COGNOiSe.com - The IBM Cognos Community

IBM Cognos 10 Platform => Cognos 10 BI => Report Studio => Topic started by: hespora on 27 Feb 2018 06:04:30 AM

Title: std.deviation yielding NaN when it should yield zero
Post by: hespora on 27 Feb 2018 06:04:30 AM
Hi there,


please refer to report definition against the samples attached.

when using cognos statistical function standard-deviation-pop, the system sometimes yields Not a number as a result. It seems it only does so when the result should be zero (or infintessimally small); on the example report attached, it happens for product numbers '18110' and '123150', for example.

Has anybody seen something like that or even knows a solution?
Title: Re: std.deviation yielding NaN when it should yield zero
Post by: hespora on 27 Feb 2018 07:47:32 AM
for now, I'm solving it by calculating variance and standard deviation manually.