COGNOiSe.com - The IBM Cognos Community

Legacy Business Intelligence => COGNOS Impromptu => Topic started by: LarryN on 17 Feb 2011 12:47:15 PM

Title: Impromptu (with Distinct) clause and Transformer - Performance and duplicattes
Post by: LarryN on 17 Feb 2011 12:47:15 PM
I have a client running Imp 7.5 against a SQL Server 2005 (on Win 7), a 1-table View. When I run the View in SQL Server, I only get one row per ticket_No field. Total 900,000 rows

When I run the IMR, I get three duplicate rows per Ticket_No field/column, save as IQD and run Transformer - Very fast - but triple the measure values (if summed)

- so I use the remove Duplicate Rows option in IMP, run the IQD in Transformer, and now it takes 5 minutes to complete 1000 rows - this is unacceptable.

Does anyone know of a performance issue or a tip to get Transformer to read "Distinct" IQD files faster?

Thanks

Title: Re: Impromptu (with Distinct) clause and Transformer - Performance and duplicattes
Post by: MFGF on 18 Feb 2011 06:19:13 AM
If you open the IQD in Notepad, how has the SQL query been defined?  Is there anything in there which you can see would cause the duplication?

MF.
Title: Re: Impromptu (with Distinct) clause and Transformer - Performance and duplicattes
Post by: LarryN on 18 Feb 2011 09:20:32 AM
The IQD shows that the "Ticket_No" is only coming from the source SQL Server View table. I will have to verify that the column in the View is actually the master column and not the detail one, but I doubt that since, as mentioned, when running the View in SQL Server - I do not get the duplication of rows?????

Also when running the SQL from the IQD separately - no duplication (more question marks???)

Thanks - I'll Keep looking