Performance issue with Transformer C10.1.1 (RS datasources) vs C8 (IQDs sources)

[Stephane Lambert]

Hi all,

I'm migrating cubes from C8 (with IQDs datasources) to C10.1.1 (with RS datasources).

My challenge is the old model (C8) run in 2 or 3 minutes but the new one (C10.1.1) take, at least, 5 to 10 minutes just for the validation of datasources so the entire cube build in an average of 12 minutes. And this is a very small model. A medium size model takes now around half an hour just to validate when it was building in about 15 minutes on C8 with IQDs sources.

Any clue on what can cause this ?

[wyconian]

Hi

I would imagine there is a differnce in the way the IQD has been written compared to framework model.

Try taking a look at the script for the IQD and compare it to how the relationships have been defined in the FM model.

Good luck

[pricter]

There is an automation in the properties of the data sources "Auto Aggregate" or something similar I do not have
an Transformer in front of me.

This option groups your data. If your data are grouped you can unckecked it.

I have noticed I dramatically improved of performance when I unckecked this option.

[Stephane Lambert]

The problem is not at the fetch level but at the query validation level.

The fetch time is exactly the same as the old IQDs.

[wyconian]

What is the source for your new cube?  If it's a report Transformer will have to run the report into memory before it can be used as a source whereas with an IQD it will go straight to the database and retrieve the data as needed