COGNOiSe.com - The IBM Cognos Community

ETL, App Development and other tools => COGNOS DecisionStream/Data Manager => Topic started by: csss2cognos on 06 Mar 2012 12:40:10 AM

Title: Cleansing data with Data Manager
Post by: csss2cognos on 06 Mar 2012 12:40:10 AM
Hi dude,

I am wondering is Data Manager so powerful to achieve following examples:

Elementizing:-  Breaks a data record into elements (e.g., the address 1 Pennsylvania Avenue is broken down
into Street Number: 1, Street Name: Pennsylvania Avenue, Street Type: Avenue
).

Standardizing:-  Standardizes fields to contain identical values for equivalent data elements (e.g., Street or ST,
Lane or LN, Circle or CIR, etc.
)

Thank you very much!
Edward
Title: Re: Cleansing data with Data Manager
Post by: MFGF on 06 Mar 2012 04:17:04 AM
You can use derivations and lookups to achieve these kinds of examples. There are no specific inbuilt functions for this, but you can effectively roll your own using whatever technique best suits the desired goal - the first example would probably need substr() to extract the various parts of the address and the second could utilise a lookup fed via static members for each translation you need.

Regards,

MF.
Title: Re: Cleansing data with Data Manager
Post by: csss2cognos on 07 Mar 2012 04:11:24 AM
Hi MF,

Thank you very much for your reply!

I will have a try on it.

Regards,
Edward