Loading Profile...
Twitter,
Facebook, or email.
Frequency analysis
I have about 1.5 million records in the table.When I import these records as a file and create a profile in DQ analyzer,it reads all the rows.But frequency analysis is done only for 20,000 records.
Official
Response
-
EMPLOYEE
1Hi Krithika, the number of records (distinct values) you see in the frequency analysis view is determined by 2 factors:
1. The number of records (distinct values) stored in the .profile file during the computation. This value is setup in the Profiling step in the property "Output limit". You will need to switch to the "Normal layout" using a button in the top right corner of the Step dialog (after you double click the Profiling step).
It is not advised to set this value too high since it makes the .profile files potentially very large (in case of unique columns you could store the whole dataset).
2. The second option influencing the number of records you see in the Frequency view is option in the properties
Window -> Preferences -> Ataccama DQ Analyzer -> Profiler -> Read limit
This determines how many lines (distinct values) will be shown in the Frequency view (with maximum being the number of records stored in the .profile file).
Therefore if you are interested in seeing more then 20 000 values in the Frequency tab, increase the "Output limit" on the profiling step before starting the plan and change the number on your Read limit in the preferences.
-
EMPLOYEE
1Hi Krithika, the number of records (distinct values) you see in the frequency analysis view is determined by 2 factors:
1. The number of records (distinct values) stored in the .profile file during the computation. This value is setup in the Profiling step in the property "Output limit". You will need to switch to the "Normal layout" using a button in the top right corner of the Step dialog (after you double click the Profiling step).
It is not advised to set this value too high since it makes the .profile files potentially very large (in case of unique columns you could store the whole dataset).
2. The second option influencing the number of records you see in the Frequency view is option in the properties
Window -> Preferences -> Ataccama DQ Analyzer -> Profiler -> Read limit
This determines how many lines (distinct values) will be shown in the Frequency view (with maximum being the number of records stored in the .profile file).
Therefore if you are interested in seeing more then 20 000 values in the Frequency tab, increase the "Output limit" on the profiling step before starting the plan and change the number on your Read limit in the preferences.Comment -
-
I’m
happy
Hi
Thanks a lot.It works fine. -
