+1Hi!
I am profiling tables and am looking at the profiles. I noticed that for date and datetime the profile does not show the MIN or MAX values. That is something I had expected though. Working on the data quality of this data, I really would like to know the MIN and MAX values for these attributes. Is there a way to change the configuration and include these profile statistics for these datatypes?
kind regards, Jur Dördregter
Best answer by ekaterina.ponomareva
Hi
I can see that your data source is Hadoop, so it is indeed because of that.
Kind regards,
Ekaterina
Hi
Thank you for your question!
As you are correctly pointing out, numerical statistics are calculated only for numeric attributes.
However, you can have a look at the Quantiles - They display the values that occur at designated intervals in the ordered data set, with the first value on the list shown at 0% and the last value at 100%.
If your date type attributes have standardized format, like YYYY-MM-DD, it will work for you, as well.
Hope this will help you!
Kind regards,
Ekaterina
+1Hi
I tried your solution, however it does not show the quantiles in my profiling, is this due to our version or the source used?
kind regards, Jur Dördregter
Hi
I can see that your data source is Hadoop, so it is indeed because of that.
Kind regards,
Ekaterina
Hi
+1
Hi
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
