Skip to main content
Solved

How to define data types in Ataccama using regular expression syntax


Forum|alt.badge.img

Hi, 

I am trying to write some rules to check the data type of attributes within sql tables or flat file columns. I am aware that profiling checks this but I have a requirement to check the data type as well. There don’t appear to be any parse functions in the interface. Any help would be appreciated, I am a noob so please be gentle :)

Best answer by anna.spakova

Hello @Delbert71 , the DQ rules are applied to the data and not the metadata (which is the data type). So unfortunately it is not possible to check the data type this way. If you have a value stored as string, you can test it for proper date formats, numbers etc., but when the attribute is already something different than string (e.g. Integer), you can apply only DQ rules that have the Integer attribute as an input.

What we suggested to other clients, you can do this check via the ONE Desktop plan - you download the metadata for the table (attribute data types) and check the value of it. You can then send the results to your desired destination (DB, file, ...)

Please let me know if this answers your question.

Kind regards,

Anna

View original
Did this topic help you find an answer to your question?

2 replies

anna.spakova
Ataccamer
Forum|alt.badge.img+3
  • Ataccamer
  • 144 replies
  • Answer
  • August 22, 2024

Hello @Delbert71 , the DQ rules are applied to the data and not the metadata (which is the data type). So unfortunately it is not possible to check the data type this way. If you have a value stored as string, you can test it for proper date formats, numbers etc., but when the attribute is already something different than string (e.g. Integer), you can apply only DQ rules that have the Integer attribute as an input.

What we suggested to other clients, you can do this check via the ONE Desktop plan - you download the metadata for the table (attribute data types) and check the value of it. You can then send the results to your desired destination (DB, file, ...)

Please let me know if this answers your question.

Kind regards,

Anna


Forum|alt.badge.img
  • Author
  • Universe Traveller
  • 6 replies
  • August 22, 2024

Good morning Anna,

Many thanks for your reply.

I think that option will work for me.

Thanks for sharing.

Kind regards

Derek


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings