Skip to main content
Solved

how to detect duplicate records in One Web?

S
Data Pioneer
Forum|alt.badge.img+2

Hello all, I have a task of detecting duplicate records from particular tables. So is there anyone who know about creating rule for this, a rule to detect duplicate values and mark it using One Web and One Desktop?

Best answer by anna.spakova

Hello @suryakanth.Emisha, I am not sure what is your version, but in the current version of Ataccama ONE you can define Aggregation rules which also include Uniqueness rules. In the documentation there is an example how to configure a uniqueness rule that will chek if the combination some attributes is unique or if there are any duplicates in the data: https://support.ataccama.com/home/docs/aip/13.9.0/user-guides/one-web-application-user-guide/data-quality/working-with-rules/aggregation-rules#AggregationRules-UniqueGroup 

Is it what you were looking for?

Kind regards,

Anna

View original
Did this topic help you find an answer to your question?

6 replies

anna.spakova
Ataccamer
Forum|alt.badge.img+3
  • anna.spakovaAtaccamer
  • Ataccamer
  • 141 replies
  • Answer
  • May 11, 2023

Hello @suryakanth.Emisha, I am not sure what is your version, but in the current version of Ataccama ONE you can define Aggregation rules which also include Uniqueness rules. In the documentation there is an example how to configure a uniqueness rule that will chek if the combination some attributes is unique or if there are any duplicates in the data: https://support.ataccama.com/home/docs/aip/13.9.0/user-guides/one-web-application-user-guide/data-quality/working-with-rules/aggregation-rules#AggregationRules-UniqueGroup 

Is it what you were looking for?

Kind regards,

Anna

M
S
2 people like this
  • M
    msyed6
  • S
    suryakanth.Emisha
S
Data Pioneer
Forum|alt.badge.img+2

Hello @anna.spakova , thanks for the help. I’ll try this method and let you know the resultant later tomorrow!

Cansu
Community Manager
Forum|alt.badge.img+3
  • CansuCommunity Manager
  • Community Manager
  • 625 replies
  • May 15, 2023

Hi @suryakanth.Emisha, could you let us know if everything worked as planned 👀

If yes, we would appreciate it if you could take a moment to mark Anna’s answer “Best Answer” and vote on the topic survey. Thank you!

Check out our Quick Start Guide to get started on the community 🙋‍♀️
S
1 person likes this
  • S
    suryakanth.Emisha
S
Data Pioneer
Forum|alt.badge.img+2

@anna.spakova , i have to check for duplicates based on one particular attribute, so the documentation which you referred works fine with two values, i have to check with one. Should i go with creating lookup or is there any other way you know?

anna.spakova
Ataccamer
Forum|alt.badge.img+3

@suryakanth.Emisha the principle is still the same, in your case simply use just one attribute to create the group and then follow the instructions.

 

S
1 person likes this
  • S
    suryakanth.Emisha
S
Data Pioneer
Forum|alt.badge.img+2

I’ve worked on this method now and waiting to know the result of this from my seniors, thanks for the help @anna.spakova !

Cansu
1 person likes this
  • Cansu
    Cansu

Reply


Most Liked this week

Community Terms of Use & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings