How to check duplicate records in ONE Desktop, and using fuzzy logic?

Badge +1

Hello. i have a general material data csv file, and in that i have to check for duplicates based on material data. Currently i'm trying with the matching step by creating partitions and key rules but still i'm not sure about it. So is there anyone knows about solving this process?? Thanks!


Best answer by AKislyakov 25 May 2023, 10:23

View original

2 replies

Userlevel 3
Badge +4

Hi Suryakanth,

You can find a tutorial on how to configure the Matching step in the Tutorials project > 09 Match and merge > 09.01 Match and merge.plan.

If you're new to this, I suggest trying the Canopy Clustering step first. It requires less configuration and is more user-friendly. You can find an example usage in the Tutorials project > 07 Analyze > 07.10 Clustering.plan.

The Canopy Clustering step allows you to setup components which will be used to search for duplicates, their weights and thresholds when to consider two records belonging to the same group.



Badge +1

Hello @AKislyakov ,I'll work on this method and let you know the resultant, thanks.