Deduplication of records using Zapier AI?

Hey ​@ClayPotter,

I think it can be handled by having a Find Record action before creating a New Record. From there you can add an AI by Zapier step to check for similarity and score it accordingly. You can make a logic and depending on that you either make a new record or update the existing one.

You can also have confidence score here and have a approval step in case of low confidence so you have full control over the workflow. 

Hope it helps!

PS: If you need more active help, I’m happy to connect through my Zapier Solution Partner page if you’d like to reach out here- https://zapier.com/partnerdirectory/automation-jinn

Hi ​@ClayPotter! 👋 

Definitely worth giving Sparsh’s suggestion a try if you haven’t already. Depending on how complex the comparison and searching needs to be, you might need to add additional search actions to find potential duplicates based on different data points and pass those to the AI by Zapier action to compare as well.

You could also try Zapier Agents for this. Similar to a Zap, an agent can be triggered when new CRM data comes in, and then have multiple agents working together on separate tasks to perform a more extensive search and comparison to check for duplicates.

Let us know how you get on!

​@Sparsh from Automation Jinn : Thank you for replying. I like the suggestion, however, since this “fuzzy matching” within AI is still very much dependent on a prior step to perform a deterministic search query (“Find Record”) -- the results are somewhat unpredictable. Yet, this is a good starting point. 

A second part remains: how can AI actually perform the deduplication. If we can trust AI for recognizing dupes, then it should be possible to merge them as well -- however, in practice this is not easy because in some CRM’s like Salesforce, this involves merging several object records (and I understand that here, the onus is on the CRM to allow deduplication via an API first, because Zapier works with whatever the endpoint allows it to do.)

Thank you, this has been a good discussion. Ultimately, it may actually be more worthwhile to dump the data into an export file and perform an AI-assisted analysis -- because this way the agent gets to view the entire dataset.