Dedupe all records

Once you have setup your settings in the Dedupe app, is there a way to just have it apply the same pattern to ALL the rest of the duplicates? If you have hundreds of duplicates, it’s imposible to do this one by one.

Sorry, no, the Dedupe app cannot do this. The Dedupe app expects you to manually select the relevant fields for each set of duplicate. However, if you know JavaScript, you could put that logic into a custom script.

Hi,

I had the same problem last year. Even started to write my own ‘bulk deduper’ script, but final result was far from my expectations. And then i’ve found a way to do almost the same without scripting.

I would advice to use no-code approach, described here, but don’t remove temporary table and fields.

it works according to Airtable behaviour for ‘copy-pasting something into link field’ - it searches matched value (ignoring ‘Limit selection by a view’ setting, but that’s another story) and then if it not exist, creates new record with that value.

After you create count field in temporary table and pass it via lookup in first table, you can filter ‘duplicates only’ (count>1) and divide them them into 2 groups according to your pattern. Since every ‘duplicate set’ represented by single record in temporary table, you can create other lookups (or rollups with ARRAYUNIQUE) in it (temporary table) and clearly see - which field values are match and which are ‘conflicting’.

1 Like