Free Online CSV Duplicate Remover, By Row or By Column
Remove duplicate rows from a CSV in your browser. Judge duplicates on the whole row or on the columns that identify a record, such as an email, and keep the first copy, the last one, or whichever copy has the most fields filled in. You can also list the duplicates instead of removing them, or add a count column.
| Nothing to show yet. |
| Nothing to show yet. |
Enjoying WizTools123? Help keep our server infrastructure 100% free and open for everyone.
How to Use Bulk CSV Duplicate Remover
Step by step, start to finish.
One or many. Each file is deduplicated on its own; rows are never merged between files.
Every column, or just the ones that identify a record. An email column alone is usually the right answer for a contact list.
First, last, or the one with the most fields filled in. The last of those is usually what you want when the duplicate was a later, better record.
The mode menu can list only the repeated rows instead of removing anything, which is how you check before you commit.
Key Features
What this tool does, and what it does not do.
Judge duplicates on an email, an ID, or any combination of columns, named by heading or letter.
Keep the copy with the most fields filled in, which is usually the record worth keeping.
Add how many times each row appeared, turning the duplicates into a frequency table.
List only the repeated rows, or only the unique ones, without changing anything.
Every file deduplicated with the same rules, downloaded together as one zip.
Contact lists are deduplicated inside this tab and never sent anywhere.
About Bulk CSV Duplicate Remover
Duplicate rows arrive in two shapes. The easy shape is an exact repeat, usually caused by running an export twice or pasting the same block twice, and almost anything can remove those. The hard shape is the one that matters: the same person or product recorded more than once with slightly different details, which is what happens whenever data is entered by hand or merged from two systems.
The hard shape cannot be found by comparing whole rows, because the rows genuinely differ. It is found by deciding which columns identify a record, which only you know. An email identifies a contact; a name does not, because two people share a name. An order number identifies an order; a date does not. Once the key is chosen, the duplicates are obvious.
Then comes the question most tools skip: which copy survives. Keeping the first is the usual default and often wrong, because the later record is frequently the corrected one. Keeping the last is wrong just as often. Keeping the copy with the most fields filled in is the answer that matches what people actually want, since the duplicate that carries a phone number is more useful than the one that does not, whenever it arrived.
Frequently Asked Questions
Common questions about this tool.