Data & CSV

Remove duplicate CSV rows

Keep the first row for each complete record or chosen key.

Remove duplicate CSV rows
Esc to restore

Your inputs

UTF-8 CSV/TSV stays on this device. First row contains unique headings; maximum 25 MB, 50,000 rows and 200 columns. Fully empty rows are ignored.

Up to 25 MB per file, 50,000 data rows, 200 columns and 2 million data cells. Fully blank rows and columns are ignored before row, column and cell limits are checked. Individual tools may have smaller result or chart limits.

Results update as you type. Larger files run when you press Update result.

Your result

LOCAL & PRIVATE

Your result will appear here.

Your inputs stay in this browser. Nothing is uploaded or saved.

A clear answer. Here’s how.

Compares exact cell text in all columns, or one chosen key column, and keeps the first occurrence in input order. Quoted commas and new lines are parsed as cell contents before comparison. Blank keys compare equal. It does not trim, change case or infer that numeric-looking IDs are equivalent.

See a worked example

Worked example

A fixed demonstration, separate from the values you enter above.

Your CSV data
ID,Name,Department,Amount,Date
001,Ada,Design,120,2026-01-05
002,Sam,Writing,80,2026-01-06
003,Jo,Design,150,2026-01-07
004,Lee,Writing,,2026-01-08
005,Alex,Design,60,2026-01-09
Column separator
Comma
Duplicate comparison
All columns

Example result

Example result
IDNameDepartmentAmountDate
001AdaDesign1202026-01-05
002SamWriting802026-01-06
003JoDesign1502026-01-07
004LeeWriting2026-01-08
005AlexDesign602026-01-09

0 duplicate rows removed; the first occurrence is retained.