Remove Duplicate Lines
Clean up a list by removing duplicate or blank lines, instantly.
Input
Output
Why remove duplicate lines?
Merged exports, copied spreadsheet columns and concatenated logs all accumulate repeats, and spotting them by eye in a list of thousands is impossible. This strips them in one pass while preserving your original order — so a ranking, a log or a sequence stays meaningful instead of being alphabetised into nonsense.
How it works
- Paste your list, one item per line.
- Turn on case-insensitive matching if needed.
- Optionally strip blank lines at the same time.
- Copy the cleaned list, and see how many lines were removed.
Frequently Asked Questions
Which occurrence of a duplicate is kept?
The first occurrence of each line is kept; later duplicates are removed, preserving your original line order.
Can I ignore case when comparing lines?
Yes — enable "Case insensitive" so "Apple" and "apple" are treated as duplicates.
Are blank lines treated as duplicates?
No. Blank lines are kept as-is and never deduplicated against each other, so your paragraph spacing is preserved. If you'd rather strip every empty line, turn on "Remove blank lines".
Does leading or trailing whitespace affect matching?
Yes — two lines that differ only by a trailing space are treated as different. Trim the whitespace first if you want them matched, which is a common gotcha with copied spreadsheet columns.
How many lines can it handle?
Lists of tens of thousands of lines process in well under a second. Everything runs in your browser's memory, so the practical ceiling is your device rather than a fixed limit.
Does it sort the output?
No. Order is preserved deliberately, since sorting would destroy meaningful sequences like logs or rankings. Use the text sorter if you also want the result sorted.
Can I see which lines were duplicated?
The counter reports how many lines were removed, so you can tell at a glance how much overlap there was between the entries.
Is it good for cleaning up email or address lists?
Yes, it's one of the most common uses. Paste one address per line and turn on case-insensitive matching, since email addresses are not case-sensitive in practice.
Will it remove duplicate words within a line?
No. It works line by line, so a repeated word inside a single line is left alone. Split your text so each item sits on its own line first.
Is my text uploaded anywhere?
No. Everything runs locally in your browser — nothing is sent to a server.
Related tools
More free, private, browser-based utilities — no upload, no sign-up.

Davemi