About Remove Duplicate Lines
Use this tool to remove duplicate lines from a list. Paste one item per line and the unique lines appear instantly in the result box, together with a count of how many lines were removed and how many were kept. It works well for email lists, keywords, URLs, log files and exported spreadsheet columns. Everything happens as you type, with no button to press.
The first occurrence of each line stays in its original position, and later copies are deleted, so the order of your list is preserved. Three options are available: Ignore case treats Apple and apple as the same line, Trim whitespace ignores spaces at the start and end of each line, and Remove empty lines drops blanks. Trim and empty-line removal are on by default. Nothing is uploaded.
How to use Remove Duplicate Lines
- 01
Paste one item per line.
- 02
Choose whether to ignore case or trim spaces.
- 03
Copy the unique list.
When to use it
- Clean a mailing list so each email address appears only once.
- Deduplicate a keyword list exported from an SEO or advertising tool.
- Remove repeated URLs from a crawl or sitemap export before checking them.
- Tidy a column copied from a spreadsheet that contains repeated values.
- Shrink a log or word list while keeping the original order of first appearances.
Frequently asked questions
How do I remove duplicate lines from a list?
Paste your list with one item per line. The unique lines appear in the result box right away and the counter shows how many lines were removed. Copy the result when you are happy with it.
Is the original order of my lines kept?
Yes. The first occurrence of each line stays where it was and only later repeats are removed. If you also want the list alphabetical, run the result through the Sort Lines tool.
Does it treat uppercase and lowercase as different lines?
By default yes, so Apple and apple are both kept. Turn on Ignore case to treat them as duplicates; the first version that appeared is the one that stays in the result.
Why are lines with extra spaces still counted as duplicates?
Trim whitespace is on by default, so spaces at the start or end of a line are ignored when comparing, and they are removed from the kept lines. Turn the option off to compare lines exactly as typed.
Can it delete blank lines too?
Yes. Remove empty lines is on by default and drops blank lines, and lines with only spaces, from the result, counting them as removed. Turn it off to keep one blank line as a normal entry.
Is there a limit on list size, and is it private?
Processing happens in your browser, so nothing is uploaded and there is no set limit. Very large lists depend on your device memory. The tool matches exact line text, not similar lines.