Which duplicate is kept?
You can keep either the first or last occurrence. The retained line keeps its original spelling unless trimming is enabled.
Duplicate Line Remover & Sorter
Find repeated or one-off lines, inspect frequencies, and sort or shuffle the live result.
Workspace
Preparing line cleanup…
0 considered, 0 distinct, 0 duplicate occurrences, and 0 result lines.
Review line frequencies
Add lines to populate the report.
Matching options affect comparison only; the retained line keeps its original content unless edge trimming is enabled.
GuideHow to use
- Paste one item per line or load the sample.
- Choose which occurrence to keep, how lines should be matched, which occurrence groups to output, and how results should be ordered.
- Review the live counts and frequency report, shuffle manually if selected, then copy, download, export, or reuse the result.
HelpFrequently asked questions
Can I show only repeated or non-repeated lines?
Yes. The Output control can return one of every distinct line, only lines that occur more than once, or only lines that occur once.
Can I sort numbers correctly?
Yes. Numeric sorting accepts lines that are entirely valid numbers. Other lines remain grouped after numeric values.
How can I match spacing variations?
Turn on Ignore repeated spaces and tabs to compare lines after collapsing runs of horizontal whitespace. The retained line itself is not rewritten by that matching rule.
What does equivalent Unicode mean?
Visually equivalent composed and decomposed text, such as two encodings of café, can be matched as duplicates while preserving the original kept line.
What is included in the frequency CSV?
It contains every distinct retained line and its occurrence count. Values that could be interpreted as spreadsheet formulas are safely prefixed when exported.
Why does shuffle use a button?
Random ordering is an intentional action. If the source or options change, the live unique list is shown until you shuffle the updated result again.
Keep working
Related tools
Text & WritingPlain Text Formatter
Strip formatting from pasted text and keep commas, line breaks, and full stops.
Text & WritingEmail Formatter
Extract, sort, and format unique email addresses with a live result.
Text & WritingWord & Character Counter
Count words, characters, sentences, paragraphs, and estimated reading time.