Text
Remove Duplicate Lines, Sort and Clean Lists
Deduplicate, sort, shuffle, number and tidy up line-based text lists in one place.
What is Remove Duplicate Lines, Sort and Clean Lists?
Line-separated lists are the most common quick data format there is: email addresses, usernames, product codes, URLs, keywords. And the operations you need on them repeat endlessly — dedupe, sort, strip stray whitespace.
Opening a spreadsheet just to delete a few duplicate rows is slow and irritating. This tool collects the ten most useful operations in one place, each a single click, applied directly to the text in the box so you can chain steps: trim whitespace, then drop empty lines, then dedupe, then sort.
Sorting uses locale-aware comparison rather than raw character codes, so accented characters land in the correct alphabetical position. Shuffling uses the browser's cryptographic random source, producing genuinely unpredictable order.
How to use
- Paste your list into the box, one item per line.
- Check the statistics to see immediately how many duplicates and empty lines you have.
- Click the operation you need — the result replaces the text in the box, so click another to chain operations.
- Click Copy when you are done.
Frequently asked questions
Which duplicate does it keep?
The first occurrence; later ones are dropped. That preserves the original ordering of your list. If you want it reordered, apply a sort operation afterwards.
Why is there a case-sensitivity option?
Because the right answer depends on context. For email addresses, Gmail and gmail are the same thing, so leave it off. For product codes or API keys, case matters and it should be on.
What is 'keep only duplicates' for?
It surfaces the repeated entries rather than removing them. Useful when reconciling two lists or spotting data that got entered twice.
How large a list can it handle?
Tens of thousands of lines stays responsive. At hundreds of thousands the browser slows down since everything is held in memory — reach for command-line sort and uniq at that scale.