Remove duplicate lines
Clean up a list while keeping its original order.
Result
Start typing and the result appears here. No button needed.
Remove duplicate lines, without the extra steps.
Remove repeated lines from a pasted list. The first occurrence of each line is kept, preserving the original order. Exact matching is the default; switch to Ignore case and spacing when the same entry has been typed as "Anna", "anna", and " Anna ".
How to use this tool
- 1Paste one entry per line.
- 2Choose exact matching, or ignore case and spacing.
- 3Copy the cleaned list.
When Remove duplicate lines is the right tool
- Two mailing lists were merged and share entries.
- A log or export repeats identical rows.
- A pasted list of tags or SKUs needs collapsing to unique values.
- You need a clean set before counting or importing.
Matching is exact
Lines are compared character for character, so a trailing space, a differing capital, or a stray tab makes two otherwise identical lines distinct. This is the safe default — it never merges records that only look alike — but it means you should trim and normalise case first when the data came from mixed sources. The first occurrence of each line is kept and order is preserved.
When exact matching is not enough
Near-duplicates are unaffected: "Acme Ltd" and "Acme Ltd." remain two entries, as do the same email address in different cases. Deduplicating contact data usually needs case normalisation first, and genuinely fuzzy matching needs a dedicated tool. Check the before-and-after counts to confirm the result matches what you expected to remove.
A few quick answers.
Paste one entry per line. Choose exact matching, or ignore case and spacing. Copy the cleaned list.
Tool inputs are processed in your browser. Crate has no upload endpoint and no accounts. Downloaded site assets and a cookie-free page-view count still require a connection; your files and text are not included in those requests.
Exact matching is case-sensitive and preserves whitespace; the loose mode compares entries trimmed and lowercased but keeps the first spelling it saw. Blank lines are treated as entries, and only the first blank line is retained.
No. Matching is exact, so “Acme Ltd” and “Acme Ltd.” both remain. Normalise case and trim whitespace first if the data came from mixed sources.
The first occurrence of each line, with the original order of the remaining lines preserved.