Why use this tool?
Cleaning duplicate entries out of a list, log file, or email list by hand is tedious and error-prone. This tool scans your text line by line and removes repeats instantly, with options to control case sensitivity and whitespace trimming.
Everything runs locally in your browser, your data is never uploaded or stored.
Frequently asked questions
How does this tool decide what counts as a duplicate?+
It compares each line to the ones seen before. With "Trim whitespace" enabled, leading/trailing spaces are ignored; with "Case-sensitive" off, "Apple" and "apple" are treated as the same line.
Does this keep the first or last occurrence of a duplicate?+
It keeps the first occurrence of each unique line and removes any repeats that come after it, preserving the original order.
Does this tool store or upload my text?+
No. All processing happens locally in your browser using JavaScript. Nothing is sent to a server.
Can I use this for CSV or list data?+
Yes, it works on any line-based text, lists, CSV rows treated as plain text, log files, or email lists.