How to use
Use it in seconds:
- Paste your items (JSON array, CSV, or lines) into the input.
- Pick delimiter (or Auto) and comparison rules (Trim, Case-insensitive, etc.).
- Choose an output format (JSON/CSV/Lines/JS array) and click Remove duplicates.
- Copy the output.
FAQ
What input formats are supported?
JSON arrays are supported directly, and plain text lists work via delimiter splitting (lines, commas, tabs, pipes, etc.).
Does it keep the original order?
Yes—by default it keeps the first occurrence of each value. You can optionally sort the unique output.
How does case-insensitive de-duplication work?
If enabled, strings are compared using lowercased versions, so Apple and apple count as duplicates.
What do Trim and Normalize spaces do?
Trim removes leading/trailing whitespace; Normalize spaces collapses repeated whitespace inside an item to single spaces.
Can it dedupe objects in a JSON array?
Yes. Objects are compared using a stable JSON representation with sorted keys, so the same object with different key order is treated as a duplicate.
Is my data uploaded to a server?
No. The tool runs client-side in your browser and does not send network requests.
Why do numbers become strings sometimes?
If you paste plain text like 1,2,3, items are treated as text tokens; use a JSON array like [1,2,3] to keep numeric types.