Skip to content

Sort and deduplicate lines

Order text lines case-insensitively and remove exact duplicate rows.

Install in Serialize

What it can do

  • Split by line feeds
  • Apply case-insensitive ordering
  • Remove exact duplicates

How the recipe works

Sort

Sort lines without treating case as the primary key.

Unique

Keep the first copy of each exact line.

Demonstration

Sample input

Beta
alpha
beta
Alpha
alpha

Expected result

alpha
Alpha
Beta
beta

When to use it

  • Indicator lists
  • Test fixtures
  • Cleaning copied data

Adapt it

Normalize case before Unique when Alpha and alpha should count as the same value.

Source and verification

Adapted from GCHQ CyberChef project and examples. The explanation and sample are written for Serialize, use synthetic or documentation-safe data, and are checked against the current operation catalogue. The workflow runs locally without an external API call.

Navigation

Type to search…

↑↓ navigate↵ selectEsc close