Sort, shuffle and select rows in Hugging Face Datasets

iinventedlight (synthesis of cited sources); text drafted with AI assistance

Hugging Face Datasets: sort, shuffle, select

Short answer

sort, shuffle, and select rearrange a dataset and return a new Dataset. Shuffling uses a fast approximate indices mapping. [S1]

Points

Processing methods return a new dataset object. [S1]
select keeps rows by a list of indices. [S1]
Indexing into a dataset returns a dict for that row. [S2]

Claims

id: C1 claim: Processing methods return a new Dataset. source: S1 evidence: "All processing methods in this guide return a new Dataset object"
id: C2 claim: select returns rows for a list of indices. source: S1 evidence: "returns rows according to a list of indices"
id: C3 claim: Shuffle uses a fast approximate indices mapping. source: S1 evidence: "leverage its fast approximate shuffling"
id: C4 claim: Row indexing returns a dictionary example. source: S2 evidence: "indexing by the row returns a dictionary of an example from the dataset"

Sources

[S1] Process · Hugging Face. Hugging Face (Datasets docs). https://huggingface.co/docs/datasets/process . License: Apache-2.0 (huggingface/datasets docs). Accessed 2026-11-05.
[S2] Know your dataset. Hugging Face. https://huggingface.co/docs/datasets/access . License: Apache-2.0 (huggingface/datasets docs). Accessed 2026-11-05.

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted).

Source notice: Hugging Face Datasets documentation, Apache License 2.0 (https://github.com/huggingface/datasets/blob/main/LICENSE).

License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Sources: Hugging Face (Datasets docs), Process · Hugging Face, Apache-2.0 (huggingface/datasets docs); Hugging Face, Know your dataset, Apache-2.0 (huggingface/datasets docs).

Cite this

Permanent ID: iil:note:2kmbysaw

iinventedlight. 2026. "Sort, shuffle and select rows in Hugging Face Datasets." iinventedlight Library, iil:note:2kmbysaw, version of 2026-11-04. https://iinventedlight.com/library/notes/hf-datasets-sort-shuffle-select/. License: CC-BY-4.0.

@misc{iil_note_2kmbysaw,
  author = {{iinventedlight}},
  title = {{Sort, shuffle and select rows in Hugging Face Datasets}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-04},
  url = {https://iinventedlight.com/library/notes/hf-datasets-sort-shuffle-select/},
  note = {Permanent ID iil:note:2kmbysaw. License: CC-BY-4.0.},
}

Markdown

Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.

For language models and agents: start at /llms.txt. This page in Markdown: /library/notes/hf-datasets-sort-shuffle-select.md.