← All notes

Answer: Transformers and estimators (predictors) can be combined together into a single unifying object: a Pipeline. The pipeline offers the same API as a regular estimator: it can be fitted and used for prediction with fit and predict. (S2)

Why use one

• Pipeline can be used to chain multiple estimators into one. (S1)
• You only have to call fit and predict once on your data to fit a whole sequence of estimators. (S1)
• You can grid search over parameters of all estimators in the pipeline at once. (S1)
• Pipelines help avoid leaking statistics from your test data into the trained model in cross-validation, by ensuring that the same samples are used to train the transformers and predictors. (S1)

Rules

• Pipelines require all steps except the last to be a transformer. (S1)
• A pipeline exposes all methods provided by the last estimator. (S1)
• A typical pipeline consists of a pre-processing step that transforms or imputes the data, and a final predictor that predicts target values. (S2)
• FeatureUnion concatenates the output of transformers into a composite feature space. (S1)

Claims

• id: C1 claim: A Pipeline has the same API as an estimator. source: S2 evidence: "offers the same API as a regular estimator"
• id: C2 claim: All steps except the last must be transformers. source: S1 evidence: "Pipelines require all steps except the last to be a"
• id: C3 claim: Pipelines help avoid leaking test statistics. source: S1 evidence: "Pipelines help avoid leaking statistics from your test data into the"
• id: C4 claim: You can grid search over all pipeline parameters. source: S1 evidence: "over parameters of all estimators in the pipeline at once."

Sources

• [S1] 8.1. Pipelines and composite estimators — scikit-learn 1.9.1 documentation. scikit-learn docs. https://scikit-learn.org/stable/modules/compose.html . License: BSD-3-Clause (scikit-learn/scikit-learn COPYING; Copyright (c) 2007-2026 The scikit-learn developers; https://github.com/scikit-learn/scikit-learn/blob/main/COPYING). Accessed 2026-11-04.
• [S2] Getting Started — scikit-learn 1.9.1 documentation. scikit-learn docs. https://scikit-learn.org/stable/getting_started.html . License: BSD-3-Clause (scikit-learn/scikit-learn COPYING; Copyright (c) 2007-2026 The scikit-learn developers; https://github.com/scikit-learn/scikit-learn/blob/main/COPYING). Accessed 2026-11-04.

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted).

@misc{iil_note_5r03n8kh,
  author = {{iinventedlight}},
  title = {{scikit-learn Pipelines}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-04},
  url = {https://iinventedlight.com/library/notes/sklearn-pipelines/},
  note = {Permanent ID iil:note:5r03n8kh. License: CC-BY-4.0.},
}

Markdown

Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.

For language models and agents: start at /llms.txt. This page in Markdown: /library/notes/sklearn-pipelines.md.