BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
Summary
BLIP-2 bootstraps vision-language pre-training from frozen pre-trained image encoders and frozen large language models. It bridges the modality gap with a lightweight Querying Transformer, pre-trained in two stages. The authors report state-of-the-art results with fewer trainable parameters, including outperforming Flamingo80B by 8.7% on zero-shot VQAv2 with 54x fewer trainable parameters. [S1]
Claims
- id: C1 claim: 'BLIP-2 bootstraps vision-language pre-training from frozen image encoders and frozen language models.' source: S1 evidence: "bootstraps vision-language pre-training from off-the-shelf frozen pre-trained image encoders and frozen large language models"
- id: C2 claim: 'A lightweight Querying Transformer is pre-trained in two stages.' source: S1 evidence: "a lightweight Querying Transformer, which is pre-trained in two stages"
- id: C3 claim: 'The authors report outperforming Flamingo80B by 8.7% on zero-shot VQAv2 with 54x fewer trainable parameters.' source: S1 evidence: "outperforms Flamingo80B by 8.7% on zero-shot VQAv2 with 54x fewer trainable parameters"
Verification
- Code available: Paper: https://github.com/salesforce/LAVIS/tree/main/projects/blip2, which returned HTTP 200 on 2026-11-12. Not run.
- Reproduced: not reproduced (2026-11-12). Code not run.
- Related work: Live notes 2103-00020-clip and 2304-08485-visual-instruction-tuning.
- Limits: The 8.7% and 54x figures are the authors' reported comparison with Flamingo80B on zero-shot VQAv2 (v3, 15 Jun 2023).
- License: CC BY 4.0 on the abs page (2026-11-12; icon by-4.0.png; http://creativecommons.org/licenses/by/4.0/). Submitted 30 Jan 2023 (v1); last revised 15 Jun 2023 (v3). Sources: [S1] https://arxiv.org/abs/2301.12597, v3 (15 Jun 2023). checked_on: 2026-11-12.
When to apply
Use when asking how a frozen image encoder was connected to a frozen language model with a Querying Transformer.
Facts
- id: F1 claim: 'BLIP-2 connects a frozen image encoder to a frozen language model with a lightweight Querying Transformer.' confidence: medium date: 2026-11-12 sources: [S1] license: CC BY 4.0
- id: F2 claim: 'The Querying Transformer is pre-trained in two stages, first for representation learning and then for generative learning.' confidence: medium date: 2026-11-12 sources: [S1] license: CC BY 4.0
- id: F3 claim: 'The authors report an 8.7% gain over Flamingo80B on zero-shot VQAv2 with 54x fewer trainable parameters.' confidence: medium date: 2026-11-12 sources: [S1] license: CC BY 4.0
Sources
- [S1] arXiv 2301.12597, https://arxiv.org/abs/2301.12597. License: CC BY 4.0. v3 (15 Jun 2023). Accessed 2026-11-12.
License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted). Paper is CC BY 4.0.
License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Source: Junnan Li, Dongxu Li, Silvio Savarese, Steven Hoi, BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models (CC BY 4.0).
Cite this
'iinventedlight (AI-assisted)'. 2026. "BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models." iinventedlight Library, iil:note:jj6te2ny, version of 2026-11-12. https://iinventedlight.com/library/notes/2301-12597-blip-2/. License: CC-BY-4.0.
@misc{iil_note_jj6te2ny,
author = {{'iinventedlight (AI-assisted)'}},
title = {{BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models}},
howpublished = {iinventedlight Library},
year = {2026},
date = {2026-11-12},
url = {https://iinventedlight.com/library/notes/2301-12597-blip-2/},
note = {Permanent ID iil:note:jj6te2ny. License: CC-BY-4.0.},
}
Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.
For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2301-12597-blip-2.md.