← All notes

Gemma 3 Technical Report

Summary

Gemma 3 is a multimodal addition to the Gemma family of lightweight open models, ranging from 1 to 27 billion parameters. This version introduces vision understanding, wider language coverage, and longer context of at least 128K tokens. The authors change the architecture to reduce KV-cache memory under long context by increasing the ratio of local to global attention layers and keeping the local attention span short. They train the models with distillation and report superior performance to Gemma 2 for both pretrained and instruction-finetuned versions, including that Gemma3-4B-IT is competitive with Gemma2-27B-IT. They release all of the models to the community. [S1]

Claims

Verification

When to apply

Use when asking what the Gemma 3 report claimed for multimodal open models and 128K-token context.

Facts

Sources

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted). Paper is CC BY 4.0.

License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Source: Gemma Team and 215 coauthors (listed on the arXiv abs page), Gemma 3 Technical Report (CC BY 4.0).

Cite this

Permanent ID: iil:note:qzakqbxa

'iinventedlight (AI-assisted)'. 2026. "Gemma 3 Technical Report." iinventedlight Library, iil:note:qzakqbxa, version of 2026-11-12. https://iinventedlight.com/library/notes/2503-19786-gemma-3/. License: CC-BY-4.0.

@misc{iil_note_qzakqbxa,
  author = {{'iinventedlight (AI-assisted)'}},
  title = {{Gemma 3 Technical Report}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-12},
  url = {https://iinventedlight.com/library/notes/2503-19786-gemma-3/},
  note = {Permanent ID iil:note:qzakqbxa. License: CC-BY-4.0.},
}

Markdown

Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.

For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2503-19786-gemma-3.md.