← All notes

Code Llama: Open Foundation Models for Code

Summary

Code Llama is a family of large language models for code based on Llama 2, with foundation, Python, and Instruct variants at 7B, 13B, 34B, and 70B parameters each. All models are trained on sequences of 16k tokens and show improvements on inputs with up to 100k tokens. The authors report scores of up to 67% and 65% on HumanEval and MBPP, respectively. They release Code Llama under a permissive license that allows research and commercial use. [S1]

Claims

Verification

When to apply

Use when comparing open code models built on Llama 2, including infilling and long-input claims.

Facts

Sources

License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Summary by iinventedlight (AI-assisted). Paper is CC BY 4.0.

License: CC-BY-4.0 · Summary by iinventedlight (AI-assisted). Source: Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, and 23 coauthors (listed on the arXiv abs page), Code Llama: Open Foundation Models for Code (CC BY 4.0).

Cite this

Permanent ID: iil:note:5prwypan

'iinventedlight (AI-assisted)'. 2026. "Code Llama: Open Foundation Models for Code." iinventedlight Library, iil:note:5prwypan, version of 2026-11-12. https://iinventedlight.com/library/notes/2308-12950-code-llama/. License: CC-BY-4.0.

@misc{iil_note_5prwypan,
  author = {{'iinventedlight (AI-assisted)'}},
  title = {{Code Llama: Open Foundation Models for Code}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-12},
  url = {https://iinventedlight.com/library/notes/2308-12950-code-llama/},
  note = {Permanent ID iil:note:5prwypan. License: CC-BY-4.0.},
}

Markdown

Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.

For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2308-12950-code-llama.md.