Kimi k1.5: Scaling Reinforcement Learning with LLMs
Summary
Kimi k1.5: Scaling Reinforcement Learning with LLMs (2025) is Moonshot's open report on scaling reinforcement learning for a long-context, multimodal reasoning model, published in the same period as DeepSeek-R1 and discussions of OpenAI's o1.
What it introduced: a relatively simple RL recipe that the authors say does not rely on Monte Carlo tree search, value functions, or process reward models. Long-context scaling and improved policy optimization are the main ingredients. They also describe long2short methods that use long chain-of-thought training to improve short chain-of-thought models. The report includes results on math, coding, and visual math benchmarks, including a comparison with o1 on several of those suites.
What it led to: one of the main public references for large-scale RL on reasoning models outside the DeepSeek-R1 line. Live notes: 2501-12948-deepseek-r1 and 2402-03300-deepseekmath. Qwen2.5-Math is another pointer note in this batch.
Where to read it: https://arxiv.org/abs/2501.12599 (v4, last revised 3 Jun 2025).
The paper is posted under CC BY-NC-ND 4.0. This note links to it rather than reproducing it. The note itself is CC BY 4.0.
License: this note is CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Pointer by iinventedlight (AI-assisted). Paper license: CC BY-NC-ND 4.0; this note links to it and does not reproduce it.
License: CC-BY-4.0 · Pointer by iinventedlight (AI-assisted). Source: Kimi Team and 95 coauthors (listed on the arXiv abs page), Kimi k1.5: Scaling Reinforcement Learning with LLMs (CC BY-NC-ND 4.0). This note links to the paper rather than reproducing it.
Cite this
'iinventedlight (AI-assisted)'. 2026. "Kimi k1.5: Scaling Reinforcement Learning with LLMs." iinventedlight Library, iil:note:38mhhbjv, version of 2026-11-12. https://iinventedlight.com/library/notes/2501-12599-kimi-k1.5/. License: CC-BY-4.0.
@misc{iil_note_38mhhbjv,
author = {{'iinventedlight (AI-assisted)'}},
title = {{Kimi k1.5: Scaling Reinforcement Learning with LLMs}},
howpublished = {iinventedlight Library},
year = {2026},
date = {2026-11-12},
url = {https://iinventedlight.com/library/notes/2501-12599-kimi-k1.5/},
note = {Permanent ID iil:note:38mhhbjv. License: CC-BY-4.0.},
}
Spotted a mistake? Use the MCP feedback tool or email hello@iinventedlight.com.
For language models and agents: start at /llms.txt | /agents.md | /.well-known/agent-library.json. This page in Markdown: /library/notes/2501-12599-kimi-k1.5.md.