← Reference notes

Gorilla: Large Language Model Connected with Massive APIs

Summary

Gorilla is a fine-tuned LLaMA-based model for writing API calls. The authors report it beats GPT-4 at this task. With a document retriever it can adapt to API documentation that changes at test time, and it hallucinates wrong API usage less often. The paper also introduces APIBench, which covers HuggingFace, TorchHub and TensorHub APIs.

Draft. License: CC BY 4.0 (this summary). Sources: [S1] arXiv, "Gorilla: Large Language Model Connected with Massive APIs" (CC BY 4.0).

When to apply

• Agents that must call large, changing API surfaces: pair the model with retrieval over current docs.

Paper

• Title: Gorilla: Large Language Model Connected with Massive APIs
• Authors: Shishir G. Patil, Tianjun Zhang, Xin Wang, Joseph E. Gonzalez
• arXiv: https://arxiv.org/abs/2305.15334 (first posted 2023-05-24)
• License: CC BY 4.0 (checked on the arXiv abstract page 2026-11-02)
• Read for this note: arXiv abstract page; figures restate the abstract.

Related

• 2402.01030 CodeAct

Facts

• id: F1 claim: Gorilla is a fine-tuned LLaMA-based model that the authors report surpasses GPT-4 at writing API calls. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F2 claim: The motivation is that LLMs often produce wrong input arguments and hallucinate API usage. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F3 claim: Combined with a document retriever, Gorilla adapts to test-time documentation changes such as version updates. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F4 claim: The paper introduces APIBench, a dataset built from HuggingFace, TorchHub and TensorHub APIs. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02
• id: F5 claim: Code, model, data and a demo were released. confidence: medium date: 2026-11-02 sources: [S1] license: CC BY 4.0 checked_on: 2026-11-02

Caveats

• Benchmarks cover ML-model-hub APIs; results may not transfer to other API styles.
• Comparisons are to 2023 models.

Pointers

• id: P1 answers: Full method, experiments and appendices where: https://arxiv.org/abs/2305.15334 access: free, public web page

@misc{iil_note_y54460ez,
  author = {{iinventedlight Library}},
  title = {{Gorilla: Large Language Model Connected with Massive APIs}},
  howpublished = {iinventedlight Library},
  year = {2026},
  date = {2026-11-02},
  url = {https://iinventedlight.com/library/reference/arxiv/2305-15334-gorilla/},
  note = {Permanent ID iil:note:y54460ez. License: CC-BY-4.0. Summary of https://arxiv.org/abs/2305.15334.},
}

For language models and agents: start at /llms.txt. This page in Markdown: /library/reference/arxiv/2305-15334-gorilla.md.