eunomie/devstral-small-2505 repository overview

⁠Devstral-Small-2505 (gguf)

Devstral is an agentic LLM for software engineering tasks built under a collaboration between Mistral AI⁠ and All Hands AI⁠ 🙌. Devstral excels at using tools to explore codebases, editing multiple files and power software engineering agents. The model achieves remarkable performance on SWE-bench which positionates it as the #1 open source model on this benchmark⁠.

This is the GGUF version of the Devstral-Small-2505⁠ model. We released the BF16 weights as well as the following quantized format:

• Q8_0 (recommended)
• Q4_K_M (recommended)
• Q4_K_M (recommended)

It is finetuned from Mistral-Small-3.1⁠, therefore it has a long context window of up to 128k tokens. As a coding agent, Devstral is text-only and before fine-tuning from Mistral-Small-3.1 the vision encoder was removed.

For enterprises requiring specialized capabilities (increased context, domain-specific knowledge, etc.), we will release commercial models beyond what Mistral AI contributes to the community.

Learn more about Devstral in our blog post⁠.

⁠Key Features:

• Agentic coding: Devstral is designed to excel at agentic coding tasks, making it a great choice for software engineering agents.
• lightweight: with its compact size of just 24 billion parameters, Devstral is light enough to run on a single RTX 4090 or a Mac with 32GB RAM, making it an appropriate model for local deployment and on-device use.
• Apache 2.0 License: Open license allowing usage and modification for both commercial and non-commercial purposes.
• Context Window: A 128k context window.
• Tokenizer: Utilizes a Tekken tokenizer with a 131k vocabulary size.