Qwen-Agent
Native Qwen framework. Best tool-call alignment for Qwen2.5-Coder 32B.
Qwen2.5-Coder 32B is the open-weight code model that landed inside the GPT-4o tier on every public coding benchmark. Released November 11, 2024 under Apache 2.0, trained on 5.5 trillion tokens spanning 92 programming languages.
Specs that matter when picking the model and the hardware.
32.5B dense (31.0B non-embedding)
128K tokens
Apache 2.0
November 11, 2024
5.5T tokens, 92 programming languages
92.7
90.2
73.7
19GB
22GB
34GB
42
55-70
18
Three tiers, real SKUs, real throughput numbers.
Throughput: 18-42 tokens/sec. Best for: Solo developers, small teams, IDE autocomplete, code review.
Throughput: 55-90 tokens/sec. Best for: 5-15 engineer teams, vLLM serving for shared autocomplete, Q5/Q6 quality, code generation server.
Throughput: 120-200 tokens/sec. Best for: 30+ engineer org, multi-tenant code platform, fine-tuning loop, internal Copilot replacement.
Feedback from the people who were in the room when decisions were made.
I used to spend every Sunday reconciling contractor invoices. Now they match automatically. I got my weekends back.
Crew scheduling was a nightmare. Guys would show up at the wrong site or not at all. The automated dispatch board fixed that in week two.
Three drivers called out on the same morning. The system reassigned every route before I finished my coffee. That used to take two hours of phone calls.
GGUF, AWQ, FP8, INT4.
Q4_K_M for single-user and consumer GPU. Q5_K_M or Q6_K when VRAM allows (RTX 5090 or larger), better code quality on edge cases. AWQ INT4 for vLLM serving. FP8 on H100 only if you are running a fleet.
Code models are sensitive to quantization on long-form generation. Q4 is fine for IDE autocomplete and edit-style tasks. Q5_K_M and Q6_K are noticeably better on writing functions from scratch or multi-file refactors. Q8_0 forces offload on RTX 4090 (~34GB), drops throughput from 42 to 22 tokens per second.
File size: 19GB.
File size: 22GB.
File size: 34GB.
File size: 18GB.
Best 'budget' agentic coder in 2026: matches GPT-4o on HumanEval, runs on a single RTX 4090 at Q4_K_M.
Best fit. Aider's diff-edit format does not depend on aggressive multi-turn tool loops, so Qwen2.5-Coder 32B's tool-call quirks do not bite. 73.7 percent on the Aider code-repair benchmark, comparable to GPT-4o. Run aider --openai-api-base http://your-vllm:8000/v1 --model openai/Qwen2.5-Coder-32B-Instruct.
Strong fit: config.yaml with provider: openai or vllm, apiBase to your endpoint. Tab autocomplete works at Q4_K_M on a single RTX 4090. Use as the autocomplete-and-edit role; pair with a smaller fast model for inline completion if latency matters.
Vanilla Qwen2.5-Coder 32B can loop on Cline tasks (re-reading files without progressing). Workaround: use the mychen76/qwen2.5_cline_roocode:32b community Ollama model with a tailored system prompt enforcing strict <tool><param>value</param></tool> XML format, exactly one tool per turn. Or upgrade to Qwen3-Coder.
Same caveat as Cline. The mychen76/qwen2.5_cline_roocode:32b custom prompt explicitly targets both Cline and Roo Code. Architect mode tends to be more forgiving than Code mode because it offloads the planning step.
Native Qwen agent framework with built-in tool-call template for Qwen2.5. Bundles function calling, MCP, code interpreter, RAG. Best-supported path for tool calling on the vanilla Qwen2.5-Coder 32B since it uses the official chat template.
Runs but underperforms vs Qwen3-Coder 30B-A3B on SWE-bench. Qwen2.5-Coder was not RL-trained on agentic loops the way Qwen3-Coder was. Use only if Qwen2.5-Coder 32B is the only model you can run on the available 24GB GPU.
Available via OpenRouter or cloud APIs but not via custom local endpoint. Cursor routes through their backend, breaking the data-locality argument that makes Qwen2.5-Coder 32B attractive in the first place. Cline is the better Pineido pick.
Where this model + agent stack ships real work.
Code-specialized model.
RAG, MCP, code interpreter built in. Best research stack for Qwen2.5-Coder 32B because the chat template alignment is exact: pip install -U qwen-agent[gui,rag,code_interpreter,mcp].
Code-aware RAG over repository documentation. Workspace per project. @agent mode usable for code-research questions over your private codebase plus SDK docs.
Default chat UI. Works for ad-hoc code Q&A and documentation lookup. Document upload covers PDF SDK manuals, RFCs, and library docs.
Usable for code-adjacent research (library comparisons, framework benchmarks). For pure non-code research a general model is a better pick. OPENAI_BASE_URL override works.
Best retrieval pairing for code-and-docs RAG. LlamaIndex's tree summarizer and citation tracking handle SDK docs well. Pair with a Qwen-Agent or LangGraph orchestration layer on top.
Production orchestration. Useful when you want a multi-step code-research workflow (parse stack trace, search docs, draft fix). Tool-call quirks of Qwen2.5-Coder mean you may need explicit retry logic in the graph.
Sequential crews. Useful for research-and-write pairs (researcher reads docs, writer drafts an architecture decision record). Faster to demo than LangGraph.
Where this model + research agent stack delivers reports your team actually uses.
Pick the framework by workflow shape.
Native Qwen framework. Best tool-call alignment for Qwen2.5-Coder 32B.
Production orchestration with explicit retry logic for tool-call quirks.
Sequential research-and-write crews.
Prompt compilation. Useful for tightening Qwen2.5-Coder's tool-call prompts.
Type-safe code-generation agents.
Retrieval over code plus docs.
Three buyer profiles where this model is the right answer.
Task: IDE autocomplete, code review, refactoring, internal tooling. Outcome: Replaces $24-40 per seat per month Copilot or Cursor licensing. Single RTX 5090 serves the whole team. ROI in 3 months. Code never leaves the firm.
Task: Code generation against private trading systems and proprietary algorithms. Outcome: Apache 2.0 plus on-prem deployment passes SOC 2 review cleanly. No code-snippet exfiltration to third-party APIs. Fine-tunable on the proprietary codebase.
Task: Code review and generation on export-controlled software. Outcome: Air-gapped deployment satisfies ITAR. Q5_K_M on a single workstation per engineer. No third-party API touches the codebase.
Where this model wins, where it loses.
Qwen2.5-Coder 32B beats Llama 3.3 70B on every code benchmark by 3 to 8 points, and runs on hardware one-third the cost. Llama 3.3 70B wins on general reasoning and non-code tasks. Use Qwen2.5-Coder for code, Llama 3.3 for everything else, or just run both.
Qwen2.5-Coder 32B matches GPT-4o on HumanEval and MBPP, comparable on Aider. GPT-4o wins on the hardest reasoning. For 90 percent of dev work (autocomplete, refactor, write tests, review PRs) the gap is invisible.
Qwen2.5-Coder 32B beats DeepSeek-Coder V2 on EvalPlus, the most resistant-to-saturation code benchmark. Qwen2.5-Coder also wins on dense versus MoE serving simplicity (single 32B versus DSCv2's MoE complexity).
Day 4 Ollama or vLLM serves Qwen2.5-Coder 32B Instruct on a single 24GB GPU.
Ollama runs qwen2.5-coder:32b at Q4_K_M (~22GB on a 24GB GPU). For higher throughput, vLLM serves Qwen2.5-Coder-32B-Instruct with --tensor-parallel-size 1 --max-model-len 32768. The 128K full window requires more VRAM headroom.
We choose the agent path. Vanilla Qwen2.5-Coder works for Aider and Continue.dev. For Cline or Roo Code, we install mychen76/qwen2.5_cline_roocode:32b with the tailored XML-tool system prompt, or recommend upgrading the buyer to Qwen3-Coder 30B-A3B.
Aider via --openai-api-base, Continue.dev via config.yaml provider: openai or vllm. Tab autocomplete enabled in Continue.
Open WebUI plus AnythingLLM live. Code-aware RAG over repo plus SDK docs.
Qwen-Agent installed (pip install -U qwen-agent[gui,rag,code_interpreter,mcp]). MCP servers wired for filesystem and GitHub.
LangGraph workflow for code-research-and-write pipeline. Explicit retry logic on tool-call nodes given the model's tool-format quirks.
Evidence pack with Aider score reproduction, throughput numbers, agent inventory, and a written recommendation on whether to upgrade to Qwen3-Coder.
Fixed fee.
Bench against your real codebase. Pick Q4_K_M or Q5_K_M based on VRAM. Verify language coverage matches your stack (92 languages, but quality varies).
Serve via vLLM (RTX 5090 or Pro 6000) or Ollama (Mac, single dev workstation). Wire OpenAI-compatible endpoint. Connect to Continue.dev or Cline IDE plugin.
Optional: fine-tune on private codebase with QLoRA. Embed search via BGE-M3 over your repo. RBAC, audit logging, no-egress firewall rule.
Pen-test cleared. Apache 2.0 NOTICE filed. Cutover. Replace Copilot/Cursor seats.
Yes. Apache 2.0, no MAU cap, no attribution-in-product, no commercial restriction. You can fine-tune on your codebase, redistribute the fine-tuned weights, and embed in commercial products. Preserve the NOTICE file in source distributions and you are clear.
Mac Mini M4 Pro 24GB at $1,599 runs Q4_K_M out of the box with Ollama, around 14 to 18 tokens per second decode. Fine for one developer's IDE autocomplete. RTX 4090 hits 42 tokens per second at the same quant level for around the same price. RTX 5090 lifts that to 55 to 70 with headroom for Q5 or Q6.
For autocomplete, refactor, and code review on most stacks, yes. HumanEval 92.7 is GPT-4o class. The gap shows on the hardest reasoning and on niche languages. Most teams find that Qwen2.5-Coder plus a good IDE plugin (Continue, Cline) covers 90 percent of Copilot use cases at zero per-seat cost.
Qwen3 base models exist, Qwen3-Coder family follows the same release cadence. If you have a working stack, Qwen2.5-Coder 32B is mature, ecosystem-supported, and benchmarks well above any model that ran on $2K of hardware a year ago. Migrate when Qwen3-Coder lands and shows a real benchmark delta. Do not wait to start.
With caveats. Vanilla Qwen2.5-Coder 32B has a known issue where Cline loops on multi-turn tasks (Cline issue #1429), re-reading files without progressing. Two fixes work. First, install the mychen76/qwen2.5_cline_roocode:32b community Ollama variant with a tailored XML-style tool prompt. Second, upgrade to Qwen3-Coder 30B-A3B which was RL-trained for Cline-style agent loops. Pineido tests both during the sprint and recommends Qwen3-Coder for buyers whose primary use case is autonomous agent loops. Qwen2.5-Coder remains excellent for Aider-style explicit-edit workflows.
73.7 percent on the Aider code-repair benchmark per QwenLM's official blog. Comparable to GPT-4o. Aider's diff-edit pattern does not trigger the tool-call quirks that bite Cline, so Qwen2.5-Coder 32B is genuinely usable for Aider-driven multi-file refactors. Run aider --openai-api-base http://your-vllm:8000/v1 --model openai/Qwen2.5-Coder-32B-Instruct.
32.5B dense (31.0B non-embedding) Parameters
Fixed fee.
Day 1 you see the exact model, the exact hardware, the exact agent stack, the exact cost math, and the exact compliance posture.
ByKostadin StambolievFounder and Imaginator
Pineido, based in Strumica, North Macedonia, is a software company that builds websites, online shops, web and mobile apps, business automation and AI for companies at home and abroad. Work ships in 30-day sprints at a fixed price, and the client owns the code.
Published Updated