AGENTIC ENGINEERING

Why Chinese LLMs are Eating Agentic Coding.

How engineering teams are slashing API costs by 90% and dodging rate limits by orchestrating DeepSeek and Qwen alongside Claude.

Bennet Alexander

Bennet Alexander

Founder & Agentic Lead10 min read

If you're using Claude 3.5 Sonnet for your entire agentic loop, you're burning cash.

Building autonomous coding agents is exhilarating, until you get the API bill. When developers first wrap tools like Claude Code, Aider, or custom multi-agent loops around OpenAI’s GPT-4o or Anthropic’s Claude 3.5 Sonnet, the results feel like magic. You issue a prompt, and the agent begins to think, read files, execute commands, read logs, debug, and write code continuously.

But there’s a hidden math problem in agentic coding.

Agents don't just generate text; they loop.

Every time an agent runs a bash command and encounters an error, it feeds that entire log context—plus the surrounding codebase context—back into itself to try again. A simple refactoring task that takes a human 20 minutes might take an agent 45 loops. If you are paying $3 to $15 per million input tokens, a single complex pull request can suddenly cost $10 in API fees.

Worse yet, you hit Rate Limits. Try running 50 concurrent Claude agents on an enterprise engineering floor, and Anthropic's API will throttle you instantly. For an enterprise trying to deploy agents at scale to handle thousands of tickets, the unit economics and infrastructure completely break.

This is exactly where the new wave of Chinese frontier models is changing the game.

The Current Landscape

For the past year, the rule of thumb in AI engineering has been simple: use Claude 3.5 Sonnet for coding. Period.

Anthropic’s model has reigned supreme on almost every coding benchmark, and more importantly, in the subjective "vibes" of real-world software architecture. GPT-4o remains highly capable, but Sonnet has been the default brain for autonomous dev tools.

However, there is a fundamental inefficiency in using a frontier model for every step of an agentic workflow. Let's look at a standard agent loop:

  • Task 1: Understand the user request and map it to the repository architecture (High Cognitive Load).
  • Task 2: Search for the specific file and read its contents (Low Cognitive Load).
  • Task 3: Write a bash script to update the dependencies (Low Cognitive Load).
  • Task 4: Debug a syntax error thrown by the linter 14 times in a row (Low Cognitive Load, High Token Burn).

Using Sonnet to fix a missing semicolon in a loop is like hiring a Staff Engineer at $300/hour to format JSON files. It works, but it's wildly inefficient.

The API Cost Reality

Input/Output cost per 1 Million tokens (Approximate USD)

Claude 3.5 Sonnet / GPT-4o$3.00 / $15.00
DeepSeek Coder V2 / Qwen 2.5 Coder~$0.14 / ~$0.28

The Agentic Multiplier: In an autonomous loop, agents consume tokens exponentially by reading logs, rewriting files, and analysing context repeatedly. A 90%+ cost reduction isn't just savings: it makes continuous autonomous coding financially viable. Plus, open-weight models bypass strict enterprise API rate limits.

Enter the Contenders

Over the last few months, models from Chinese AI labs, specifically DeepSeek and Alibaba (Qwen), have aggressively closed the performance gap with Western frontier models, while deploying a completely different pricing strategy.

1. DeepSeek Coder V2

DeepSeek Coder V2 shocked the industry when it dropped. It’s an open-weights Mixture-of-Experts (MoE) model that consistently beats GPT-4 Turbo and Claude 3 Opus on standard coding benchmarks like HumanEval and MBPP.

But the real magic is the API offering. DeepSeek hosts their model at an astonishingly low price point—often hovering around $0.14 per 1M input tokens. That is literally a fraction of a fraction of the cost of western proprietary models.

2. Qwen 2.5 Coder (Alibaba)

Alibaba’s Qwen 2.5 series has proven equally formidable. The 32B and 72B parameter variants are incredibly sharp at Python, TypeScript, and shell scripting. Because the weights are open, providers like Together AI, Groq, and Fireworks host Qwen at pennies on the dollar, and at blazing fast speeds (100+ tokens per second).

"We aren't just seeing a price war. We are seeing the commoditization of mid-to-high tier coding intelligence. The brute force logic required for syntax, boilerplate, and basic debugging is now effectively free and instant."

The Hybrid Workflow

Smart engineering teams aren't ditching Claude or OpenAI. Instead, they are moving to a cognitive routing architecture—matching the complexity of the task to the cost of the model.

The most effective pattern we've deployed at mindscale is the Architect / Executor split.

The Architect

Claude 3.5 Sonnet

System Design • MCP Tooling • Code Review

Worker_1

DeepSeek / Qwen

Worker_2

DeepSeek / Qwen

Worker_3

DeepSeek / Qwen

The Brute Force

Boilerplate • Refactoring • Execution

In this workflow, the human developer talks only to the Architect (Claude 3.5 Sonnet). The Architect explores the repository using Model Context Protocol (MCP) tools, designs the solution, and writes a detailed, deterministic plan.

Then, the Architect spawns sub-agents (Executors) powered by DeepSeek Coder or Qwen 2.5. These sub-agents are given narrow scopes: "Implement this specific React component" or "Write the unit tests for this API route."

If the DeepSeek agent gets stuck in a loop trying to fix a linter error, it doesn't matter. It can loop 50 times, burn 2 million tokens, and stream responses at 150 tokens/sec. It will cost you $0.28 instead of $6.00, and it won't trigger Anthropic's rate limits.

Implementation Workarounds

It sounds perfect, but integrating Chinese LLMs into Western agent frameworks requires some finesse. Here is the technical playbook:

1. Instruction Following Degradation

While Qwen and DeepSeek are elite code generators, their ability to follow complex, multi-step constraints over long contexts is slightly weaker than Sonnet.

The Fix: Atomic Scoping

Keep executor tasks hyper-focused. Do not ask DeepSeek to "build a user authentication feature." Ask it to "write the SQL migration file for the users table."

2. Tool Calling & JSON Modes

Agentic coding relies heavily on Tool Calling. Early open-weights models hallucinated schema arguments or broke strict JSON formatting.

The Fix: API Normalisation

Ensure you use the latest iterations (e.g., Qwen 2.5 Coder or DeepSeek V2.5) which are explicitly fine-tuned for function calling. Use a framework like LiteLLM to normalise the tool-calling syntax to match OpenAI's standard.

3. Context Window Caching

DeepSeek supports massive context windows (up to 128k+), but stuffing the context blindly degrades performance and increases latency.

The Fix: RAG + Prompt Caching

Use Sonnet for semantic search (RAG) over the codebase to find relevant files. Then, pass only those specific file contents to the DeepSeek executor. Enable Prompt Caching at the inference provider to slash costs and time-to-first-token.

The New Blueprint

The era of the monolithic LLM is ending. The future of autonomous coding is orchestration.

By decoupling the cognitive architecture from the brute-force execution, engineering teams can build multi-agent systems that operate continuously without triggering financial alerts from the CFO.

Open-weights models from DeepSeek and Alibaba aren't just cheaper alternatives; they are the fundamental enabling layer that allows agentic looping to scale. If you are building AI developer tools today, integrating these models as the execution layer isn't just a cost optimisation: it's a requirement for survival.

Stop Burning Cash on Monolithic Agents.

Ready to deploy high-concurrency, low-cost autonomous engineering teams? We design and implement custom multi-agent architectures that scale.

Explore Enterprise Agentic Architecture

Related Service

Agentic AI

Bring agentic AI into your business with controls you can trust. Multi-agent systems, MCP, and secure RAG implementations.

Explore Agentic AI