Small Agents vs. Large Models: A Coordination Test

This episode examines whether a system of small, coordinated language models can outperform a single large model on complex tasks — testing the paper "Can Small Agents Collaborate to Beat a Single Large Language Model?" from researchers at the University of Amsterdam, ETH Zürich, and the University of Copenhagen. It unpacks a strict hub-and-spoke architecture where one orchestrator delegates to isolated sub-agents (a web searcher, coder, and file inspector) that never communicate with each other, relying on structured shared memory instead of raw conversation replay to avoid flooding the orchestrator with unprocessed tool output. The hosts debate whether this design genuinely escapes scaling laws or just relocates capacity into the orchestrator role, with the paper's three research questions — collaborative performance, the value of chain-of-thought reasoning in the hierarchy, and whether bottlenecks trace to the orchestrator or sub-agents — framed as a direct test of that skepticism. Using the Qwen3 model family exclusively (1.7B to 32B) to isolate size as the only variable, the experiments compare direct tool-calling against full delegation across different orchestrator/sub-agent size pairings. Listeners interested in agentic AI system design, cost-efficient alternatives to frontier-scale models, and the mechanics of multi-agent coordination will find a rigorous, skeptically-argued breakdown of where model capacity actually needs to live.

Sources:
1. Can Small Agents Collaborate to Beat a Single Large Language Model? — Agata Żywot, Xinyi Chen, Yifei Yuan, Anders Søgaard, Maarten de Rijke, 2026
http://arxiv.org/abs/2601.11327
2. AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation — Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Jiale Liu, Ahmed Awadallah, Ryen White, Doug Burger, Chi Wang, 2023
https://scholar.google.com/scholar?q=AutoGen%3A+Enabling+Next-Gen+LLM+Applications+via+Multi-Agent+Conversation
3. MetaGPT: Meta Programming for a Multi-Agent Collaborative Framework — Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, 2023
https://scholar.google.com/scholar?q=MetaGPT%3A+Meta+Programming+for+a+Multi-Agent+Collaborative+Framework
4. HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace — Yongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li, Weiming Lu, Yueting Zhuang, 2023
https://scholar.google.com/scholar?q=HuggingGPT%3A+Solving+AI+Tasks+with+ChatGPT+and+its+Friends+in+HuggingFace
5. More Agents Is All You Need — Junyou Li, Qin Zhang, Yangbin Yu, Qiang Fu, Deheng Ye, 2024
https://scholar.google.com/scholar?q=More+Agents+Is+All+You+Need
6. ToolOrchestra: Elevating intelligence via efficient model and tool orchestration — Hongjin Su, Shizhe Diao, Ximing Lu, et al., 2025
https://scholar.google.com/scholar?q=ToolOrchestra%3A+Elevating+intelligence+via+efficient+model+and+tool+orchestration
7. In-the-flow agentic system optimization for effective planning and tool use — Zhuofeng Li, Haoxiang Zhang, Seungju Han, et al., 2025
https://scholar.google.com/scholar?q=In-the-flow+agentic+system+optimization+for+effective+planning+and+tool+use
8. When single-agent with skills replace multi-agent systems and when they fail — Xiaoxiao Li, 2026
https://scholar.google.com/scholar?q=When+single-agent+with+skills+replace+multi-agent+systems+and+when+they+fail
9. The illusion of thinking: Understanding the strengths and limitations of reasoning models via the lens of problem complexity — Parshin Shojaee, Iman Mirzadeh, Keivan Alizadeh, et al., 2025
https://scholar.google.com/scholar?q=The+illusion+of+thinking%3A+Understanding+the+strengths+and+limitations+of+reasoning+models+via+the+lens+of+problem+complexity
10. Multi-agent architecture search via agentic supernet (MaAS) — Guibin Zhang, Luyang Niu, Junfeng Fang, Kun Wang, Lei Bai, Xiang Wang, 2025
https://scholar.google.com/scholar?q=Multi-agent+architecture+search+via+agentic+supernet+%28MaAS%29
11. The curse of CoT: On the limitations of chain-of-thought in in-context learning — Tianshi Zheng, Yixiang Chen, Chengxi Li, et al., 2025
https://scholar.google.com/scholar?q=The+curse+of+CoT%3A+On+the+limitations+of+chain-of-thought+in+in-context+learning