When do multi-agent architectures actually earn their complexity over one well-tooled agent, and what fails in them?
What they are really testing: Hype resistance at the architecture level. The fashionable answer is a crew of specialist agents; the experienced answer knows single-agent-with-good-tools wins more often, and can name the coordination failures multi-agent adds.
A real interview question
When do multi-agent architectures actually earn their complexity over one well-tooled agent, and what fails in them?
What most people say
drag me
“Multi-agent systems mirror how human teams work, a researcher, a writer, a reviewer, so complex tasks benefit from specialist agents collaborating.”
Anthropomorphism as architecture. Agents are not colleagues, they are correlated LLM calls with lossy text hand-offs, and the team metaphor is precisely how projects end up with 5 agents, 5x cost, and worse accuracy than one agent with better tools.
The follow-ups they ask next
Design the hand-off so it is not lossy.
Structured artifacts, not prose summaries: a schema for findings with sources and confidence, plus access to the underlying material so the receiver can drill down rather than trusting the summary blindly.
Reviewer and generator as separate agents, worth it?
A verification pass is often worth it, but it does not require a separate stateful agent, a fresh single call with a critique rubric gets the benefit without the orchestration. Fresh context is the value, not the second identity.
What the interviewer is listening for
- Defaults to one agent and demands a measured plateau before splitting
- Names context isolation and privilege separation as the real triggers
- Can describe hand-off loss, error cascades and cost multiplication concretely
What sinks the answer
- Architecture by analogy to human teams
- No eval evidence anywhere in the decision
- Cannot name a single failure mode multi-agent introduces
If you genuinely do not know
Say this instead of freezing. Reasoning out loud from what you do know beats silence every single time, and a good interviewer is listening for exactly that.
“Default: [one agent, good tools]. Split only for [context isolation, real parallelism, privilege separation, or measured specialisation], and expect the new failures: [lossy hand-offs, divergent state, error cascades, multiplied cost]. The bar is [the same eval, before and after, proving the split paid].”
Keep going with agents & tools
Junior
How does tool calling actually work under the hood, and what makes a tool definition good versus bad?
Mid
What actually is an agent, mechanically, and what stops one from looping forever or going off the rails?
Mid
What problem does MCP, the Model Context Protocol, solve, and what should you check before plugging a third-party MCP server into your assistant?
Senior
Design the model-serving layer for a company with 15 LLM features. One gateway or per-team integrations, and what lives in it?
Senior
Support reports the AI assistant got noticeably worse this week. Nothing was deployed. Walk me through the investigation.
Senior
Legal asks: what happens to our customer data when we use third-party LLM APIs, and what controls do we need? Answer them.
Knowing the answer is not the same as recalling it under pressure
Sign in to send the questions you fumble to spaced recall, so they come back right before you would forget them, and learn the concepts behind them with hands-on labs.
Start free