Phase 16: Multi-Agent & Swarms

Hierarchical Architecture and Its Failure Mode

Hierarchical is supervisor nested. Manager agents over sub-managers over workers. CrewAI Process.hierarchical is the textbook version: a managerllm dynamically delegates tasks and validates outputs. The LangGraph equivalent is createsupervisor(createsupervisor(...)). It is the natural pattern when the task is a real org chart. It is also the pattern most likely to collapse into managerial looping — manager agents assign work poorly, misinterpret sub-outputs, or fail to reach consensus. Sequential often beats it. Once the supervisor pattern clicks, the natural next step is "what if the workers are themselves supervisors?" Teams have sub-teams; companies have departments of departments. Hierarchical architectures mirror that. The issue: LLM managers are not the same as human managers. A human manager has stable priors about what their reports know. An LLM manager re-reasons the org every turn from whatever is in its context. Tiny drift in that context, and the whole tree misallocates work. Every internal node plans, delegates, and synthesizes. Only leaves do work. Clear org mapping. If the real task is departmental ("legal review the doc, finance review the doc, engineering review the doc, then summarize for exec"), the hierarchy is explicit. Local summarization. Each sub-manager synthesizes its team's output before the top manager sees it. Top manager sees three sub-manager summaries, not fifteen worker outputs. Three failure modes the 2026 post-mortems keep finding: Task…

Hierarchical Architecture and Its Failure Mode: Hierarchical is supervisor nested. Manager agents over sub-managers over workers. CrewAI Process.hierarchical…

This free lesson is part of the AI Engineering from Scratch curriculum. Read the full explanation, run the lesson code, and verify the result in the interactive reader or from the repository source.

Browse the complete course catalog or open this lesson on GitHub.