Which orchestration architecture fits the task?
An orchestration architecture determines who starts work, what information is shared, and who controls hand-offs, retries and approvals. It is not a model ranking. Sequential and concurrent workflows can behave differently on identical tasks because latency, state loss, error propagation and authorization matter. The official Microsoft Agent Framework documentation describes Sequential, Concurrent, Handoff, Group Chat and Magentic orchestration; this is evidence of documented framework support, not independent proof of performance superiority. Microsoft Learn.
Seven patterns side by side
| Pattern | Control flow | State and communication | Potential value | Typical failure |
|---|---|---|---|---|
| Single-agent baseline | One execution path | Local context | Simpler tracing, fewer hand-offs | Limits of a single context or competence |
| Sequential | A → B → C | Explicit outputs passed forward | Ordered review and approvals | Latency and cascading mistakes |
| Concurrent | A, B, C → collector | Isolated sub-tasks | Independent work in parallel | Cost and reconciliation conflicts |
| Handoff | Ownership transfers | Task status plus message | Dynamic expert routing | Missing context or accountability |
| Group chat | Shared discussion | Shared conversation history | Alternative perspectives | Loops, false consensus and token cost |
| Central / hierarchical | Supervisor assigns work | Central coordination | Clear governance and roles | Bottleneck or single point of failure |
| Graph / hybrid | Conditional transitions | Versioned state/checkpoints | Recovery and branching | Harder state and failure analysis |
- TaskInput + permissions
- OrchestratorRouting + budget
- SpecialistsOutput artifacts
- ValidationEvidence + tests
- ApprovalHuman or stop
These are architectural characteristics and failure modes, not measured head-to-head scores. Any product's actual implementation needs its own primary-source evidence. A platform's marketing description does not grant the same permissions or patterns to every agent running on it.
Detailed control-flow patterns
1. Single-agent baseline before complex coordination
One agent executes with a bounded set of tools and context. It is the necessary control condition for asking whether extra components provide value. Record model/version, prompt, tools, time budget, accessible data and outcome. Without this baseline, measured gains cannot be attributed reliably to coordination.
2. Sequential: ordered responsibility
A drafting agent produces an artifact, a second checks citations, and a third routes the outcome for approval. Each stage gets a structured and versioned input. The downside is cumulative latency and propagation of earlier errors. Critical boundaries therefore require validation before the next step starts.
3. Concurrent: leverage real task independence
Different agents investigate independently scoped sources. A coordinator accepts results when an evidence threshold or deadline is reached, then reconciles contradictions. Shared editing of the same resource and multiple agents repeating one unreliable source are common failure modes. A majority vote is not a substitute for source verification.
4. Handoff: transfer ownership explicitly
A triage agent routes a problem to a domain specialist, carrying the authorization scope, unresolved tasks, provenance and deadline. Handoff must not silently grant new tool privileges. Missing context or an unclear task contract turns a supposedly autonomous interaction into an untraceable one.
5. Group chat: debate requires stopping rules
Multiple agents propose or critique options in a shared conversation. This may expose alternative approaches. Without round limits, citation requirements and a separate decision mechanism, repeated arguments and false agreement can dominate. Agents built on one model do not necessarily offer independent judgments.
6. Hierarchical supervision: a governance checkpoint
A supervisor assigns constrained tasks and inspects responses. Organizations can centralize approval, identity and budget limits at this point. But the supervisor itself needs defenses against prompt injection and unauthorized tool use. Its failure must not trigger uncontrolled actions.
7. Graph/hybrid: conditional paths and recovery
A graph workflow branches on verifiable states: missing evidence triggers research, failing tests trigger correction, validated results proceed to approval. This calls for versioned checkpoints, explicit transitions and bounded retries. The ACL 2025 MultiAgentBench paper explores multiple coordination topologies, but its findings cannot be generalized without a comparable workload. Study.
Scenario A: concurrent, source-critical technical research
Task: Evaluate three implementations using their official documentation. Sequential research → review → synthesis would work, but independent source reading may be concurrent. Each researcher has the same output schema: URL, precise passage, retrieval date, product scope and open questions. A validator checks whether the evidence covers equivalent versions and definitions. Only then does a synthesis agent prepare a table, with a human deciding if missing evidence is acceptable. Potential time savings come at the cost of more invocations and validation; the actual trade-off requires measurement.
Scenario B: controlled multi-stage operational approval
Task: Recommend a change to an enterprise environment. A sequential workflow drafts the change, evaluates its risks, runs a test in an isolated environment and waits for authorized human approval. Only then can a narrowly permissioned execution agent act. A separate verifier checks the resulting state; a defined rollback applies only if the concrete product documents and supports it. Discussion between agents never replaces the authorization gate.
Accessible process diagram: messages and escalation
The following is a conceptual reference flow, not an AgentenCode-executed runtime:
- Task contract: specify sources, data permissions, output and cost budget.
- Orchestrator: choose Sequential, Concurrent or Handoff from stated dependencies.
- Specialists: produce traceable artifacts with source passages and versions.
- Validator: inspect schema, citations, risks, tests and uncertainty.
- Decision: return incomplete work; escalate sensitive actions for human approval.
- Output and audit: store result, timestamps, state transitions and responsibility.
Decision matrix for a production pilot
| Evaluation question | Architecture implication | Acceptance evidence |
|---|---|---|
| Are subtasks independent? | Test Concurrent; otherwise start Sequential | Dependency map and test cases |
| Is explicit authorization required? | Enforce ordered human approval gate | Approval records and role controls |
| Does task ownership change dynamically? | Consider Handoff or supervision | Handoff contract and recovery traces |
| Are conditional retries needed? | Graph/Hybrid with durable checkpoints | State machine and retry budget |
| Are inputs untrusted or external? | Restrict tools and validate every boundary | Injection tests, permissions and audit |
| Is the single-agent baseline unknown? | No substantiated performance advantage | Repeatable control runs |
Frameworks, protocols and product scope
Official Microsoft Agent Framework workflow documentation supports specific orchestration patterns. AgentenCode has a Microsoft Agent Framework profile; the documented patterns concern that framework, not all Microsoft agents. A2A supports agent-to-agent interoperability and MCP covers tool/context integration, but each product's runtime support requires separate proof.
For research limitations consult external benchmarks. The methodology explains source provenance and conflict handling.
INTERACTIVE DECISION AID
Explore one orchestration pattern
The source documents patterns, not an all-purpose performance score. The comparison table above works without JavaScript.
Selection reveals control flow, state and failure modes.
Primary sources and provenance
Each citation supports a scoped proposition. Third-party results have not been independently measured by AgentenCode.
Frequently asked questions
When is Concurrent preferable to Sequential?
When subtasks are genuinely independent. Potential latency gains must be measured against added cost and merge failures.
How does Handoff differ from central orchestration?
Handoff transfers active task ownership; central orchestration retains assignment and oversight with a supervisor.
Is graph orchestration always best?
No. Reported research advantages are scenario-specific, and graph workflows introduce state and debugging complexity.
Which controls should a workflow include?
Explicit tool permissions, hand-off schema, stopping limits, traces, source validation and human approval for sensitive actions.
Current product examples: decision nodes and dynamic workflows (October 2026)
Microsoft-Decision-1 illustrates a separate decision-scoring component inside a broader orchestrator. Microsoft documents routing and control use cases, but its published benchmarks are vendor measurements and do not establish that any multi-agent topology is generally superior. Read the scoped AgentenCode analysis and the original Microsoft announcement.
Anthropic documents dynamic workflow runs for Claude Managed Agents in beta: a configured agent may write a program to coordinate multiple agents in phases, with runs and threads exposed in the event stream. This is product support rather than a verified system-wide speedup. Read the October 9 feature update and the workflow-runs documentation.
Selection rule: distinguish the decision model, the orchestration runtime and the acting agent; define permissions, errors and a single-agent baseline before making performance claims.