LLM Orchestration
Routing prompts and responses across multiple large language models.
What is LLM Orchestration?
LLM orchestration is the practice of routing tasks across multiple language models based on cost, capability, or fallback policy. While LLM orchestration is one feature of broader agent orchestration, it focuses specifically on the model layer. LeafMesh ADK includes intelligent LLM routing as part of its agent operations fabric.
Related concepts
Looking for the agent operations fabric?
LeafMesh ADK is the production runtime for the concepts defined here.
More definitions
Agent Operations FabricAI Agent OrchestrationAutonomous AIAgentic AIMulti-Agent SystemAI Control PlaneAgent Development Kit (ADK)Human-in-the-Loop (HITL)AI GovernanceShared Memory (Agent Context)YAML-First ConfigurationEscalation RoutingAgent ObservabilityVendor-Agnostic AIAgentOpsAgent Operations Platform