Use generative orchestration

Enabled for Public preview General availability
Users by admins, makers, or analysts - Mar 17, 2025

Business value

Generative orchestration lets your makers focus on managing plugins and maintaining artifacts. Businesses save time because makers don't need to build agents manually. Users get better responses because agents can more easily answer unexpected questions.

Feature details

With generative orchestration, your agent chooses the best actions, knowledge, and topics to answer user queries or respond to event triggers. In contrast, classic orchestration uses only one topic to respond to a user, based on manually authored trigger phrases.

When you activate generative orchestration, it mainly relies on the descriptions of actions and topics to determine which elements to use in response to the last user input or event. When enabled, generative orchestration orchestrates the conversations users have with your agent. This orchestration helps provide users with a more natural and fluid conversation.

The following table compares agent behavior between classic orchestration and generative orchestration.

Behavior Classic orchestration Generative orchestration
Topics The system selects topics by matching a user query with trigger phrases. The system selects topics based on the description of their purpose.
Actions You can call actions only when you explicitly call them from within a topic. The agent chooses to call actions based on their name and description.
Knowledge Use knowledge as a fallback when no topics match a user's query, or when you explicitly call it from within a topic. The agent proactively searches knowledge to answer a user's query.
Use of multiple topics, actions, knowledge sources The agent tries to select a single topic to respond to the user. It falls back to knowledge if you configure it. The agent uses a combination of topics, actions, and knowledge.
Asking users for input To ask users for input, use question nodes in topics to create messages that prompt users for any required information. The agent can automatically create questions to prompt users for any missing information it needs to fill inputs for topics and actions.
Responding to a user To respond to a user, use message nodes in topics to create messages that respond to the user (or call an action from a topic). The agent automatically creates a response using available information from topics, actions, and knowledge it uses.

To turn on generative orchestration for your agent, follow these steps:

  1. Go to the Overview page for your agent.
  2. In the Details section, under Orchestration, turn on Use generative AI to determine how best to respond to users and events.

Geographic areas

Visit the Explore Feature Geography report for Microsoft Azure areas where this feature is planned or available.

Language availability

Visit the Explore Feature Language report for information on this feature's availability.

Orchestrate agent behavior with generative AI (docs)