AzureAIProjectsModelFactory.EvaluatorGenerationInputs Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Caller-supplied inputs for an evaluator generation job.
public static Azure.AI.Projects.EvaluatorGenerationInputs EvaluatorGenerationInputs(System.Collections.Generic.IEnumerable<Azure.AI.Projects.EvaluatorGenerationJobSource> sources = default, string model = default, string evaluatorName = default, string evaluatorDisplayName = default, string evaluatorDescription = default);static member EvaluatorGenerationInputs : seq<Azure.AI.Projects.EvaluatorGenerationJobSource> * string * string * string * string -> Azure.AI.Projects.EvaluatorGenerationInputsPublic Shared Function EvaluatorGenerationInputs (Optional sources As IEnumerable(Of EvaluatorGenerationJobSource) = Nothing, Optional model As String = Nothing, Optional evaluatorName As String = Nothing, Optional evaluatorDisplayName As String = Nothing, Optional evaluatorDescription As String = Nothing) As EvaluatorGenerationInputsParameters
- sources
- IEnumerable<EvaluatorGenerationJobSource>
Source materials for generation — agent descriptions, prompts, traces, or datasets. Each entry is an EvaluatorGenerationJobSource variant discriminated by type.
- model
- String
The LLM model to use for rubric generation (e.g., 'gpt-4o'). Required — users must provide their own model rather than relying on service-owned capacity.
- evaluatorName
- String
The evaluator name (immutable identifier). 1-256 characters; allowed characters are ASCII letters, digits, underscore (_), period (.), tilde (~), and hyphen (-). The prefix builtin. is reserved for system-managed evaluators and is rejected by the service. If an evaluator with this name already exists in the project (and is rubric-subtype), the service creates a new version under the same name and uses the prior version's dimensions as context for incremental improvement (foundation of the post-//build adaptive loop). Old versions remain queryable via get_version(name, version). If the existing evaluator is not a rubric-subtype evaluator (built-in, prompt-based, code-based), the request is rejected with 400 Bad Request.
- evaluatorDisplayName
- String
Optional human-friendly display name for the resulting evaluator. Surfaced as EvaluatorVersion.display_name on the persisted evaluator. When omitted, the service uses evaluator_name as the display name. The evaluator_ prefix disambiguates this from the immutable evaluator_name identifier.
- evaluatorDescription
- String
Optional human-friendly description for the resulting evaluator. Surfaced as EvaluatorVersion.description on the persisted evaluator. Typically collected from the UI alongside evaluator_display_name. The evaluator_ prefix disambiguates this from any other description fields on related models.
Returns
A new EvaluatorGenerationInputs instance for mocking.
