AzureAIBenchmarkPreviewEvalRunDataSource Class
Represents a data source for benchmark evaluation runs.
Constructor
AzureAIBenchmarkPreviewEvalRunDataSource()Methods
| clear | |
| copy | |
| fromkeys |
Create a new dictionary with keys from iterable and values set to value. |
| get |
Return the value for key if key is in the dictionary, else default. |
| items | |
| keys | |
| pop |
If the key is not found, return the default if given; otherwise, raise a KeyError. |
| popitem |
Remove and return a (key, value) pair as a 2-tuple. Pairs are returned in LIFO (last-in, first-out) order. Raises KeyError if the dict is empty. |
| setdefault |
Insert key with a value of default if key is not in the dictionary. Return the value for key if key is in the dictionary, else default. |
| update |
If E is present and has a .keys() method, then does: for k in E.keys(): D[k] = E[k] If E is present and lacks a .keys() method, then does: for k, v in E: D[k] = v In either case, this is followed by: for k in F: D[k] = F[k] |
| values |
clear
clear() -> None. Remove all items from D.copy
copy() -> a shallow copy of Dfromkeys
Create a new dictionary with keys from iterable and values set to value.
fromkeys(value=None, /)Positional-Only Parameters
| Name | Description |
|---|---|
|
iterable
Required
|
|
|
value
|
Default value: None
|
get
Return the value for key if key is in the dictionary, else default.
get(key, default=None, /)Positional-Only Parameters
| Name | Description |
|---|---|
|
key
Required
|
|
|
default
|
Default value: None
|
items
items() -> a set-like object providing a view on D's itemskeys
keys() -> a set-like object providing a view on D's keyspop
If the key is not found, return the default if given; otherwise, raise a KeyError.
pop(k, [d]) -> v, remove specified key and return the corresponding value.popitem
Remove and return a (key, value) pair as a 2-tuple.
Pairs are returned in LIFO (last-in, first-out) order. Raises KeyError if the dict is empty.
popitem()setdefault
Insert key with a value of default if key is not in the dictionary.
Return the value for key if key is in the dictionary, else default.
setdefault(key, default=None, /)Positional-Only Parameters
| Name | Description |
|---|---|
|
key
Required
|
|
|
default
|
Default value: None
|
update
If E is present and has a .keys() method, then does: for k in E.keys(): D[k] = E[k] If E is present and lacks a .keys() method, then does: for k, v in E: D[k] = v In either case, this is followed by: for k in F: D[k] = F[k]
update([E], **F) -> None. Update D from mapping/iterable E and F.values
values() -> an object providing a view on D's valuesAttributes
input_messages
Input messages configuration.
input_messages: InputMessagesItemReferencetarget
The target model or agent to evaluate against the benchmark. When using azure_ai_model
target, sampling_params must not be provided; inference parameters are auto-filled from the
benchmark specification stored in eval group properties. Required. Is either a
AzureAIModelTargetParam type or a AzureAIAgentTargetParam type.
target: AzureAIAgentTargetParam | AzureAIModelTargetParam | dict[str, Any]type
The type of data source, always azure_ai_benchmark_preview. Required. Default value is
"azure_ai_benchmark_preview".
type: Literal['azure_ai_benchmark_preview']