ModelSamplingConfigParam Class

clear() -> None.  Remove all items from D.

copy() -> a shallow copy of D

Create a new dictionary with keys from iterable and values set to value.

fromkeys(value=None, /)

Positional-Only Parameters

Return the value for key if key is in the dictionary, else default.

get(key, default=None, /)

Positional-Only Parameters

items() -> a set-like object providing a view on D's items

keys() -> a set-like object providing a view on D's keys

If the key is not found, return the default if given; otherwise, raise a KeyError.

pop(k, [d]) -> v, remove specified key and return the corresponding value.

Remove and return a (key, value) pair as a 2-tuple.

Pairs are returned in LIFO (last-in, first-out) order. Raises KeyError if the dict is empty.

popitem()

Insert key with a value of default if key is not in the dictionary.

Return the value for key if key is in the dictionary, else default.

setdefault(key, default=None, /)

Positional-Only Parameters

If E is present and has a .keys() method, then does: for k in E.keys(): D[k] = E[k] If E is present and lacks a .keys() method, then does: for k, v in E: D[k] = v In either case, this is followed by: for k in F: D[k] = F[k]

update([E], **F) -> None.  Update D from mapping/iterable E and F.

values() -> an object providing a view on D's values

The maximum number of tokens allowed in the completion. Required.

max_completion_tokens: int

The random seed for reproducibility. Required.

seed: int

The temperature parameter for sampling. Required.

temperature: float

The top-p parameter for nucleus sampling. Required.

top_p: float