nucleus.evaluation_v2_preset¶

Evaluation V2 presets — saved, reusable evaluation configurations.

A preset bundles a name with a label configuration (rollup_groups, or legacy allowed_label_matches) and exclusion_rules so the same configuration can be applied across many evaluations. Presets are private to the creating user.

Create and manage presets via NucleusClient:

preset = client.create_evaluation_v2_preset(
    "vehicles",
    rollup_groups=[RollupGroup("vehicle", ["car", "truck"])],
    exclusion_rules=[LabelExclusionRule(scope="item", target="prediction", labels=["ignore"])],
)
client.create_benchmark_evaluation_v2(benchmark_id, model_run_id, preset=preset)

EvaluationV2Preset

A saved Evaluation V2 configuration owned by the current user.

class nucleus.evaluation_v2_preset.EvaluationV2Preset¶

A saved Evaluation V2 configuration owned by the current user.

delete()¶

Delete this preset.

Return type:: None

update(*, name=_UNSET, rollup_groups=_UNSET, allowed_label_matches=_UNSET, exclusion_rules=_UNSET)¶

Update this preset in place.

Only the arguments you pass are changed. Passing rollup_groups=None / exclusion_rules=None clears that field; omitting an argument leaves it unchanged.

Returns:

self, with updated fields.

Parameters:

name (Any)
rollup_groups (Any)
allowed_label_matches (Any)
exclusion_rules (Any)

Return type:

EvaluationV2Preset