nucleus.validate.scenario_test_metric¶
A Scenario Test Metric is an evaluation function combined with a comparator and associated with a Scenario Test. |
- class nucleus.validate.scenario_test_metric.ScenarioTestMetric¶
A Scenario Test Metric is an evaluation function combined with a comparator and associated with a Scenario Test. Scenario Test Metrics serve as the basis when evaluating a Model on a Scenario Test.
- set_threshold(threshold=None)¶
Sets the threshold of the metric to the new value passed in as a parameters. .. attribute:: threshold
The ID of the scenario test.
- type:
str
- Parameters:
threshold (Optional[float])
- Return type:
None