TestSuiteResult

class opik.TestSuiteResult(items_passed: int, items_total: int, item_results: Dict[str, ItemResult], evaluation_result_: evaluation_result.EvaluationResult, suite_name: str | None = None, total_time: float | None = None)

Bases: object

Result of running a test suite.

Contains pass/fail status for each item based on execution policy, as well as overall suite pass/fail status.

property all_items_passed: bool

Whether all items in the suite passed.

property items_passed: int

Number of items that passed.

property items_total: int

Total number of items evaluated.

property item_results: Dict[str, ItemResult]

Results for each item, keyed by dataset_item_id.

property pass_rate: float | None

Pass rate among items that had assertions.

Items without any assertions are excluded from the calculation. Returns None if no items had assertions.

property suite_name: str | None

The name of the test suite.

property total_time: float | None

Total evaluation time in seconds.

property experiment_id: str

The experiment ID.

property experiment_name: str | None

The experiment name.

property experiment_url: str | None

URL to view the experiment.

to_report_dict() → Dict[str, Any]

Convert the result to a structured report dictionary.

to_dict() → Dict[str, Any]

Alias for to_report_dict().