kaira.benchmarks.ComparisonRunner

Inheritance diagram for ComparisonRunner

class kaira.benchmarks.ComparisonRunner(verbose: bool = True)

Bases: object

Runner for comparing multiple benchmarks on the same task.

Methods

__init__	Initialize comparison runner.
get_comparison_summary	Get summary of comparison results.
run_comparison	Run comparison between multiple benchmarks.

__init__(verbose: bool = True)

Initialize comparison runner.

Parameters:

verbose – Whether to print verbose output

run_comparison(benchmarks: List[BaseBenchmark], comparison_name: str, **kwargs) → Dict[str, BenchmarkResult]

Run comparison between multiple benchmarks.

get_comparison_summary(comparison_name: str) → Dict[str, Any]

Get summary of comparison results.