simulstream.metrics.scorers.latency.LatencyScorer

class simulstream.metrics.scorers.latency.LatencyScorer(args: Namespace)

Bases: object

Abstract base class for all latency scorers.

A latency scorer evaluates system hypotheses against references and returns a LatencyScores object that represents the latency scores.

Subclasses must implement the abstract methods defined here and should be registered via register_latency_scorer().

Parameters:

args (argparse.Namespace) – Parsed command-line arguments.

__init__(args: Namespace)

Methods

__init__(args)
add_arguments(parser)
requires_reference()
score(samples)