simulstream.metrics.scorers.latency.mwersegmenter.MWERSegmenterBasedLatencyScorer

class simulstream.metrics.scorers.latency.mwersegmenter.MWERSegmenterBasedLatencyScorer(args)

Bases: LatencyScorer

Abstract base class for scorers that require aligned system outputs and references through MWER Segmenter alignment.

This class wraps a latency scorer and applies the MWER Segmenter alignment by “Effects of automatic alignment on speech translation metrics” to hypotheses before scoring.

Subclasses must implement _do_score(), which operates on ResegmentedLatencyScoringSample instances where hypotheses and references are aligned.

Example

>>> class CustomLatencyScorer(MWERSegmenterBasedLatencyScorer):
...     def _do_score(self, samples):
...         # Compute a custom latency score
...         return LatencyScores(...)

__init__(args)

Methods

__init__(args)
add_arguments(parser)
requires_reference()
score(samples)