simulstream.metrics.score_latency

Functions

cli_main()

Latency scoring script for Simulstream evaluation.

main(scorer_cls, args)

Main entry point for latency scoring.

simulstream.metrics.score_latency.cli_main()

Latency scoring script for Simulstream evaluation.

This module provides tools to compute latency metrics for streaming speech translation or recognition. It supports multiple latency scorers through a pluggable registry (LATENCY_SCORER_REGISTRY).

The script works with JSONL log files generated during inference.

Typical usage from the command line:

$ python -m simulstream.metrics.score_latency \
    --eval-config config/speech-processor.yaml \
    --log-file metrics.jsonl \
    --audio-definition segments.yaml \
    --reference ref.txt \
    --scorer stream_laal
simulstream.metrics.score_latency.main(scorer_cls: type[LatencyScorer], args: Namespace)

Main entry point for latency scoring.

Loads system outputs from a log file, builds scoring samples with segment-level references, and computes latency scores using the specified scorer.

The score (in seconds) is printed on standard output.

Parameters: