simulstream.metrics.score_latency
Functions
|
Latency scoring script for Simulstream evaluation. |
|
Main entry point for latency scoring. |
- simulstream.metrics.score_latency.cli_main()
Latency scoring script for Simulstream evaluation.
This module provides tools to compute latency metrics for streaming speech translation or recognition. It supports multiple latency scorers through a pluggable registry (
LATENCY_SCORER_REGISTRY).The script works with JSONL log files generated during inference.
Typical usage from the command line:
$ python -m simulstream.metrics.score_latency \ --eval-config config/speech-processor.yaml \ --log-file metrics.jsonl \ --audio-definition segments.yaml \ --reference ref.txt \ --scorer stream_laal
- simulstream.metrics.score_latency.main(scorer_cls: type[LatencyScorer], args: Namespace)
Main entry point for latency scoring.
Loads system outputs from a log file, builds scoring samples with segment-level references, and computes latency scores using the specified scorer.
The score (in seconds) is printed on standard output.
- Parameters:
scorer_cls (type[LatencyScorer]) – The latency scorer class to use.
args (argparse.Namespace) – Parsed command-line arguments.