LatencyScorer
LatencyScores
LatencyScoringSample
register_latency_scorer()
Data structure representing a latency score.
The latency score in ideal conditions, which do not include computational costs.
float
The latency score in computational aware conditions, which include computational costs.
Optional[float]