live status

Model status.

Uptime, TTFT, throughput and ITL per model, refreshed about every 30 seconds. How we measure