Inference dashboard

Latency, throughput and errors across all conversations