Skip to content

Performance

Metric Value
Latency ~150–300ms chunk → text
CPU ~20–40% (1 core)
RAM ~500MB (Int8)
Accuracy ~95% clean Spanish
Bandwidth ~256KB/s PCM; VAD reduces ~60% silence
  • Quantization — Int8 is ~2% less accurate than Float32 but ~2× faster
  • VAD — Saves bandwidth and server CPU by skipping silence
  • Model choiceCanary180M (180M params) faster; ParakeetTDT (0.6B) more accurate
  • GPUtranscribe-rs with OrtAccelerator::Auto / Cuda
  • Chunk size — Smaller frameSamples (256) = lower latency but more overhead

Server logs chunk timing; client shows end-to-end in UI. Test with pre-recorded WAV piped over WebSocket for reproducible benchmarks.