All speech to text modelsSpeech to textNVIDIA · 2026

Nemotron 3.5 ASR

A streaming RNN-T model that transcribes while you're still talking.

nvidia/nemotron-3.5-asr-streaming-0.6b on Hugging Face
1.4 GBof GPU memory at its peak
426 MBof RAM at its peak
97.9×faster than real time, one clip at a time
3.6%of words wrong on LibriSpeech test-clean

Memory

The most it held at once, from loading to the last test. Next to every other speech to text model here.

Speed

Clips go in one at a time, the way a dictation app sends them, so this is the speed you'd feel.

78 msfor a typical clip (the median; clips run 2 to 24 s)
16 sto transcribe all 26 minutes of the test set
0.7 sto load the model

Accuracy

Word error rate on 100 clips each of LibriSpeech test-clean (clear reading) and test-other (harder speakers). Below, what it heard on six of them.

Word error rate, test-cleanShorter is more accurate. #4 of 4.
Word error rate, test-otherShorter is more accurate. #4 of 4.
  1. 01

    He cried in high dudgeon just as if he owned the whole of the peppers and could dispose of them all to suit his fancy

    “He cried and hide dudgeon just as if he owned the whole of the peppers and could dispose of them all to suit his fancy.”· test-clean

    0:07
  2. 02

    She screamed and shouted too with a terrific volume of sound which doubtless caused the hearts of the fugitives to quake within them

    “She screamed and shouted too with a terrific volume of sound which doubtless caused the hearts of the fugitives to quake within them.”· test-clean

    0:08
  3. 03

    If you are not then knocked on the head your being a non composser will protect you and you'll then have a good reason to expect to die in your bed

    “If you are not then knocked on the head, you're being a noncomposter will protect you and you'll then have a good reason to expect to die in your bed.”· test-clean

    0:08
  4. 04

    So far it has been used mostly for garnishment of other dishes and it is only recently that the hof brau has been making a specialty of them

    “So far it has been used mostly for garnishment of other dishes, and it is only recently that the Holf Brow has been making a specialty of them.”· test-other

    0:07
  5. 05

    By allah an thou fetch him not to me i will assuredly rouse the chamberlain on thee and he shall beat thee and cast thee out

    “By Allah, and thou fetch him not to me, I will assuredly rouse the chamberlain on thee, and he shall beat thee and cast thee out.”· test-other

    0:10
  6. 06

    I have missed four fits and had but five and have recovered so much strength as made me venture to meet your letter on wednesday a mile from home

    “I have missed four fits and I've had but five and have recovered so much strength as made me venture to meet your letter on Wednesday a mile from home.”· test-other

    0:11

How it ran

638Mparameters
0.7 sto load onto the GPU
OpenMDW 1.1license
35 languageslanguages

Ran with audio.cpp on Vulkan, q8_0 weights, offline mode on an AMD Radeon RX 9070 XT (16 GB, Vulkan through RADV (Mesa 26.2.2)).