r/LocalLLaMA
· Communities
Running a 13M ASR conformer on a microcontroller
Hello everyone, I wanted to share a recent project of mine, which brings a 13.1 million parameter convolution transformer model to a < $10 microcontroller (more specifically, the ESP32-S3). It's a distilled and quantized version of nvidias small conformer model from huggingface. Thanks to quantization, this model now f