Skip to content
r/LocalLLaMA Β· Communities

I wrote a GGUF inferencer from scratch, AMA

*for a specific model, in the R language. veeery impractical. 60 seconds per token, yum πŸ˜‹ not vibecoded, I just wanted to learn how the architecture works on our end lmao (and all of karpathy's guides are outdated 😒) writeup here, though it's kinda old news if you're already familiar with the math I'd really like to ma