r/LocalLLaMA
· Communities
Mobile Offline LLMs: What do you use them for?
I've spent the last year or so playing around with open source MLX and GGUF models on iPhone hardware. Given the limitations in memory, GPU/CPU/ANE, and in turn the context window I've been trying to figure out the best use cases for them. I've also done a lot of testing with Apple Foundation model. It is not that capa