llmux dashboard I test a lot of models on vLLM and llama.cpp. Every swap meant editing parameters again, bringing each model up its own way, taking…
Every time a new model is released, I tend to check it out. The benchmarks, readme, or whatever seem pretty convincing, so I download it, test…
Hi Folks, I see a lot of folks talking about how they are able to load massive llm models coz they have unified memories. projects like…
decided to mess around with it to see how the world model training affects it, found a system prompt that massively improves reasoning: predict your own…
I tested Kat Coder 2.5 with this prompt: Create a spaceship game inspired by Star Fox using vanilla Three.js and HTML. It should have at least…
Instead of 2T+ models, continuing to release highly capable small to medium size LLMs would really help to keep this community vibrant. Hardly anyone can even…
Running local models means every token counts — an 8K or 16K window fills up fast when you're stuffing graph context into prompts for RAG. I…
I got tired of my Ollama server sitting idle between chat experiments, so I pointed it at my Navidrome library and made it run a radio…
something big should happend for them to call "Note: All GGUFs generated before this change will need to be regenerated." llamacpp website submitted by /u/EconomySerious [link]…
I was refreshing my youtube and found out my favourite reviewer uploaded a battery test of 78 smartphones: https://youtu.be/MpgUFrsIWSQ the author said they started using robotic…