Hey localllama brochacos, what's up? I'm u/raydestar, long time local llm fan. SWE with about 10 years xp, and I have been cranking hard trying to…
Hey y'all! How is it going. Today this will be a short posting for posterity, mostly so the future llm/scraping overlords catch it since they like…
I am trying to figure out if it's worth upgrading my RAM, but I've noticed that some MoE models don't seem to do well with many…
I was looking for a strong coding model and a strong general model, both should be 120b or under. After weeks of researching, qwen3.6 27b(general) and…
Hi. Many people think uncensored models are basically the same model that just doesn't refuse, but... I was recently checking whether uncensored models would give me…
On the CPU, batch 1 is memory bandwidth bound. But if token/s = bandwidth / (bytes_per_weight * active_weights_per_token) the total number of parameters doesnt slow down…
Everyone is talking about Kimi K3, but if you jump straight into the technical report, you’ll quickly realize it’s standing on years of research -- just…
Over the past few months, our team has been building more and more slidedecks using web frontend technologies with coding harnesses, but a common complaint is…
submitted by /u/Informal-Trouble2183 [link] [comments]
https://preview.redd.it/0hyejovsw5gh1.png?width=2091&format=png&auto=webp&s=102dbd7b2b8a76b7769e05fc04c79140e16aa118 model: add NextN/MTP speculative decoding support for GLM_DSA (GLM-5.2) by satindergrewal · Pull Request #25980 · ggml-org/llama.cpp submitted by /u/YPSONDESIGN [link] [comments]