Skip to content

Latest

r/LocalLLaMA Communities

Xiaomi quietly uploaded MiMo-V2.5-DFlash — official DFlash weights are now on Hugging Face

https://huggingface.co/XiaomiMiMo/MiMo-V2.5-DFlash Xiaomi appears to have quietly uploaded MiMo-V2.5-DFlash to Hugging Face: there is dedicated dflash directory containing the Dflash model, anyone willing to GGUF it and…

r/LocalLLaMA Communities

i would like to share my experience. working with huge LLMs and poor Machine

hello people i wanted to share my experience with big and huge models (usually 100B+ models and 200B+ models and more) my laptop specs is very…

r/LocalLLaMA Communities

**Your $80 Tesla P100 has been doing silently noisy math in llama.cpp for years. Three lines fix it, for free.**

## TLDR; Shipped — in turboquant v0.3.0, downloadable now. https://github.com/TheTom/llama-cpp-turboquant/releases/tag/tqp-v0.3.0 llama.cpp's CUDA code has a flag that means "this GPU is fast at fp16, so do…

r/LocalLLaMA Communities

I mapped Anthropic’s J-Space Hallucination signal across 7 datasets on Qwen3-4B to find out where it works and where it breaks

Anthropic recently published their paper on "Global Workspaces" (J-Space) inside language models, showing that looking at internal "workspace noise" (entropy) can catch hallucinations better than just…

r/LocalLLaMA Communities

First attempts at a CPU setup – MS-02 Intel 285hx, trying Qwen3, Qwen3.6 and Gemma4

I got a new mini-pc for a homelab server recently and thought I'd tinker around with some LLM options on there. As it doesn't have a…

r/LocalLLaMA Communities

Benefits of a second cheap GPU, what capabilities are gained?

Right now I have Gemma 4 26B-A4B (Q4_K_M) running reasonably well (12-15 t/s) on my hardware, which is an i5-8500, 48 GB of DDR4, and an…

r/LocalLLaMA Communities

I didn’t give up – extGemma4-40_5B returned

Continue from my previous posts: https://www.reddit.com/r/LocalLLaMA/comments/1ul0cx9/i_extended_gemma431b_to_44b_88_layers_since/ https://www.reddit.com/r/LocalLLaMA/comments/1um20ev/why_new_inserted_layers_kill_the_gemma4/ (Warning : AI generated Post - due to my bad English) Hugging Face : https://huggingface.co/TOT

r/LocalLLaMA Communities

Qwenthropic

Hey guys, I've been running Qwen 3.6-27b locally on an RTX 3090 for a while now, and it's been genuinely great at solving software issues. However,…

r/LocalLLaMA Communities

Interactive Jacobian-Lens visualizer and live steerer for GGUF models on llama.cpp

I saw a lot of (complete and abortive) jacobian lens projects for HF and PyTorch, but nothing for GGUFs or llama.cpp. So I set Fable 5…

r/LocalLLaMA Communities

next best jump from qwen 3.6 27b

how much vram do you need and what model do you think is the next major upgrade from the good old qwen 3.6 27b as of…