Luth-2: New State-of-the-Art French Small Language Models
Hey everyone, Today we release Luth-2-0.8B and Luth2-2-2B, two non-reasoning models that set a new state of the art for French across a wide variety of…
Latest
DeepSeek-V4-Flash acting as my Linux sysadmin
I'm very happy with some Linux admin tasks I'm throwing at a locally running DeepSeek. My request was simple, check why 'samples' folder is taking more…
Why have 8B-12B models been dropped?
I am a Macbook Pro M4 user with the 16GB of unified ram. The best model I have been able to run on LM Studio is…
12GB VRAM gang, what’s our plan?
Seems like we're limited to qwen finetuned MoEs for now. Looking at the current landscape - focus seems to be on dense models (muse glimmer 30b,…
Add CI targets for ROCm 7.14 by superm1 · Pull Request #25775 · ggml-org/llama.cpp
Available b10356 onwards. Overview ROCm 7.14 is the first production release using TheRock build system. It can be installed using multi-arch deliverables from wheels, debs, rpms,…
I ran Muse Glimmer @ 1M context – All tests passed.
Heeeey all! I just completed some fun tests with Muse Glimmer, I thought I'd let you know. In fact, the summary below was written by Muse…
Qwen 3.8-27b coming this week
Confirmed by the official Qwen account. submitted by /u/Bestlife73 [link] [comments]
Nvidia reportedly testing lower memory configs of Rubin Ultra as memory shortage bites back — designs tested include as little as 192 GB and step back to HBM4
submitted by /u/fallingdowndizzyvr [link] [comments]
I gave DeepSeek V4 Flash basic vision by training a 40M connector on 100K examples
I wanted to find out whether a huge text-only MoE could be given basic vision without retraining the language model itself. The short answer is yes.…
1 Day in and I feel okay saying Muse-Glimmer-30B finally beats 3.6-27B for the size in some use-cases
A few things right off the bat: it reasons very efficiently. Like Grok 4.5 levels of efficient thinking it quantizes very well. My first few tests…