[Paper] Sparse Delta Memory: Scaling the State of Linear RNNs through Sparsity
Linear attention models allow a fixed state size and a fixed amount of compute per token. However, due to their limited state size, linear attention models…
Latest
CEO: “token efficiency needs to drop 90%” Dude… just write “no_think” before you ‘summarize this email’ prompts
“token efficiency needs to drop to as much as 20% over the next 12 months, and 90% by the following year” submitted by /u/JLeonsarmiento [link] [comments]
Qwen 3.6 Q2-FP8 Terminal Bench 2 and GPQA Scores
TL;DR: Quantization has a marked impact on agentic performance but little effect on knowledge. I manage a small HPC cluster at a university, and we have…
Meta are apparently working on an open source variant of Muse Spark.
No real details or timescales yet, but this article has confirmation from Alexandr Wang that Meta are working on an open source variant of Muse Spark.…
Deepseek V4 Flash on a single RTX 6000 Pro – vLLM-Moet
Wow... https://github.com/kacper-daftcode/vLLM-Moet Using this customized vllm provided as a docker, I'm able to run DS V4 Flash on a single RTX 6000 Pro (apparently it also…
Locally run assistant on a w-10 board on a local Xiaozhi server
Hello, Locallama! "long-time" member here, from the days when the max context window doubled from 2K to a whooping 4K! Now I feel like I am…
The untuned 27B beat the tuned 75B as an agent
I have to admit, a lot of people we're 100% correct to make the suggestion to try this model. I am sorry I ever doubted. The…
Has anyone tested how quantization hits different capabilities separately? My results are surprising.
I've been running some systematic tests on a few models comparing FP16 vs various GGUF quant levels, and instead of looking at one aggregate benchmark score,…
Koboldcpp v1.117 released
submitted by /u/Fcking_Chuck [link] [comments]
GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine
submitted by /u/yogthos [link] [comments]