The lab named after humanity is the only one that will not share weights with humanity
submitted by /u/InternationalGap3698 [link] [comments]
Latest
Qwen3.6-27B speculative decoding gets better on heavier quants
I finished the speed leg of my spec-decode benchmarking for Qwen3.6-27B, main algorithms across quants. Overall: the heavier the quant, the more spec-decode buys you (10…
For V100 Users: SGLang running Qwen+Dflash and Laguna
Forked SGLang, wrote TeilLang FlashAttention for V100, used open-source marlin-v100, ungated flashinfer for sm70, made Dflash work for Qwen3.5/3.6 models, added Laguna S2.1 support, tried to…
The entire tech industry (save for Anthropic) has come out in favor of open source AI. So what happens next? Will Anthropic change its lobbying efforts? Not likely. Now the gaslighting begins: “Nobody is trying to ban open source.”
submitted by /u/SignificantLegs [link] [comments]
Chinese Chipmaker CXMT’s market capitalization surpassed Intel
Chinese chipmaker CXMT surged by almost 500% on its first day of trading, bringing its total market capitalization to approximately RMB 3.28 trillion and making…
I want to run Kimi K3 at home, so I’m trying to make 2.8T-scale experimentation cheaper
Hey r/LocalLLaMA, I’m a retired engineer with a background in distributed computing, currently running a 1-person startup. Like many people here, I’d love to experiment with…
A llama.cpp fronted gui that runs on Windows? (Without extra steps)
I now have llama.cpp running pretty well for my needs, but the inability to quickly set/swap models and system prompts isn't ideal. Lm-studio let's you save…
Current smallest usable coding model
I've been seeing a lot of news about the latest gemma 4 and qwen 3.6 being really good and the current go-to models but those are…
A quick coding capability test:4 Qwen 3.6-35B GGUF Variants
Test Prompts: 1.1. Algorithm & Logic (10 pts): "Write a function in Python that finds the contiguous subarray with the largest sum (Kadane's algorithm). Include time…
Meta has confirmed that it will release an open source model in the future
https://preview.redd.it/k97l56d8ypfh1.png?width=606&format=png&auto=webp&s=2a2e2156bea56b25f5709e8f1df2bf82525eb089 https://x.com/alexandr_wang/status/2081501627836661928?s=20 submitted by /u/External_Mood4719 [link] [comments]