Told it that in plan mode, then told it to implement with no changes to the plan. This model punches far, far above its weight. I…
Been trying to troubleshoot prefill around when I saw the newer (supposibly faster) nvfp4 quant. For those curious of prefill issues on 4x5060 ti's, hopefully this…
Hey r/LocalLLaMA folks! We made NVFP4 quants 2.5x faster for Qwen3.6 27B and also 1.56x to 1.79x faster for 35B-A3B vs NVIDIA's NVFP4 quants without any…
WoahMoore Threads post-trains Qwen3.6-27B for kernel engineering, getting a really good model… good RL details… but what's more salient, they test it on a MUSA port…
TL;DR: Quantization has a marked impact on agentic performance but little effect on knowledge. I manage a small HPC cluster at a university, and we have…
Context: I just configured Qwen3.6 27B with DFlash on my DGX spark and looking at all the "reports" it should be a bit faster than i…
submitted by /u/beneath_steel_sky [link] [comments]
Hey Everyone, here is an update on MTPLX! One month after releasing MTPLX V1 which brought a swift based app and upgraded CLI for coding use…
I’m using Opencode and a computer with 128gb. So maybe the results would be different on system. I’ve exhaustingly tried Qwen3.6 27B and Qwen3.6 33B. I…
Been using this for real software development for a commercial app. i.e. Not a single file HTML app. I mean a large scale 100k+ loc project…
It's more of a showcase demo at the moment, but Qwen3TTS 0.6B runs usable fast in Q4. On my Galaxy S25 I get around 0.5 realtime…
Hey guys, A month ago I posted my MTP benchmarks here (3.34x on Gemma 4). DFlash support just merged into llama.cpp (PR #22105), so I ran…
Lower is better - Quantization increases from right to left I recently made a post here about how I squeezed more context into a Q8 model…
Qwen RLVR that makes it a dry math-brained tool [in visible outputs]:Wyatt Walls: Ask Qwen about its favorite sport and this where its mind immediately goes
I run Qwen3.6-35B-A3B daily for Laravel + Vue full-stack work, and it genuinely bugs me that a 20GB+ model spends weights on French, Chinese, Spanish—languages I…
Hi everyone, I'm trying to determine if I'm dealing with a misconfiguration in my stack or if this is an inherent limitation of current quantization methods…
Anthropic published research today into what a model is thinking behind the scenes while it is deciding what to actually write. More importantly, they released the…
I have been running Qwen 3.5 122B at 4 bit for quite a while, and have started running it at 5 bit recently now that Llama.cpp…
Interesting stuff. And the visualization at the end is worth trying: https://www.neuronpedia.org/qwen3.6-27b/jlensAnthropic: New Anthropic research: A global workspace in language models.Of everything happening in your brain…
We rigorously evaluate the resulting checkpoint across general reasoning, non-reasoning multiple-choice question answering, everyday multi-turn conversations, system prompt adherence, safety, math, code and agentic use cases.…
I have this feeling for sometime. Also noticed few similar tweets online before. submitted by /u/pmttyji [link] [comments]
Who has results for this? submitted by /u/Stock-Union6934 [link] [comments]
Sharing some testing of Qwen 3.6 27B using VLLM across the popular quants on my development system. I used llama benchy to generate the results, then…
Given that Alibaba went proprietary/API-only for the Qwen 3.7 Max and Plus launches back in May, do we have any rumors or roadmap for a local…
Qwen is Alibaba's open-weight model family — Qwen3 (text), Qwen3-VL (vision), Qwen3-Coder, QwQ (reasoning). Qwen3 sits near the top of every open-weight benchmark in 2026 and ships under a permissive licence.
Owner: Alibaba. We have 350 stories indexed for this model, auto-tagged from titles across every tracked source — official announcements, papers, GitHub release notes, and third-party press. The CTA on each card links to the original; the official site is qwen.ai.
Related text models: GPT, Claude, Gemini, Gemma, Llama, Mistral, Grok, DeepSeek.