I RL-trained Qwen3.6-35B-A3B to RL-train small task-specific Qwen models. Fully open source! 🤓
👋 Training my first RL model last year was super fun, now I've RL-trained a model that RL-trains other models... wild times! The agent gets a…
Qwen fable hybrid
We tried to gather as many useable beneficial fable and opus 4.8 examples as possible. Fully uncensored (huihui) and we think the numbers speak for itself.…
RT Benjamin Marie: ThinkingCap-Qwen3.6-27B is really good. Much faster than the original Qwen3.6-27B thanks to shorter thinking, while preserving accu…
RT Benjamin MarieThinkingCap-Qwen3.6-27B is really good.Much faster than the original Qwen3.6-27B thanks to shorter thinking, while preserving accuracy.Also one of the best evaluation I have seen…
Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V2-GGUF
Here model: https://huggingface.co/LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V2-GGUF Settings: temperature=0.6, top_p=0.95, top_k=20, min_p=0, presence_penalty=disabled, repeat_penalty=disabled, seed=42, thinking=enabled System Prompt: You are Qwen, a large language model created by Tongyi Lab team…
By the end of the year we should have: GPT 6 Fable 5.5 Gemini 3.5 Pro Grok 5 Spark 2 Kimi 3 Minimax M3.5 GLM 6 DeepSeek v4.5 Mistral 4 Qwen 4 MiMo 3 N…
By the end of the year we should have:GPT 6Fable 5.5Gemini 3.5 ProGrok 5Spark 2Kimi 3Minimax M3.5GLM 6DeepSeek v4.5Mistral 4Qwen 4MiMo 3Never in the history of…
Qwen3.6-35B-A3B-MTP built this website with Pi Coding Agent on my laptop
I tested Unsloth's Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL with simple Pi Coding Agent. No skill or extensions used. My laptop have 32GB RAM and 8GB VRAM. Without context it runs…
Production Qwen 3.6-27B VLLM config?
Hi everyone, I've spent about four days now trying to find the eight configuration for running Qwen 27b in production using VLLM but have been getting…
20GB VRAM + 64GB DDR5 – Qwen3.6 35B A3B still the best choice?
Hey everyone. Trying to figure out the best setup for my hardware. I've got a 64GB DDR5 RAM laptop and A 20GB 7900xt egpu. Usecase is…
Compressed Version of Qwen-3.6-27B coming from PrismML – Khosla-Backed Startup Claims Breakthrough With Largest-Ever AI Model on an iPhone
The startup, PrismML, said it has shrunk down Qwen 3.6, an open-source large language model developed by Chinese internet giant Alibaba, to run on an iPhone…
Running Qwen3.5-122B on Mac Studio 96GB: Fixed 3 bugs that made long-context inference usable
Hey everyone, I recently switched from DS4 Flash to Qwen3.5-122B on my M3 Ultra Mac Studio for long-context agentic coding. While the model fit better, I…
Qwen 3.6 35b 3a Fable fine tune
Hey friends, I started a project i think we can all benefit from. I rented a few h200's and am fine tuning a hui Qwen 35b…
If you use Open Code or other agenting programs you are leaving a lot of t/s if you don’t actually use agents in parallel. Benchmark : RTX5090, Qwen3.6 35B loaded via LM studio with parallel tasks set to 8
As many of you know t/s is super important. It's how fast your stuff gets done. I create via open code benchtest and run it. Thanks…
Working around Qwen3.6-27B’s tool-call failures and looping
Let's start a discussion about what can be done to make local models more reliable. I've been using Qwen3.6-27B a lot lately, and have noticed the…
Benchmark – 4x 5060 Ti (64GB VRAM) (P2P) – Qwen3.6 27B (INT8 /w bf16 kv cache) @ 8 concurrency with SGLang. SGLang seems to handle higher concurrency better with this setup
I recently posted some posts with VLLM showing issues with TTFT and concurrency with 4x 5060 ti's. Wanted to share this benchmark to provide what worked…
Voodoo Quant beats Unsloth Dynamic 2.0 KLD by 95% in Qwen3.5 0.8B and 2B
Hey all, here are two new high performance qwen3.5 gguf sets I created using a new state of the art technique for optimizing mixed precision called…
First attempts at a CPU setup – MS-02 Intel 285hx, trying Qwen3, Qwen3.6 and Gemma4
I got a new mini-pc for a homelab server recently and thought I'd tinker around with some LLM options on there. As it doesn't have a…
next best jump from qwen 3.6 27b
how much vram do you need and what model do you think is the next major upgrade from the good old qwen 3.6 27b as of…
Fixed three bugs that made Qwen3.5-122B a daily driver on Mac Studio
Article URL: https://mrzk.io/posts/qmlx-maximising-ai-psychosis-minmaxing-mac-studio/ Comments URL: https://news.ycombinator.com/item?id=48876619 Points: 5 # Comments: 0
I benched quad 5060Tis for code generation with Qwen3.6-27B so you don’t have to (it’s really good)
WEIRD DISCLAIMER: none of this was written by an LLM until you get to the Github repo/site, which was obviously assembled by your friend and mine,…
Is it possible to run Qwen 122B in 64GB ram + 24gb vram ? If so, how ?
Which settings would suffice to work with it ? submitted by /u/soyalemujica [link] [comments]
CTX: How far can you reasonably go with Qwen 3.6 27B?
How far can i stretch the context window with Qwen 3.6 27B (using Q8_0) before it gets too unreliable? I am at 100k right now and…
Fastest speculative decoding for qwen
Hey guys, we’ve built fastest speculative decoding for Qwen at least. To run in sglang you can use our fork Hf link Would appreciate your feedback…
Running Qwen3 30B A3B at 50 tok/s on RTX 5060 Ti
Experimented with some custom CUDA and C++ code that can now run a Qwen3-30B-A3B at 50-54 tok/s at float 8 on an RTX 5060 Ti with…
How can i limit reasoning effort on the qwen3.5 and gemma4 models?
So, umhh, I am working on an agentic coding platform, and I need to make qwen3.5 and gemma4 models out of controlled reasoning chains. For example,…