Qwen Developers’ responses from their recent Twitter/X AMA
Questions & Responses(in BOLD) below. Favorite question(s) moved to end of the thread with combined responses(removed duplicates). Be optimistic folks. I'm sure we're getting other models…
Latest
I updated my localy run benchmark with DeepSeek V4 Flash 0731
It's the purple cluster on the top left (the good corner...) I'm running the MXFP4 version from Bartoswski with Dspark at 1K t/s prefill and 90…
Anyone interested in building a harness-only benchmark?
There are a lot of LLM benchmarks but few, if any, harness benchmarks. I am thinking this would be a really good community project to build…
SLMs & QAT
I know many labs trying to shrink deployment costs and increase efficiency. While I do think that that is fine and dandy, I do sometimes question…
Building a Fully Local PDF Read-Aloud & PDF-to-Audiobook Desktop App with Kokoro 82M, Qwen, and llama.cpp
Hey everyone, I’ve been building Speechfony - a desktop app for reading PDFs (and EPUBs) with offline text-to-speech. Open a document, listen sentence-by-sentence with highlighting, or…
Qwen3-TTS voice cloning is now in mainline llama.cpp — the old demo finally became real support
People may remember the Qwen3-TTS llama.cpp demo from a few months ago. That PR said it probably wouldn’t be merged because llama.cpp was missing some of…
Intern S2 Mobius
A Qwen3.5-35B derived model with an interesting architectural difference that results in larger throughput and less token consumption (allegedly): https://huggingface.co/internlm/Intern-S2-Mobius submitted by /u/Miserable-Dare5090 [link] [comments]
GPT-X2.5-135M scores 3rd place on Open SLM Leaderboard on Huggingface, Beating Facebook’s MobileLLM-R1-140M
submitted by /u/Megneous [link] [comments]
China’s Open-Weight Models Will Be Spared US Safety Tests
submitted by /u/fallingdowndizzyvr [link] [comments]
VibeVoice 1.5B Running Locally…On an iPhone! Only ~2.2 GB of Memory and Up to 1.28× Real-Time Speed
I speed up the generation part of the demo in case you get bored 😄 I also tested another long-form generation, and the VRAM usage looks…