Qwen 3.6 27B + Opencode: what am i doing wrong?
Ok i'm sort of getting desperate here. So i am currently running Qwen 3.6 27B locally at Q8_K_XL and with only ~105k CTX at q8_0. Before…
Latest
poor man’s way to local inference on the go
Many bring egpu to game on laptop, yet here I am fiddling with llama cpp params for 1-time crappy HW configuration for Qwen3.6 35B A3B. idk…
OpenAI head of strategic futures says open-weight model dominance is AI communism
submitted by /u/AloneCoffee4538 [link] [comments]
Did someone used Nvidia’s Tensor-RT LLM or other streaming frameworks like DeepSpeed to run full precision models > than the VRAM+RAM?
I wan to do full precision inference with un-quantized, unmodified MoE models like Hy3 on a machine where the VRAM and system RAM together can't hold…
OSS gathering in Shanghai
This seems awesome meetup. Within a day, Qwen started the move with 3.8 version. Hoping for more moves from others soon. Tweet : https://xcancel.com/RenLeanna/status/2078144481812185186#m submitted by…
Qwen 3.8 Max is now live on app too (chat.qwen.ai)
https://chat.qwen.ai/ submitted by /u/Nunki08 [link] [comments]
Please god, please there will be a smaller variant that also come with it
Not thorwing shade to open weight, but holyshit 2.4T, isn't it sound so wrong that recent model such as Minimax M3 is the only sub 0.5T…
Introducing ASCIITermDraw Bench | Testing the ability of VLMs to Generate and Edit ASCII
ASCIITermDraw-Bench: Can a Model Actually Draw in ASCII? Do we really need a image generator to relay our thoughts about - an architecture? a topology? a…
Prepare your (v)ram – Qwen3.8 is coming!
submitted by /u/xw1y [link] [comments]
What to do after buying 5090 for Local llm training?
I just bought 5090 astral OC balck, for local research on Embedding models and small llm like bert..etc. After 3 or 5 hours the PC shutdown.…