[Discussion] non developers: what are some use cases for your local models?
i get curious about this a lot, and majority of the times i get a response which is similar to mine that is : it fulfills…
Latest
just another benchmark: $0.34 vs $27.60 for the same tasks solved
submitted by /u/arsenyinfo [link] [comments]
Softmax for People Trying To Run Models on FPGAs
My weekend sideproject was implementing the paper 'Approximating Softmax for FPGAs with Taylor Series and Pade Approximants' The paper’s motivation is the hardware constraints limiting exponential…
Do Qwen 3.6 27B quantizations break the pelican?
submitted by /u/pmigdal [link] [comments]
XYZAILab/XYZ-Aquila-mini · Hugging Face
XYZ-Aquila is a family of open-weight Deep Search agents developed by XYZ AI Lab. XYZ-Aquila-mini is post-trained from Qwen3.6-35B-A3B through a bounded-exploration AI4AI pipeline: humans define…
Jensen Huang: During the Hugging Face incident, closed AI blocked essential forensics. An open-weight frontier model helped contain the intrusion. That’s why we created the Open Secure AI Alliance.
Jensen Huang on 𝕏: https://x.com/JensenHuang/status/2081698060330250294 submitted by /u/Nunki08 [link] [comments]
Meta will be launching a harness and open-source models
submitted by /u/celsowm [link] [comments]
The lab named after humanity is the only one that will not share weights with humanity
submitted by /u/InternationalGap3698 [link] [comments]
Qwen3.6-27B speculative decoding gets better on heavier quants
I finished the speed leg of my spec-decode benchmarking for Qwen3.6-27B, main algorithms across quants. Overall: the heavier the quant, the more spec-decode buys you (10…
For V100 Users: SGLang running Qwen+Dflash and Laguna
Forked SGLang, wrote TeilLang FlashAttention for V100, used open-source marlin-v100, ungated flashinfer for sm70, made Dflash work for Qwen3.5/3.6 models, added Laguna S2.1 support, tried to…