Speculative decoding in a tools call
paper : https://arxiv.org/html/2608.00814v1 source : https://x.com/i/status/2086505517640540587 submitted by /u/Illustrious-Swim9663 [link] [comments]
Latest
Open Model: Google Weather Next 2
I am not a meteorologist, but I just read a very interesting article: https://arstechnica.com/science/2026/08/deepminds-hurricane-model-bought-forecasters-an-extra-day/ In a paper published on Thursday in Nature, researchers show that the…
Pathway’s BDH(post-transformer arch) matches GPT2 scaling from 10M to 1B params trained from scratch. runs on Normal GPUs
submitted by /u/Candid-Tackle-9061 [link] [comments]
Add a amd 9700 ai pro to a 3×5090 system vs buy a 5070ti for general useage.
Hey guys I have this OCD im trying to decide about, I was lucky enough to buy 3 5090 before all the crazy ai stuff started…
DeepSeek-V4-Flash-0731 Q8_K_XL sometimes stops mid-task in OpenCode – anyone else seeing this?
Hey everyone, I've been experimenting with the new DeepSeek-V4-Flash-0731 release locally using the Unsloth Studio Q8_K_XL GGUF with OpenCode. Overall, it's been working really well, but…
small model for text-to-regex
Anyone have a good local model for this? i feel like this should be a near solved problem. submitted by /u/minaminotenmangu [link] [comments]
Open-weight video gen that actually delivers. Five days with MiniMax H3 on local hardware.
H3 weights went live on HuggingFace August 3rd and I started pulling them immediately. An omni-modal video model with native stereo audio in the same forward…
Two flags took the official Ling-3.0-flash INT4 from 20.8 to 38.7 tok/s on one DGX Spark
The official INT4 does load on a single DGX Spark. The naive config just leaves most of its speed on the floor, 20.8 tok/s. Two changes…
Dual Radeon AI PRO R9700 server much slower than RTX 5090 for LLM inference, Ollama bottleneck? vLLM / llama.cpp / other recommendations?
Hey All, First sorry for long post, and yes i dictated to AI and got it to fix grammer so its not painful for you all…
Lophius: A workbench for language model research, from the creator of Heretic
Hi folks, I hate slop as much as you do, so instead of starting with "The Problem", I'll just cut to the chase: I just published…