Current Limitations of LLMs
The LLM Revolution, Part 2My previous post covered what LLMs are getting good at, but I also think it's important to survey their current limitations (as…
Latest
Testing new models with an animated SVG challenge: flamingo moonwalking on a Sardinian beach
Hello! With all the new model releases, I wanted to run another SVG-generation comparison and since the "pelican riding a bicycle" prompt seems fairly saturated by…
Unsloth now supports AMD!
Hey r/LocalLLaMA folks! Unsloth now officially supports AMD hardware for local inference, fine-tuning, reinforcement learning, and deployment! It's been in the works for quite some time,…
543 tok/s single-request Qwen3.6-35B-A3B on one RTX 5090 over a 65K-token decode
An example TL;DR I have open-sourced NInfer, a from-scratch C++/CUDA inference engine currently specialized for two exact Qwen3.6 checkpoints on a single RTX 5090. Both the…
DeepSeek v4 flash release version appears to have been activated on api. Open weights imminent?
https://np.reddit.com/r/DeepSeek/s/skO7urrE2C DS4 sort of came and went from the spotlight. The consensus seemed to be that its most notable feature is its price, and then we…
RT Zixuan Li: Open-weight models carry real responsibilities. Hugging Face’s disclosure describes how GLM-5.2 was used in a self-hosted forensic work…
RT Zixuan LiOpen-weight models carry real responsibilities.Hugging Face’s disclosure describes how GLM-5.2 was used in a self-hosted forensic workflow during a time-sensitive cyber incident, keeping sensitive…
Linux patches introduce "KNOD" for in-kernel network offloading directly to AMD GPUs
This could be big news for those who use multiple computers in a network to run models locally. submitted by /u/Fcking_Chuck [link] [comments]
I just published my blog on using world modeling to create better language agents. Here are the key takeaways… Link to the blog: https://cameronrwolf…
I just published my blog on using world modeling to create better language agents. Here are the key takeaways…Link to the blog: https://cameronrwolfe.substack.com/p/agentic-world-modelsHow does this work?…
It’s coming folks.
submitted by /u/MLExpert000 [link] [comments]
Our 1-bit quant of Hy3 295B runs 2.2x faster than the cloud API with no quality loss
We quantized Tencent's Hy3 295B down to 1 bit and got a 92GB IQ1_M GGUF, small enough for one 4-GPU box. We ran it on 4x…
RT Ben Burtenshaw: If you're looking to have a load of fun with agents and learn about cutting-edge AI, try this reproduction challenge. You'll grab a…
RT Ben BurtenshawIf you're looking to have a load of fun with agents and learn about cutting-edge AI, try this reproduction challenge.You'll grab a snippet from…
Tracing causal structure in LLM-generated text: a different lens on the Dallas circuit
The classic "Dallas" example from Anthropic focuses on an internal circuit in an LLM.I became curious about what the same underlying process looks like when viewed…
American AI is locked down and proprietary. It's losing
Article URL: https://werd.io/american-ai-is-locked-down-and-proprietary-its-losing/ Comments URL: https://news.ycombinator.com/item?id=48979269 Points: 72 # Comments: 83
Yesterday I was fortunate enough to go to my first-ever World Cup game, with my long-time colleagues/friends @OriolVinyalsML and @quocleix and their s…
Yesterday I was fortunate enough to go to my first-ever World Cup game, with my long-time colleagues/friends @OriolVinyalsML and @quocleix and their spouses). We were sitting…
Model 4: Our best model yet for local dictation and cleanup on Mac
Article URL: https://www.epilude.com/news/introducing-model-4 Comments URL: https://news.ycombinator.com/item?id=48979263 Points: 5 # Comments: 0
Lossless model compression experiment: GLM-5.2 in 25% less memory
Article URL: https://brianbell-x.github.io/weight-compression/ Comments URL: https://news.ycombinator.com/item?id=48979201 Points: 14 # Comments: 1
RT Steve Rattner: Trump claimed his tariffs would bring about a golden age of American manufacturing. Yet since his re-election, we've lost 75,000 man…
RT Steve RattnerTrump claimed his tariffs would bring about a golden age of American manufacturing. Yet since his re-election, we've lost 75,000 manufacturing jobs. Over the…
RT Tom Yeh: Backpropagation by hand ✍️ ~ 11 steps walkthrough below Backpropagation is the algorithm that actually trains a neural network, and it i…
RT Tom YehBackpropagation by hand ✍️ ~ 11 steps walkthrough belowBackpropagation is the algorithm that actually trains a neural network, and it is where most people…
Perfection Is Not Over-Engineering
Article URL: https://var0.xyz/posts/perfection-is-not-over-engineering.html Comments URL: https://news.ycombinator.com/item?id=48979120 Points: 24 # Comments: 7
Firefox 153.0 Beta
Article URL: https://www.firefox.com/en-US/firefox/153.0beta/releasenotes/ Comments URL: https://news.ycombinator.com/item?id=48979110 Points: 5 # Comments: 0
Trellis.cpp now has a studio!
When Trellis.cpp released, people were rightly complaining that while the port was nice, the usability barrier was still high since you had to navigate the command…
Trump administration reportedly builds a slow-motion ban on Chinese AI models through sanctions and soft pressure
The Trump administration is reportedly weighing measures targeting Chinese AI models, from adding Chinese labs to sanctions lists to holding U.S. companies liable for security failures.…
See like a Robot: Robot-Centric Pointmaps for Vision-Language-Action Models
Vision-language-action (VLA) models predict robot actions from visual observations and language instructions. These actions are defined in the robot's own 3D coordinate frame, yet most VLAs…
Tested Kimi K3 for Coding (2026)
Article URL: https://www.dotnetperls.com/2026_7_18_tested-kimi-k3-coding Comments URL: https://news.ycombinator.com/item?id=48979010 Points: 6 # Comments: 0