Hi r/LocalLLaMA — I’m sharing an experimental GPU-only inference backend and looking for independent reproductions, not just stars. Model: tiiuae/Falcon3-10B-Instruct-1.58bit GPU: NVIDIA RTX 5070 Batch: 1…
Article URL: https://grego.site/blog/thinkphone Comments URL: https://news.ycombinator.com/item?id=49059977 Points: 6 # Comments: 3
NOTE -> I expect answer from people who actually have experience and strong understanding of these. please give something beneficial. I'm building a SaaS platform in…
TL;DR llama.cpp fork with more KV cache quantization features, with all claims supported by benchmarks: KVarN, KV cache precision tail, additional types of standard KV cache…
Article URL: https://www.agrillo.it/EvasionEn.html Comments URL: https://news.ycombinator.com/item?id=49059660 Points: 3 # Comments: 0
Last week someone here said ThinkingCap and Fable Fusion "really do beat the OG" for agentic work, so I ran it: 6 self-grading tasks, 5 reps,…
LTT Labs recently received the Linux version of the AMD Ryzen AI Halo for testing, but it turns out that AMD had intended to send the…
Curious about the initial review distribution for Main Track theory papers this year. Our paper received 4/3/3 with confidence 3/3/3. From previous years, I've had the…
Article URL: https://spectrum.ieee.org/origami-circuit-boards Comments URL: https://news.ycombinator.com/item?id=49059418 Points: 5 # Comments: 0
Article URL: https://github.com/gmrandazzo/CheapSecurity Comments URL: https://news.ycombinator.com/item?id=49059398 Points: 16 # Comments: 2
Article URL: https://stephango.com/design-is-compromise Comments URL: https://news.ycombinator.com/item?id=49059367 Points: 35 # Comments: 14
https://x.com/i/status/2081398564345802934 submitted by /u/jacek2023 [link] [comments]
Article URL: https://vectoral.com/blog/token-relay-market Comments URL: https://news.ycombinator.com/item?id=49058993 Points: 5 # Comments: 1
Article URL: https://aerospaceglobalnews.com/news/gatwick-airport-robotic-parking-stanley-robotics/ Comments URL: https://news.ycombinator.com/item?id=49058669 Points: 52 # Comments: 22
There's been a recent call from @dynomight to declare whether and how you're using AI to write your essays. That seems reasonable, so here's my own…
Title, for local inference and training, please. submitted by /u/Desperate_Tea304 [link] [comments]
Article URL: https://techcrunch.com/2026/07/25/the-hacker-who-humiliated-spyware-makers-and-was-never-caught/ Comments URL: https://news.ycombinator.com/item?id=49058593 Points: 3 # Comments: 0
Hey r/LocalLLaMA — maintainer here, obviously biased. OpenSmith is an open-source Python tracing tool for LLM pipelines. The idea: drop u/trace on any function, run opensmith…
I'm a software engineer who mainly builds softwaes/applications, and I'm starting to work on machine learning projects. Since ML workloads often require GPUs, I know services…
The server rack was humming at maximum capacity, fan speeds pegged at 100%, and thermal throttling was the absolute last thing on the Router’s mind. "Give…
submitted by /u/pscoutou [link] [comments]
https://preview.redd.it/qoogv5m1skfh1.png?width=688&format=png&auto=webp&s=3f06fb28ceec3cd3ab95bcebd0c71374332aac9b Built a simple desktop GUI (Tkinter) that supports multiple local TTS engines (currently Kokoro and Chatterbox, will add more in the coming days). Why? mostly…
This is our biggest comparison yet. We've taken 23 Gemma 4 E4B models from huggingface and ran them through the abliterlitics gauntlet. We also have a…
Article URL: https://github.com/ricardoborges/Nautilus Comments URL: https://news.ycombinator.com/item?id=49057985 Points: 7 # Comments: 0