Native Long Video Understanding Models locally?
I've been building a personal project and wanted to check with the community on multi-modal inputs since I can't find a lot of material around this…
Communities 6560 stories
1M context with 17 GB model in 24 GB VRAM: "for the first time I was able to load a context of almost 1M tokens and extract 7 needles from various parts of the text"
https://preview.redd.it/xxjh11f38jih1.png?width=1852&format=png&auto=webp&s=76850ed51e29a8bc86c2ca718d4320075eed4363 Just wanted to share a user report that I found to be very interesting. Some person with an intriguing name manu69x managed to run 1M…
Tail-call optimization in C is relatively recent
Article URL: https://lwn.net/Articles/1034703/ Comments URL: https://news.ycombinator.com/item?id=49242297 Points: 13 # Comments: 0
Because It's Not Fun Enough: why languages fail
Article URL: https://bytecode.news/posts/2026/08/because-it-s-not-fun-enough Comments URL: https://news.ycombinator.com/item?id=49242245 Points: 10 # Comments: 0
A 'bananas' order for 5000 obscure book titles fuels suspicion
Article URL: https://www.irishtimes.com/world/europe/2026/08/10/a-mysterious-buying-spree-is-unsettling-europes-booksellers/ Comments URL: https://news.ycombinator.com/item?id=49242213 Points: 7 # Comments: 0
Semi Edge Inference Idea [D]
Today the most important factor in AI is cost. My idea is to split ML models inference (closed ones, proprietary) across server and edge computing on…
Meta's new open-weight model targets local agentic AI
Article URL: https://twitter.com/finkd/status/2086754845218726027 Comments URL: https://news.ycombinator.com/item?id=49242038 Points: 3 # Comments: 0
unsloth/Muse-Glimmer-30B-GGUF · Hugging Face
Guide: https://unsloth.ai/docs/models/muse-glimmer submitted by /u/Nunki08 [link] [comments]
Parametron: 50s Japanese computer that uses neither transistors nor vacuum tubes
Article URL: https://ethw.org/Milestones:Parametron,_1954 Comments URL: https://news.ycombinator.com/item?id=49241846 Points: 13 # Comments: 1
Comparing how Cline, Kilo, and Qwen Code handle long-task context/state (and why context loops keep happening)
I've been comparing Cline / Kilo / Qwen Code lately since they all handle long-task state differently. Cline: has Focus Chain, a markdown file kept outside…
Comparing embedding models with synthetic query probing [R]
Say you want to swap out your embedding models, for instance from ADA to Titan. Are these embedding models comparable? How do similarity score ranges compare?…
The Future Is for Everyone – The Path to a Positive AI Future
Article URL: https://www.meta.com/thefutureisforeveryone/ Comments URL: https://news.ycombinator.com/item?id=49241728 Points: 15 # Comments: 4
Introducing Muse Glimmer: an open-weight model optimized for always-on local agent workflows
Hi r/LocalLLaMA 👋 Today we’re excited to release Muse Glimmer, a 30B open-weight model built specifically for local agent workflows. We’re releasing the weights to the…
Meta open sources new on-device model Muse Glimmer & Muse spark 1.2 also coming soon!
submitted by /u/provoloner09 [link] [comments]
Meta Muse Glimmer – open weights 30B local coding model
Article URL: https://research.meta.ai/blog/introducing-muse-glimmer-open-agentic-model Comments URL: https://news.ycombinator.com/item?id=49241679 Points: 34 # Comments: 7
meta-models/Muse-Glimmer-30B
29.6B dense (including vision encoder) Apache 2.0 GGUF: https://huggingface.co/meta-models/Muse-Glimmer-30B-GGUF llama.cpp PR: https://github.com/ggml-org/llama.cpp/pull/26841 Meta blog: https://research.meta.ai/blog/introducing-muse-glimmer-open-agentic-model submitted by /u/rerri [link] [comments]
Mature/better alternatives to pi-web?
I'm looking for a web interface for my pi harness without the CLI, but this was the only one I found. Are there any others? I'm…
I’ve added Maple-Preview to Mference, got 40 tps generation with 500MB of used RAM on Air M4
I like the idea of running local models, but I don’t like the idea of having them eat up all of my memory. I’ve always thought…
One Email, Three Identities: SPF, DKIM and DMARC Explained
Article URL: https://senderledger.com/articles/one-email-three-identities-spf-dkim-dmarc Comments URL: https://news.ycombinator.com/item?id=49241578 Points: 5 # Comments: 1
3 Collapsing models [R]
Trying to train 3 models for birads detection using cross entropy and center loss + class weights but all of them seem to collapse between birads…
Implant – an extension to VS Code that exposes its APIs to coding agents
Article URL: https://marketplace.visualstudio.com/items?itemName=strangepleasures.implant Comments URL: https://news.ycombinator.com/item?id=49241303 Points: 3 # Comments: 0
Chat UIs with native audio input for multimodal models?
I've been running Gemma 4 E4B with oMLX and I can't find any chat interfaces that directly send the audio file to the model instead of…
Is Eval Gaming Downstream of Verbalized Eval Awareness? Not when it's reflexive.
Code and data available at github.com/KieronKretschmar/latent-awarenessTL;DRWe take two eval-gaming model organisms (Hua et al.'s (2025) organism and RogueQwen) and apply direct preference optimization (DPO) to their…
Why Speculative Decoding went mature in 2026?
Spec-dec has been a thing for a while, in fact, it's wasn't an idea that was born for LLM inference. E.g. Uber's https://github.com/uber/submitqueue applied it to…