Skip to content

Communities 7209 stories

r/LocalLLaMA Communities

LFM 2.5 230M running at 1440 tok/s in-browser through a custom backend

Everything runs through WebGPU, in-browser or in electron/tauri apps. It's fully portable and supports either Nvidia and Apple Silicon (Metal). The actual kernels are optimized for…

r/LocalLLaMA Communities

Great Arguments by Member of Technical Staff at Anthropic :D

Tweet : https://xcancel.com/Mononofu/status/2080937562739531837#m submitted by /u/pmttyji [link] [comments]

r/LocalLLaMA Communities

Turns out open AI is a coalition, not a company.

submitted by /u/InternationalGap3698 [link] [comments]

r/LocalLLaMA Communities

How much are you actually using your local models these days? Which ones do you reach for the most?

I started tracking my local model usage about four weeks ago and was wondering if anyone else here keeps track of how much they use them.…

Hacker News (front page) Communities

Rauno's Field Notes #2

Article URL: https://rauno.me/notes/2 Comments URL: https://news.ycombinator.com/item?id=49049066 Points: 5 # Comments: 0

r/LocalLLaMA Communities

Medium sized MoE LLM models

What are some medium sized MoE models (up to 60B parameters in float8/110B in mxfp4) that are currently worth using? As far as I am aware…

Hacker News (front page) Communities

Amen Break

Article URL: https://en.wikipedia.org/wiki/Amen_break Comments URL: https://news.ycombinator.com/item?id=49049015 Points: 10 # Comments: 0

Hacker News (front page) Communities

Politician reads AI prompt during assembly

Article URL: https://www.youtube.com/watch?v=wlYa8NV5k-U Comments URL: https://news.ycombinator.com/item?id=49048996 Points: 25 # Comments: 11

Hacker News (front page) Communities

Wind turbine is being used to produce zero-carbon "green ammonia" fertilizer

Article URL: https://energiesmedia.com/wind-turbine-stopped-electricity-wind-water-air/ Comments URL: https://news.ycombinator.com/item?id=49048819 Points: 41 # Comments: 20

Hacker News (front page) Communities

Bringing PyTorch Monarch to AMD GPUs

Article URL: https://pytorch.org/blog/bringing-pytorch-monarch-to-amd-gpus-single-controller-distributed-training-on-rocm/ Comments URL: https://news.ycombinator.com/item?id=49048689 Points: 4 # Comments: 2

Hacker News (front page) Communities

The Dark Night of Mathematics

Article URL: https://kirwinhampshire.substack.com/p/the-dark-night-of-mathematics Comments URL: https://news.ycombinator.com/item?id=49048681 Points: 25 # Comments: 8

LessWrong AI Communities

Introducing PIRAMID: Physics-Informed Research for Ambitious Mechanistic Interpretability

Principles of Intelligence (PrincInt, formerly PIBBSS) is launching PIRAMID, an internal research division using the tools and techniques of statistical physics to build scientific foundations for…

Hacker News (front page) Communities

Brazilian farmers tokenized dairy cows to get loans, bypassing bank limits

Article URL: https://www.coindesk.com/markets/2026/07/24/brazilian-farmers-tokenized-dairy-cows-to-get-loans-bypassing-bank-lending-limits Comments URL: https://news.ycombinator.com/item?id=49048645 Points: 5 # Comments: 0

Hacker News (front page) Communities

The whole premise of checking for human writing is daft

Article URL: https://mohammedshehu.com/checking-for-human-writing-is-daft/ Comments URL: https://news.ycombinator.com/item?id=49048584 Points: 35 # Comments: 40

r/LocalLLaMA Communities

… inside Anthropic right now

submitted by /u/jah242 [link] [comments]

r/LocalLLaMA Communities

Google comes out in favor of OpenWeight models. (It is now EVERY tech giant vs Anthropic)

submitted by /u/MysteryWra [link] [comments]

Hacker News (front page) Communities

Engineering management after the cost of code collapsed

Article URL: https://karimjedda.com/engineering-management-after-cost-of-code-collapse/ Comments URL: https://news.ycombinator.com/item?id=49048212 Points: 26 # Comments: 25

r/LocalLLaMA Communities

Getting a second GPU in addition to my RTX3090

Hello, I've been learning how to use local LLMs for a year or so on my workstation, using a RTX3090. Current setup : - i5 12400…

Hacker News (front page) Communities

Open-weight AI is having its Kubernetes moment. Let's not ruin it

Article URL: https://tobi.knaup.me/2026-07-25-open-weight-ai-is-having-its-kubernetes-moment/ Comments URL: https://news.ycombinator.com/item?id=49048034 Points: 38 # Comments: 8

Hacker News (front page) Communities

Task-centered iproute2 user guide

Article URL: https://baturin.org/docs/iproute2/ Comments URL: https://news.ycombinator.com/item?id=49047884 Points: 10 # Comments: 0

Hacker News (front page) Communities

Scanwheel is a drum style mechanical television you can build yourself

Article URL: https://github.com/AncientJames/Scanwheel/ Comments URL: https://news.ycombinator.com/item?id=49047707 Points: 12 # Comments: 1

r/LocalLLaMA Communities

Ollama Qwen3.6:35b randomly stops outputting tokens

RTX 4070, 32gb system ram, Linux. NVIDIA-SMI 610.43.03, KMD Version: 610.43.03, CUDA UMD Version: 13.3 Systemd service modifications: [Service] Environment="OLLAMA_HOST=0.0.0.0:11434" Environment="OLLAMA_FLASH_ATTENTION=true" Environment="OLLAMA_KV_CACHE_TYPE=q8_0" Environment="OLLAMA_NUM_PARALLEL=1" Environment="OLLAM

Hacker News (front page) Communities

The Silurian Hypothesis (2020)

Article URL: https://www.theparisreview.org/blog/2020/01/23/the-silurian-hypothesis/ Comments URL: https://news.ycombinator.com/item?id=49047563 Points: 16 # Comments: 10

r/LocalLLaMA Communities

Cheapest reliable API provider for open-source models (e.g., DeepSeek, GLM)

Hallo Everyone, i need to generate big amount of high quality data, for that i need some cheap API providers. who is the cheapest,most reliable provider…