Local LLMs for non-coding
What are your top 3 uses cases? Seems that outside coding the application of local is limited? submitted by /u/Salt_Armadillo8884 [link] [comments]
What are your top 3 uses cases? Seems that outside coding the application of local is limited? submitted by /u/Salt_Armadillo8884 [link] [comments]
I've always found it a little strange that AI is everywhere, but the codecs we use in practice are the traditional hand-engineered systems like h.264, h.265,…
tl;dr:Lindsey 2025 found models can modulate their internal states: when instructed to “think about” a concept while writing an unrelated sentence, the representation of the concept…
As AI capabilities rapidly advance, we face critical information gaps in effective AI risk management: What are the risks from AI, which are most important, and…
Article URL: https://github.com/AminBlg/SimpleEnglish Comments URL: https://news.ycombinator.com/item?id=49114639 Points: 14 # Comments: 5
Humans make carbon dioxide. Carbon dioxide is bad for cognition. But plants turn carbon dioxide back into oxygen. And plants are the one true home decoration…
Consider the following situations:when you are a small, growing startup in a big market, standard advice is not to worry too much about your competitors or…
Pretty incredible to see open-weight become a mainstream discussion. submitted by /u/Recoil42 [link] [comments]
Hello, I have a friend who's using various local LLM's like qwen3.6 27B, 35b-a3b, North Mini Code, and qwen2.5-vl-7b (just for vision). They have a use…
If you were able to get an inference machine that could do decode at 1k toks/s or even 10k tok/s, would that even be helpful? Would…
Article URL: https://www.uefa.com/news-media/news/02a7-213a92896eb0-54dfbf454e3b-1000--statement-on-behalf-of-uefa-and-its-55-national-associations/ Comments URL: https://news.ycombinator.com/item?id=49113929 Points: 14 # Comments: 2
Article URL: https://www.dbos.dev/blog/making-postgres-queues-scale Comments URL: https://news.ycombinator.com/item?id=49113913 Points: 12 # Comments: 1
Article URL: https://dynomight.net/plants/ Comments URL: https://news.ycombinator.com/item?id=49113801 Points: 8 # Comments: 0
We recently used DeepSeek V4 Flash as a teacher for finance tasks with GPT-OSS-120B. Distillation works well on this problem. At a constrained 8k token budget,…
Article URL: https://github.com/yashmahajan10/llm-differential-privacy-gateway Comments URL: https://news.ycombinator.com/item?id=49113543 Points: 4 # Comments: 0
276B total parameters, 12B active, 1M context window. Blog post: https://thinkingmachines.ai/news/inkling-small/ NVFP4: https://huggingface.co/thinkingmachines/Inkling-Small-NVFP4 GGUF's by Unsloth: https://huggingface.co/unsloth/Inkling-Small-GGUF submitted by /u/rerri [link] [comments]
Article URL: https://tally.jiegou.ai/ Comments URL: https://news.ycombinator.com/item?id=49113381 Points: 4 # Comments: 0
Article URL: https://chriscoyier.net/2026/07/30/codepen-2-0/ Comments URL: https://news.ycombinator.com/item?id=49113338 Points: 14 # Comments: 4
Hey fellow llamas, sorry for posting again this week but i thought this was interesting to showcase to share with y'all. Lucebox partnered up with AMD…
Article URL: https://www.bottlenecklabs.com/blog/autonomously-run-businesses Comments URL: https://news.ycombinator.com/item?id=49113059 Points: 22 # Comments: 3
Article URL: https://openai.com/index/advancing-the-price-performance-frontier-with-gpt-5-6/ Comments URL: https://news.ycombinator.com/item?id=49112867 Points: 122 # Comments: 58
I'm guessing 3 years, what do you think? In other words: many of us will be able to afford a general purpose robot in 3 years…
Article URL: https://krebsonsecurity.com/2026/07/read-this-before-you-buy-that-tv-streaming-stick/ Comments URL: https://news.ycombinator.com/item?id=49112744 Points: 81 # Comments: 26
submitted by /u/niacolhealth [link] [comments]