Could we have a –disk-moe or –n-disk-moe like –cpu-moe or –n-cpu-moe so we can use disk/cpu/gpu ?
Explicit title, It would be nice to have the ability to have 3 tiers moe offload :( submitted by /u/storm1er [link] [comments]
Communities 6726 stories
Measuring coding agent misalignment in the wild
Cross-posted from the Transluce blog.We studied rates of coding agent misalignment in 8,600 real-world coding agent sessions. We found severe cases of monitor evasion and misrepresenting…
Thomas Schelling's Nobel Prize Speech: An Astonishing Sixty Years: The Legacy of Hiroshima
Thomas C. Schelling — Prize Lecture, December 8, 2005. Source: NobelPrize.org, © The Nobel Foundation 2005.The most spectacular event of the past half century is one…
The Title Cards in Blade Runner Are Fucking Amazing
Article URL: https://randsinrepose.com/archives/blade-runner-title-cards/ Comments URL: https://news.ycombinator.com/item?id=49189287 Points: 4 # Comments: 1
Terminal-Bench Leaderboard Rankings: Luck or Skill?
Terminal-Bench 2.0, one of the best agent benchmarks, runs agents on 89 tasks with at least 5 tries per task. The aggregate rankings are then published…
Nvidia's Vera Whitepaper Has a Thread Loose
Article URL: https://chipsandcheese.com/p/nvidias-vera-whitepaper-has-a-thread Comments URL: https://news.ycombinator.com/item?id=49189234 Points: 11 # Comments: 0
Nikita Bier Steps Down as Head of Product at X
Article URL: https://twitter.com/nikitabier/status/2085105586966827343/ Comments URL: https://news.ycombinator.com/item?id=49189113 Points: 13 # Comments: 3
Prime Agent: A self-improving RLM agent
Article URL: https://www.primeintellect.ai/blog/prime-agent Comments URL: https://news.ycombinator.com/item?id=49189075 Points: 13 # Comments: 0
OpenAI says my prepaid credits were consumed, refuses to show any record
Article URL: https://community.openai.com/t/how-openai-lost-a-paying-customer-over-160-it-refuses-to-explain/1389233 Comments URL: https://news.ycombinator.com/item?id=49188980 Points: 11 # Comments: 1
Deepseek V4 Flash just hit Colibri, does anyone have numbers?
I'm mosty interested in 128-192GB VRAM with 128-256GB RAM to spare, so SSD streaming is basically not even necessary. Seems only FP4 is supported, so older…
An argument of Parfit's reconsidered with logical decision theory
A logical decision theory recommends that you choose as if deciding the output of your decision algorithm. The main difficulty in formulating a logical decision theory…
you can now buy llm’s at your local supermarket
submitted by /u/ECrispy [link] [comments]
Xiaomi-Robotics-1: New robotics model released
Xiaomi-Robotics-1 is a robot foundation model trained on over 100K hours of real-world manipulation trajectories. It is a Vision-Language-Action (VLA) model engineered for out-of-the-box mobile manipulation…
40% speedup of MoE training with faster megakernel, by cursor, of all people (for B200s)
daily reminder not to trust benchmarks and run it yourself. claimed e2e speedup is ~40%, forwards are ~140% faster I would wager that compared to a…
bootai
I was on here a while ago showcasing it. I've stoped playing with it so I'm open sourcing it. I figure I'll let other people play…
I built a chess transformer interp+viz library, and need an experienced software writer to review my repository and its structure before I open-source it
Please message me if you think you can help or want to set up an agreement.Discuss
R-lens: Making J-lens More Faithful on Early Layers
TL;DR:We introduce the R-lens: a drop-in replacement for J-lens that produces clearer readouts on earlier layers. We fit the R-lens on Jacobians computed through an LRP-modified…
I'm switching my phone from Android to Linux
Article URL: https://runarcn.no/android-to-linux/ Comments URL: https://news.ycombinator.com/item?id=49188022 Points: 11 # Comments: 4
Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery
Article URL: https://www.wired.com/story/meta-ran-ads-that-contained-ai-generated-child-sexual-abuse-imagery/ Comments URL: https://news.ycombinator.com/item?id=49187977 Points: 16 # Comments: 0
Do LLMs make ML research more fair for small teams? [D]
It feels like LLMs are partially leveling the playing field in ML research. A solo researcher or a two-person team can now get help with coding,…
Muse Code and Muse Spark 1.2
Article URL: https://research.meta.ai/blog/introducing-muse-code-and-muse-spark-1-2 Comments URL: https://news.ycombinator.com/item?id=49187575 Points: 24 # Comments: 11
An International AI Slowdown Is Ready Whenever Politicians Are
Linkpost for a piece we recently published for AI Frontiers in the wake of recent calls for slowdown, covering how an international verification effort be trivially…
Arguments for P
Daniel Kokotajlo: To be clear, we don’t claim P will happen specifically. But when we wrote out our best-guess scenario month by month, P kept happening.…
Sula: A Gemini protocol server written in Scryer Prolog
Article URL: https://sagredo.dev/projects/sula/ Comments URL: https://news.ycombinator.com/item?id=49187259 Points: 7 # Comments: 0