DavidAU somehow managed to improve Qwen 3.6 27B
I know DavidAU gets a bad rap, and rightfully so. I've tried some of his fine tunes in the past and they have been... Interesting. I…
Communities 7193 stories
Is surveillance risk chilling your online speech?
Given the expansion of the fed/state/local/corporate surveillance net, do you find yourself expressing yourself less freely on the internet than you did five years ago? Comments…
Tri-Net v2: Open-source implementation of our Scientific Reports paper on unified skin lesion and symptom-based monkeypox detection [R]
Hi everyone, We've open-sourced Tri-Net v2, the official implementation accompanying our recently published Scientific Reports (Nature Portfolio) paper: "Tri-Net: Unified Deep Learning for Skin Lesion and…
Has anyone tried running PrismML Bonsai 27B yet?
It can only run the 1_0 quant in LM Studio. Only 3.8GB and runs on low-end hardware. Even a phone! https://prismml.com/news/bonsai-27b https://huggingface.co/prism-ml/Bonsai-27B-gguf 1 upvote submitted by…
My learnings from optimizing training pipeline to go from 36 steps/minute to 47 steps/minute
I got my ML model training pipeline to go from 36 steps/minute to 47 steps/minute by optimizing how they're stored on disk. When training larger ML…
MTP on MoE matters
Hey everyone, Back when MTP came available on llama.cpp, it seemed like the common consensus was that MTP didn't matter much for MoE models. After spending…
The Model Knows Your Project, Not You.
I came across this study on X and tested it myself; the findings align with the results: FSRS is more recognizable than Jarrett Ye among LLMs.…
OpenAI released gpt-oss 350 days ago. Will we ever see another open-weight model from them?
Nearly a year later, we've had safeguard fine-tunes but no general-purpose base model or successor. Will Kimi, Qwen and GLM force their hand? submitted by /u/prescorn…
Motif 3 Beta released
https://huggingface.co/Motif-Technologies/Motif-3-Beta Motif-Technologies is one of the tech company participated South Korea's AI Foundation Model project. Upstage(Solar Series), LG AI Research(EXAONE Series), and SKT(A.X Series) are the…
Flock Credibility Lost as It Repeatedly Lies to City Councils, Police, & Public
Article URL: https://www.aclu.org/news/privacy-technology/tracking-alpr-cameras/flock-safety-credibility-lost-as-it-repeatedly-lies-to-city-councils-police-departments-and-public-across-the-country Comments URL: https://news.ycombinator.com/item?id=48986731 Points: 41 # Comments: 2
Benchmarked every spec-decode method on Qwen3.6-27B across vLLM and SGLang (single RTX PRO 6000 Max-Q)
https://preview.redd.it/wluwwp6s4heh1.png?width=1248&format=png&auto=webp&s=6e95d963645c5a0ef750bf81324a6d4dcbc0389e Spent the last few days measuring speculative decoding on Qwen3.6-27B (dense, NVFP4) on one RTX PRO 6000 Max-Q, comparing vLLM and SGLang across MTP, DFlash,…
Papers for Stable LatentMoE and Gated MLA?
Four technologies used by Kimi K3 to make it SOTA: KimiDeltaAttention (used in Kimi Linear, essentially a more general gated delta net) AttnRes - described in…
nvfp4 kv-cache on 2×5060 ti, vllm
I can't take credit for this, someone else described the approach, and I just copy/pasted it into opencode/GLM 5.2 to get it working. It appears to…
Those in the 1000+ prefill and 100+ decode range on Qwen3.6 35B at Q4, what hardware are you running?
Trying to see what I can scrounge together bare minimum hardware requirements to get up to that rough speed. Right now I'm running an RX6600XT and…
Google has disappeared completely from the top 15
Google hasn't shipped a model recently that is capable of competing with Sol or Fable. The previous models were pretty disappointing and unreliable, it seems the…
Jellyfin founder Andrew leaves team
Article URL: https://forum.jellyfin.org/t-project-leadership-changes Comments URL: https://news.ycombinator.com/item?id=48986091 Points: 42 # Comments: 12
Opaque, Interoperable Passkey Records (and a Go API)
Article URL: https://words.filippo.io/passkey-record/ Comments URL: https://news.ycombinator.com/item?id=48985956 Points: 14 # Comments: 0
Kimi-K3 isn’t quite better than Fable yet, but it’s definitely getting closer.
Kimi-K3’s release, while impressive, is still months behind the closed-source frontier, so all the “it’s over for Anthropic” talk feels overblown. According to Artificial Analysis, though,…
The Case for Physical AI Safety
BackgroundThe AI safety field has spent a decade building tools for systems trained to think and digitally act. The next decade will likely deliver widely deployed…
Frontier AI lab misalignment risk, lessons from trading post-2008
In this post, I propose adapting banking risk management frameworks (specifically capital adequacy requirements like Basel III) to frontier AI labs. By forcing them to hold…
Does routine compression undo LLM unlearning? A short project
I completed this project over 2 weeks as part of a BlueDot Project cohort. It was my first solo project and I learned a lot! Feedback…
The AI Safety Illusion: Why Current Safety Datasets Fool Us on Model Safety
AI models are increasingly trained to be “safe,” meaning they refuse harmful requests. But what does it truly mean for a model to be safe? Today,…
Adderall Tolerance: Much More Than You Wanted To Know
The effectiveness of amphetamine (e.g. Adderall) and methylphenidate (e.g. Ritalin) for the symptoms of ADHD, that is, lack of executive function, has been demonstrated beyond reasonable…
I gave Kimi K3 a shot at auditing my post-quantum crypto project, it found 5 real bugs Fable/Opus 4.8 and GPT-5.6 Sol had all missed
(Slides because why not) I've been building a serverless post-quantum group-encryption protocol for the last few weeks, mostly with Opus 4.8 and Fable, with GPT-5.6 Sol…