possible evidence of literal prompt injection by anthropic
submitted by /u/johnnyApplePRNG [link] [comments]
Latest
Is there some KDL chart for MiMo-V2.5 or something regarding the quants quality?
I'm using the model with opencode and the issue is it's looping hard when reasoning. It's not a deranged babbling though, the reasoning is legit large…
Gemma 4 12B – MLX Kernel
I've mentioned this kernel project I was working on in a few posts and figured I would just open the project code for anyone curious: MLX…
I merged fixes for quantized KV cache into my DeepSeek V4 branch
Check it out: https://github.com/fairydreaming/llama.cpp/tree/dsv4 They are PRs #25247, #25303 (mine) and #25202 (from am17an) but I omitted some padding changes from the last one that I…
RTX3060 12GB + Quadro RTX5000 16GB worth it?
Found cheap one RTX5000 16GB is it worth to add to RTX3060? And is it difficult to make them work together in LM Studio? Do I…
Comparing local inference speeds across a few real setups people are running (3090 vs 5090 vs dual 6000)
Pulled together token rates from a few different local rigs people have reported running lately, just to get a sense of what's realistic at each hardware…
Ran a classic(medival europe) fantasy RP/agentic benchmark across 8 local models Qwen3.6-27B held up better than its size suggests
Threw together a benchmark suite (quest completion, scene endings, item/time tracking, character detection, storytelling, drafting) and ran it across 8 models people talk about a lot…
Using local models with Hermes vs Claude code
Today I saw this in StepFun’s blog for their Step 3.7 Flash model. Running the model with CC performed better results vs Hermes. Curious why? submitted…
Qwen3.6 27B on a 5090, 6.4k sample tok/s distribution after tuning MTP/cache settings
Spent a while tuning llama.cpp for Qwen3.6 27B on a 9800X3D / 64GB / 5090 box and wanted to share the real distribution instead of just…
DGX Spark and Overtemps
For anyone who has a DGX-Spark and is having problems during these very hot summer months, you can underclock with: sudo nvidia-smi -lgc 0,900 My temps…