They fit! Mostly…. 2x 3090, Thermaltake Core p3
Got another 3090 had to print a bracket to angle the radiator and make room for the GPUs 💀 ended up liking the look more than…
Latest
Making LLMs Better at Creative Writing using Entropy
submitted by /u/CountBayesie [link] [comments]
I added MTP to local SoTA Agentic Coding Model Ornith 35B FP8 E4M3
Just wanted to share that I was looking for an optimal way to run Ornith 35B in FP8 with E4M3 and MTP with vLLM but there…
I extended Gemma4-31B to 44B (88 layers) — since Google won’t give us anything bigger than 31B
I've been just sit on this thread for a while now, both as a reader and occasional poster, so I figured it was finally time to…
Senior SWE Bench: a new benchmark focussed on realistically underspecified feature tasks
submitted by /u/jordo45 [link] [comments]
My reasons to run local models
I can finetune any model on any dataset I want. I can use techniques like speculative decoding and other sota approaches to get the max tps…
End of an Agony. Real production service that uses LLM to earn money my team had made and now we are so happy that it will die. Here are some of my final "experiences".
Hello everyone. I had posted in this sub about making a production service about 8 months ago. Here the link of my previous post . The…
ZCode: New Agentic Code Editor from the Makers of GLM
submitted by /u/johnnyApplePRNG [link] [comments]
I pulled the actual search numbers for AI coding tools
Was curious how the AI coding tools actually stack up on mindshare, so I pulled global monthly search volume. The spread surprised me: Claude Code: ~2.06M/mo…
Anyone using TensTorrent gpus for your local ai? What’s been your experience?
I'm always keeping an eye on competitive hardware and was looking at tenstorrent cards, particularly the p150a which while its memory bandwidth is only 512GB/s, it…