I tuned a custom Q8 for my AMD R9700s. My benchmark said 12.5% faster.
I have three Radeon AI PRO R9700s. I wanted to know if I could tune a quant for this specific hardware instead of just using the…
Latest
The AMD Instinct MI350P is a HBM PCIe AI Accelerator That Has Been All Over
submitted by /u/Neurrone [link] [comments]
basaltlabsai/monolith-1.0 • HuggingFace
https://preview.redd.it/nmou7prrfwdh1.jpg?width=1920&format=pjpg&auto=webp&s=839bb4d3cf380ef544242c29042d4cbbb6212f10 https://huggingface.co/basaltlabsai/monolith-1.0 demo: https://basaltlabs.org/chat submitted by /u/External_Mood4719 [link] [comments]
Kimi moment. I think the writing is on the wall for Anthropic and OpenAi
New day new model....... can't wait to see in a few weeks how Minimax 3 Pro (2.7T parameters) and GLM 5.3 reinforces the narrative. As a…
internlm/Intern-S2-Preview-397B • HuggingFace
https://preview.redd.it/k0c8uydg6wdh1.png?width=1798&format=png&auto=webp&s=dd97c61d8a881ccba988758cf99750ec4e721c49 https://huggingface.co/internlm/Intern-S2-Preview-397B submitted by /u/External_Mood4719 [link] [comments]
Kimi K3 is currently at the top of the leaderboard for Text Arena filtered for science queries.
submitted by /u/Qwen30bEnjoyer [link] [comments]
How does Kimi k3 feel? Does it match up where it stands on benchmarks?
I've seen the benchmarks, they supposedly right up there with Fable 5 and Sol 5.6. Howerver I'm skeptical of benchmarks and the kimi k3 creators even…
Local LLM project
Is it worth running local models on this old beast? Dell PowerEdge R710 (2009-12 era) Dual Xenon 5500 (I'm pretty sure) 48Gb DDR3-1066 submitted by /u/Motor-Independent572…
Getting LLMs to Quantify their Unknowns
LLM judges are increasingly common among AI teams due their ability to automate decisions that require complex reasoning and analysis. Pairing their reasoning ability with calibrated…
LocalLLaMA reacts to K3: Day 1
submitted by /u/ForsookComparison [link] [comments]