Arandu v0.6.5 available
Repository: https://github.com/fredconex/Arandu Hello Guys, This is Arandu a open source app to easily launch models using llama.cpp, it tries to integrate all in one place with…
Latest
model: add openPangu-2.0-Flash (92B-A6B) with MLA-latent cache, DSA/SWA, mHC, and multi-head MTP by joelfarthing · Pull Request #2065 · ikawrakow/ik_llama.cpp
openPangu-2.0-Flash - 92B A6B & 512K Context Length Model : https://huggingface.co/openpangu/openPangu-2.0-Flash/blob/main/README_EN.md GGUF for ik_llama folks : https://huggingface.co/ji-farthing/openPangu-2.0-Flash-ik-llama-GGUF submitted by /u/pmttyji [link] [comments]
Kimi K3 ranks #1 on @AfterQuery’s SpreadsheetBench 2, surpassing Claude Fable 5
submitted by /u/Charuru [link] [comments]
promptchain: a Python library + MCP server for swapping local LLMs on a single GPU
a few weeks ago i posted about promptchain a streamlit app that handles model loading and unloading for various backend and after seeing some feedback i…
[Model] catmind-1.2b
Everyone loves cats, even LLMs. If you are like me and can't resist the urge of petting a cat that approaches you, you will LOVE catmind.…
Consumer grade server build – AMD Ryzen 9 vs Intel Ultra 7 prompt processing speed
My AM4 server's motherboard's PCIe lanes got damaged, and I want to replace the platform because I don't want to invest in DDR4 ram. I have…
why minimax M3 branch not merged to main?
I was trying to load Minimax M3 using the `llama.cpp` main branch and realized that one needs to get an M3 branch. Is there any good…
"Basalt Labs" pulling a generationally dumb scam. Incredibly stupid lmao. Claiming 99.44% on HLE with tools. Model they released is based on Qwen2.5-7B-Instruct and the model they’re serving on their website is DeepSeek.
submitted by /u/WithoutReason1729 [link] [comments]
If you’re building a harness, here is a simple tool to catch cache invalidation in your calls to LLMs
https://preview.redd.it/o6c5enqx3zdh1.png?width=1371&format=png&auto=webp&s=20f75d4cefa5f51f40c000db8f9bd7114758b354 Hello, I know we're a lot of harness builders out there, because it's fun and because it makes us learn a lot. I've been focusing…
Is it safe to say kimi k3 can beat the opus 4.7 and gpt 5.4 ? (In agentic task and frontend and backend coding.) (All at max mode)
Well opus 4.8 and gpt 5.5 was released recently so i think its better to take the older model. In the case, if it cannot beat…