Llama.cpp now has full MCP support!
After a long and grueling effort spearheaded by ngxson, llama.cpp now fully supports MCP for all protocols. Over-the-web HTTP servers were already supported in the client…
Latest
5700, 48GB RAM and a 3090 24Gb. Best OS and framework/model?
Hi everyone, I have a system which I have been using for gaming, R7 5700X, 48GB DDR4, RTX3090 24GB. But I want to use it for…
Help me complete my AI collection
I’m building the ultimate AI tool vault, but every great collection has a few missing pieces. Note: I will react to every comment AI's currently installed:…
4x 3090, 96gb vram what Model to drive Hermes?
3 year lurker, now i finally got my server up and running. dont know which model to choose. llama.cpp or vllm, what makes more sense? mainly…
Qwen3.6 to Gemma4: Performance Triple GPU GTX 1080 Ti & P100s
Benchmarks using single system running triple GPU with 31GB Vram combined. NVIDIA GeForce GTX 1080 Ti 11GB (NVIDIA) NVIDIA P102-100 10GB (NVIDIA) - first instance (distant…
Local agent workspace on a 4GB laptop GPU (RTX 3050 Ti): the tok/s and where a small model struggles once it has to call tools, build artifacts, and RAG
In-chat interactive/previewable artifacts Disclosure: I work on Bike4Mind, a source-available (BUSL-1.1) AI workspace you can self-host with Docker. Nothing to buy to run any of it.…
Old Coder Needs help with New AI Development and wants to get up to speed to understand it all.
Hi Guys, I'm an old coder and DBA that has been in the field for almost 40 years. More and more the jobs I was doing…
Is it worth getting 128GB MacBook Pro? Will it ever be comparable to today’s frontier models for coding?
I am a long time iOS app developer. In the last year I have been using Cursor+Claude/others to assist with app development. I am concerned that…
Deepseek V4 flash – Hy3 or is Qwen3.6 27B still the most solid for agentic/coding?
I understand that the laguna model is either still buggy or potentially benchmaxxed. So I’d like to know for people who really tested, are DS flash…
GLM-5.5 Leak: It Beats Fable 5
submitted by /u/RhubarbSimilar1683 [link] [comments]