USB4 RDMA seems doable
Just found this blog : https://blog.hellas.ai/blog/thunderbolt-ibverbs/ Experimental implementation of RDMA, demonstrated on two Strix Halo Did a quick search and can't really find it posted before…
Latest
Has anyone tried to hack into their own system using a local model?
With all this talk about Mythos being able to hack into. US government systems, I was wondering if anyone has tried to get root on their…
Worse quality with MTP – Qwen 3.6, Gemma 4
Hi. I am self-hosting Qwen 3.6 27B Q8_K_XL with Llama.cpp on 4x5070ti. (All 4 cards are on single x16 slot bifurcated to 4x4 with risers). I've…
GLM 5.2 on Dual Strix Halo (256GB): Worth it?
submitted by /u/Intrepid_Rub_3566 [link] [comments]
Could you help me test MTP for GLM-4.7-Flash?
Some of you may remember old models from GLM: GLM Air or GLM Flash. I know they’re outdated, but I have a soft spot for them,…
If LLMs are so good at coding…
How come things like ROCm and the intel stack aren’t able to rapidly improve their software ecosystems to be a match for CUDA? Until the software…
Anyone running Deepseek v4 Flash with MoE offload?
I saw the DS4 repo and the last time I tried it I was just short of 5-10GB of VRAM to fit the model I wanted…
Anthropic accuses Alibaba of campaign to ‘brazenly’ and ‘illicitly’ extract AI capabilities
https://www.cnbc.com/2026/06/24/anthropic-alibaba-distillation-campaign.html https://www.bloomberg.com/news/articles/2026-06-24/anthropic-accuses-alibaba-of-illicitly-accessing-its-ai-models submitted by /u/External_Mood4719 [link] [comments]
[NEW MODEL] SupraWeather-Nano-Preview Just released!
SupraWeather Nano is live! ⛈️ We just released SupraWeather-Nano (preview), a small FT-Transformer model purpose-built to classify weather phenomena from raw tabular meteorological features. https://huggingface.co/SupraLabs/SupraWeather-Nano-Preview https://huggingface.co/SupraLabs…
Locked Dell quote for 6x RTX PRO 6000 Max-Q at $8,960 — expires tonight. What would you do?
Building an inference cluster to run GLM 5.2 locally. Got a Dell quote locked at $8,959.99/unit for 6x RTX PRO 6000 Blackwell Max-Q (300W). List price…