Gemma4-26B-A4B & 31B-QAT Uncensored Balanced are out with MTP (35% & 53% speed boost)!
First of all, I'm stoked to announce we are almost at 20 million downloads on HF! (counted only on my own account, no duplicates/quants/finetunes/etc) and almost…
Latest
Anybody used DwarfStar with DeepSeek V4 Flash on 1x DGX Spark yet? What are your thoughts?
Hey fellow localites, Has anybody used DwarfStar with DeepSeek V4 Flash on 1x DGX Spark yet? What are your thoughts? Based on what I read, with…
Colony | A simulation of an LLM within a colony of agents
Heres an educational resource to learn about LLM attention mechanism using very simple analogies with agents. The agents live inside a conway game of life style…
Any chance I could cluster my DGX Spark (128GB unified memory) and my AMD Ryzen AI Max 395 (128GM unified memory) together to run 1 model?
Hey all, So I have a Nvidia DGX Spark and an AMD Strix 395, both have 128GB of unified memory. The Spark has 200Gbit network and…
Got GLM-5.2 + MTP speculative decode running on 4× DGX Spark (GB10) — and the build piece the public recipe is missing
TL;DR: the recipe's image-build mods aren't actually public – I reconstructed them from the public kernels (with Claude) – and you have to build vLLM at…
Gefen is a drop-in replacement for the AdamW optimizer, claims 8x memory reduction in training (GitHub available)
Paper: https://arxiv.org/abs/2606.13894 GitHub: https://github.com/ndvbd/Gefen submitted by /u/indicava [link] [comments]
Do cloud chatbot’s system prompts make them stupider?
When I am talking with Chat GPT or Claude about abstract concepts, I am often surprised by how they seem kind of dumb... like they aren't…
SDXL running locally in the browser on WebGPU, open-source
I needed simple local image generation without the usual setup. No virtual environments, no ComfyUI with a complex graph and installation as an exe. So i…
MINISFORUM DEG1 Oculink eGPU Dock Refurbished – $59
I got one of these refurbished units last year. I have nothing but good things to say about it. It works great. It has heft to…
I reverse engineered Windows Copilot into a free OpenAI compatible API (GPT-4, no API key, no billing)
So Microsoft gives you GPT-4 for free in Copilot. They just don't give you an API for it. So I made one. It logs into your…