U.S. Department of Energy Launches the Genesis Open Models Initiative and, with Arcee, Unveils Genesis-Science-1 — Its First Open-Weight Model for Scientific Research
submitted by /u/johnnyApplePRNG [link] [comments]
Latest
Serving Deepseek v4 Flash 0731 on 2x DGX Spark — 5-7 GB OS headroom, what would you do to lower VRAM usage and increase OS available RAM?
Hey all, I'm serving DSv4Flash 0731 on a cluster of 2x DGX Sparks but am running into constant issues with having almost no RAM (unified memory)…
Qwen 3.6 27B flags/settings in llama.cpp
I run the following on a 5090 and have been okay with its performance, it does most things somewhere 80-100 t/s, though that can slow down…
Why no good external multi gpu solutions?
I guess we are a small market, but I would love a turnkey external dual and quad GPU box with built in pcie5 full 16 lane…
Which model would be best for Delphi development?
Hey all, Are there any Delphi developers in the crowd? If so, which models would you say are best at doing development in Delphi? What are…
DeepSeek V4 Flash 0731 – ARC-AGI Results
submitted by /u/johnnyApplePRNG [link] [comments]
How to even compare quants from various sources?
How do you guys deal with so many variables? So many publishers, each calling their quants "best", and then it's a mess to manage, download the…
Got job as Director of AI and Systems development self-taught
Hey everyone, I just wanted to share my journey here for some motivation. Three years ago, I saw the sudden spike in AI and realized it…
parakeet.wgsl – Fast, accurate ASR in the browser, via raw WebGPU & SIMD WASM
High-performance inference of NVIDIA's Parakeet TDT 0.6B V2 English transcription model, in the browser. Check out the live demo: https://parakeet.narcotic.sh/ A fully custom, dependancy-free implementation with…
llama.cpp PR reports up to 169% faster quantized-KV decode at 118K context on Intel Battlemage from one SYCL kernel switch
A fresh llama.cpp PR (#26689) changes what looks like a tiny SYCL FlashAttention dispatch decision. With a quantized KV cache ("q4_0" / "q8_0"), decode was being…