r/LocalLLaMA
· Communities
Eider: an inference runtime for the DGX Spark
So ... I've made this little inference and serving runtime for NVIDIA DGX Spark (GB10, Grace Blackwell) and variants thereof. Maybe others will find it curious or interesting. https://github.com/rdaum/eider/ It is built from scratch (in Rust and CUDA) specifically to take advantage of the NVFP4 capabilities of the SM12