b10003
tokenize : align usage by using common args (#25516) Migrate the tokenize tool to common_params_parse, replacing its hand-rolled argv parsing, Windows UTF-8 handling and file reading…
Infrastructure 949 stories
Nemotron Labs: How Open Models Give Enterprises and Nations AI They Can Trust, Control and Customize
Enterprises have plenty of powerful models to choose from. The real test is whether the AI an enterprise builds uniquely addresses the needs of the business:…
Post-Train NVIDIA Cosmos 3 in One Day Using Agent Skills
What if autonomous coding AI agents could push your vision reasoning models above 90% accuracy with almost no manual effort? When adapting vision reasoning...
How to Run an Autoresearch Workflow with RL Agent Skills and NVIDIA NeMo
Coding AI agents are becoming practical operators for long-running machine learning (ML) workflows. They can inspect repositories, set up runtimes, resolve...
b10002
ggml : add a set of functions for checking contiguity of inner tensor dimensions (#25650) Co-authored-by: Stanisław Szymczyk sszymczy@gmail.com macOS/iOS: macOS Apple Silicon (arm64) macOS Apple…
Why Performance per Watt Is the Ultimate Metric for AI Infrastructure Efficiency
Power is AI infrastructure’s inescapable constraint. How many tokens an AI factory can generate within a fixed power budget determines its revenue and profitability. Because of…
Security reviews now available in the GitHub Copilot app
You can now run a security review on your in-flight code changes directly from the GitHub Copilot app. The /security-review slash command is shipping in public…
b10001
tests: export-graph-ops: exit gracefully when called w/o arguments (#25619) Fixes a segfault when test-export-graph-ops is called without any arguments. macOS/iOS: macOS Apple Silicon (arm64) macOS Apple…
b10000
ggml: uniformize im2col dst_type for all conv ops (#23660) ggml: uniformize im2col dst_type for all conv ops Update ggml/src/ggml.c Co-authored-by: Georgi Gerganov ggerganov@gmail.com ggml : uniformize…
b9999
kleidiai : add SME2 f32 kernel (#24414) kleidiai : add SME2 f32 kernel enable dynamic scheduling for SME2 f32 kernel macOS/iOS: macOS Apple Silicon (arm64) macOS…
b9996
arg: Flush log before exiting after usage() (#25504) Under certain conditions, it's possible for messages emitted via LOG() to get lost before exit, apparently because they…
b9995
sycl: set fattn_vec_nthreads to 256 for Battlemage (#25205) Currently detects lunarlake + battlemage / xe2 and sets the value to 256. Keeps default at 128, Intel's…
b9994
metal : add Q2_0 support (#25419)
b9993
model: add Hy3 (hy_v3) support with MTP speculative decoding (#25395) model: add Hy3 (hy_v3) architecture support Adds Tencent Hunyuan 3 (HF architecture HYV3ForCausalLM, GGUF arch hy_v3):…
b9992
CUDA: refactor MMQ kernel configuration (#24127) CUDA: refactor MMQ kernel configuration fix Blackwell config remove legacy code macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64,…
b9990
spec: add Minimax2 eagle3 support Fix nullptr in minimax2 EAGLE3 minor : add newline Co-authored-by: Georgi Gerganov ggerganov@gmail.com macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon…
b9988
tests: Harmonize header use (#25616) tests: Harmonize the use of private ggml includes tests: In test-backend-ops, use quoted includes As with all other tests. This is…
NVIDIA Ising Decoding Cuts Color Code Logical Error Rates by Over 300X
Useful quantum computers will require fault tolerant logical operations. Researchers are actively exploring many different quantum error correction (QEC) codes...
b9987
gguf : add tensor shape accessor (#24405) gguf : add tensor shape accessors gguf : return tensor shape as const int64_t * gguf : remove n_dims…
Extreme Event Likelihoods with Guided Generative Models
Across science, engineering, and finance, many of the most important risks come from low-likelihood, high-impact events. Estimating the probability of these...
b9986
chat : fix reasoning leak with force-opened bare templates (#24674) chat : fix reasoning leak with force-opened bare templates The reasoning start tag inferred from prior…
b9985
sycl: add fused top-k MoE (#25217) sycl: add fused top-k MoE sycl: address review: GGML_SYCL_ENABLE_FUSION env, move fusion dispatch to topk-moe sycl: print GGML_SYCL_ENABLE_FUSION at startup…
b9984
sycl: add Q2_K to DMMV reorder path (#25064) Signed-off-by: Todd Malsbary todd.malsbary@intel.com macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel…
b9982
server: honour per-request reasoning_budget_tokens in chat completions (#23116) server: honour per-request reasoning_budget_tokens in chat completions The reasoning-budget block in oaicompat_chat_params_parse read only the server-level default (opt.reasoning_budget,…