b10034
opencl: exclude some moe kernels on Adreno a7x (#25698) opencl: exclude Adreno A7x from using Adreno MoE kernels Some compilers for A7x devices miscompile the repack…
Infrastructure 949 stories
b10032
cuda : CUDA GGML_OP_LIGHTNING_INDEXER implementation (generic vector kernel + wmma kernel) (#25545) cuda : CUDA GGML_OP_LIGHTNING_INDEXER implementation (generic vector kernel + wmma kernel) chore : remove…
b10031
tokenize : drop --stdin mutual-exclusion check (#25672) match cli and completion, which don't enforce it macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled)…
Building Faster Cryptography with Carryless Multiplication in NVIDIA CUDA 13.3
For over fifteen years, x86 CPUs have shipped with a dedicated hardware instruction for carryless multiplication. It’s a small but stubborn primitive that...
b10025
cuda : relax tensor contiguity requirements for quantized concat (#25678) cuda : relax tensor contiguity requirements for quantized concat tests : add test cases for non-contiguous…
b10021
DeepseekV4: reduce graph splits (#25702) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU)…
b10020
sycl : fix get_rows Q2_K, Q4_K, Q5_K (#25656) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux:…
b10019
sycl : support kernel type fp16 for conv2d_dw (#25653) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework…
b10018
sycl : implement xielu op (#25550) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64…
b10017
sycl: Increase minimum buffer size for USM system allocations (#25525) Raise the threshold for minimum buffer size from 1 GiB to 4 GiB, based on real-world…
NVIDIA and Japan Bring Full-Stack AI and Robotics to Every Industry
Home to leading manufacturers, robotics pioneers and infrastructure builders, Japan is one of the world’s centers of AI — building across the full stack with NVIDIA…
b10016
[SYCL] Flash Attention with XMX engine via oneDNN (#25222) [SYCL] F16 (default) Flash Attention with XMX engine via oneDNN graph API; Qwen3.6-27b-Q8_0 prefill speed up x1.21…
b10015
opencl: do not use clCreateBufferWithProperties when targeting CL 2.x (#25673) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS…
GitHub Copilot in Visual Studio — June update
June 2026 is about visibility and trust with a clearer view of your GitHub Copilot usage, a new trust layer for MCP servers, and the first…
New in Together GPU Clusters: Reliability and control for production GPU clusters
See how Together AI is improving production GPU clusters with passive health checks, node repair, stronger Slurm reliability, OIDC, and startup scripts.
Together AI brings Thinking Machines Lab’s new model Inkling on day 0
Together AI offers day zero access to Inkling, Thinking Machines Lab's multimodal mixture-of-experts model for text, image, and audio reasoning.
GitHub Copilot for JetBrains expands BYOK capabilities
This update brings major advances in customization and model provider flexibility to all tiers of GitHub Copilot for JetBrains IDEs. With richer plugin and provider experiences,…
b10012
hexagon: fix hmx-queue signal enum-narrowing problem (#25677) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu…
b10011
server : refactor prompt cache state ownership (#25649) server : clear checkpoints upon prompt clear server : move the prompt state data to the server_prompt_cache Assisted-by:…
b10010
server: add --cors-* options (#25655) server: add --cors-* options add special "localhost" value add tests fix test add link to PR macOS/iOS: macOS Apple Silicon (arm64)…
b10007
opencl: fix a dp4a bug for devices where cl_khr_integer_dot_product is unavailable (#25639) opencl: do not fail backend init on devices without cl_khr_integer_dot_product opencl: do not call…
b10005
DeepseekV4: fix seq_rm (#25588) DeepseekV4: fix seq_rm implement proper seq_cp create actual update context macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED…
Lessons From the Leaderboard: What 5,000+ Kagglers Taught Us About Improving AI Reasoning
The NVIDIA Nemotron Model Reasoning Challenge invited the Kaggle community to explore a focused question: What techniques can improve reasoning accuracy when...
b10004
vulkan/cpu: Support f16 as SET_ROWS src. (#25432) vulkan/cpu: Support f16 as SET_ROWS src. This adds full support for f16 SET_ROWS (equivalent to f32) to vulkan and…