01
Open a request
Share a reproducible FlashInfer Trace definition and explain why the kernel matters.
Agentic CUDA kernel program
Community wants,
KDA provides!
Need a CUDA kernel for your training/inference but cannot find the experts to implement?
Submit your definitions and workloads to KDA-wishlist, and KDA will automatically optimize it w/ agentic workflows!
Open process. Public results. Built for real workloads.
REQUEST ACCEPTING
01
YOU PROVIDEFlashInfer Trace
Definition · Workloads · Target
research · generate · verify
02
WE RUNKernel Design Agents
Explore and benchmark candidates
select strongest candidate
03
YOU GETValidated kernel
Code · Benchmarks · Reproduction
CUDA kernels are foundational to the modern LLM ecosystem, but building high-performance implementations requires deep expertise.
KDA Wishlist is an experimental program where the KDA team uses agentic workflows to build the kernels the community needs.
HOW IT WORKS
From definitions
to implementations
Kernel Design Agents (KDA) are agentic CUDA systems that research, implement, verify, and iterate on performance-sensitive kernel tasks. Each request gives them a measurable contract—not just an idea.
Explore the KDA tech reportPUBLIC REQUEST LIFECYCLEGITHUB-MANAGED
02
Community votes
Others add a thumbs-up reaction to the GitHub issue and contribute useful workload context.
03
KDA thinks and builds
Accepted tasks enter a measured loop of analysis, generation, correctness checks, and profiling.
04
Results return
We publish the strongest validated kernel with benchmarks, reproduction steps, and known limits.
SELECTED ACHIEVEMENTS
Built by agents.
Merged upstream.
KDA has already turned optimization targets into production contributions across LLM serving, image generation, and video workloads.
01 / FLASHINFER CONTEST SOTA
1.39×peak vs. human SOTA
KDA-0.5 surpassed human SOTA
MLSys’26 FlashInfer Kernel Contest · B300 · MoE 2.25× · DSA 29.95× · GDN 6.10×
02 / SOLEXEC 1ST PLACE
#1SOLExec L1
KDA boosts Databricks to rank #1 on SOL-Bench
L1 Single Operation track · score 0.7608 · previous best 0.7584
03 / FLASHINFER CONTEST TOP 3
TOP3all contest tracks
KDA-0.1 achieves TOP3 on every track
MLSys’26 FlashInfer Contest · B300 · MoE 0.67× · DSA 11.91× · GDN 1.16×
04 / FLASH-KMEANS OPEN SOURCE
6.1×balanced k-means
Flash-KMeans
KDA speedup for the Wan 2.2 workload on B200
05 / SGLANG MERGED
2.03×weighted B200 kernel group
Cosmos3 causal Conv3D cat-pad
10.621 → 5.240 ms weighted; model E2E +2.11%
06 / SGLANG MERGED
5.84×kernel geomean
LTX-2.3 QKNorm + split-RoPE
B200 · 4.22–7.34× across 14 production shapes; E2E −9.16%
Results vary by hardware, model, and workload. See each linked pull request or repository for validation and reproduction details.
KDAPROVEN IN COMPETITION
The workflow behind KDA earned 1st, 2nd, and 3rd place across the three fully agent-driven tracks in the MLSys 2026 FlashInfer contest.Review the released workflow and results
GOOD TO KNOW
Before you
request a kernel
How do upvotes work?
Open the public wishlist, find a request you care about, and add a thumbs-up reaction to the top-level GitHub issue. Comments are best used for new workload evidence or implementation context.
Will my request and results be public?
Yes—unless we agree otherwise in advance. For accepted requests, KDA may publish the submitted definitions, generated implementations, benchmarks, profiling data, and design notes. We credit submitters for their definitions and workloads. If your business requires private kernels, email Ligeng Zhu at ligengz@nvidia.com to discuss a collaboration.
How many kernels will KDA deliver?
KDA typically delivers one to three of the most-requested kernels each week, depending on the team’s development workload. Sihao Liu and Ligeng Zhu currently cover the GPU and model-token costs personally, so capacity is limited. If you have a larger operator roadmap, email Ligeng Zhu at ligengz@nvidia.com to discuss establishing an official collaboration with NVIDIA.
Why might a request be returned or declined?
Requests may need revision when they cannot be reproduced, lack a reliable correctness reference, target unsupported hardware, are too vague for automated evaluation, or have unclear licensing.
YOUR BOTTLENECK, NEXT
What should
KDA build?
Bring the definition and real workloads. We’ll bring the research loop.
Submit a kernel request Or browse the wishlist and upvote