ParallelKernelBench: Frontier LLMs Still Struggling with Fast Multi-GPU Kernels23. June 20264. July 2026AI Models, OpenAIFrontier LLMs solve fewer than one-third of 87 multi-GPU CUDA benchmark tasks, though some generated kernels still outperform public reference implementations. Share on: