Senior Software Engineer - GPU Kernel Authoring & Optimization

CoreWeave is seeking a Senior Software Engineer to join its Benchmarking & Performance team, focusing on kernel authoring and optimization. The successful candidate will be responsible for writing, profiling, and tuning GPU kernels to maximize throughput and minimize latency. They will also contribute to achieving industry-leading end-to-end performance benchmarking publications.

Responsibilities

• Author, profile, and optimize CUDA kernels for large-scale model serving
• Optimize kernels for hardware, exploiting tensor cores and tuning occupancy, memory coalescing, and shared-memory/register usage
• Use kernel-authoring DSLs and compilers to prototype and ship kernels quickly without sacrificing performance
• Benchmark rigorously, building reproducible microbenchmarks and roofline analyses to validate kernel-level wins
• Implement and maintain benchmarking workflows for end-to-end MLPerf Inference and Training runs
• Lead design reviews and drive architecture within the team
• Mentor junior engineers and review cross-team designs

Requirements

• 5+ years of experience in high-performance computing, GPU/accelerator software, or performance-critical systems
• Hands-on CUDA experience, with a deep understanding of GPU architecture and performance
• Strong coding skills in C++ and Python
• Familiarity with model-serving stacks and kernels that dominate their inference cost
• Strong communication and collaboration skills

Preferred Skills

• Triton or Mojo for authoring custom GPU kernels
• CuTe DSL for Python-based kernel authoring on NVIDIA GPUs
• JAX and its Pallas kernel language for authoring kernels on GPU/TPU
• HIP / ROCm and AMD GPU experience
• Experience with Kubernetes at production scale
• Experience running MLPerf submissions or similar large-scale audited benchmarks

Benefits

• Competitive salary ($182,000 to $242,000)
• Comprehensive benefits program, including medical, dental, and vision insurance
• Flexible PTO and catered lunch in office and data center locations
• Opportunities for professional growth and development

Culture

• Collaborative and innovative work environment
• Emphasis on curiosity, ownership, empowerment, and client satisfaction
• Flexible work arrangements and supportive team