Senior Systems Software Engineer

NVIDIA is seeking a Senior Systems Software Engineer for the Apache Spark Acceleration group. The role involves designing, building, and operating a hosted Spark service control plane on Kubernetes, extending the cuDF Spark runtime and CPU/GPU workload router, investigating production failures, and providing recommendations to teams.

Responsibilities:

• Design, build, and operate hosted Spark service control plane on Kubernetes: Java REST API, Spark Connect runner, Kyuubi, and deployment using Helm charts and Flux
• Own code review for one or more services end-to-end and keep them releasable on the release train
• Extend the cuDF Spark runtime and CPU/GPU workload router in Scala and Java, including interoperability with Delta Lake, Apache Iceberg, and Unity Catalog
• Investigate production failures on clusters running over a thousand concurrent jobs with the customer team and upstream library teams, and drive fixes to closure
• Instrument metrics, dashboards, and alerts; participate in on-call rotation and keep runbooks current
• Provide recommendations and feedback to teams regarding decisions on infrastructure, continuous integration, and testing strategy

Requirements:

• BS, MS, or PhD in Computer Science, Computer Engineering, or a closely related field (or equivalent experience)
• 9+ years of experience in software development
• Strong distributed-systems fundamentals and proficiency in Java or Scala, plus C++ or Python
• Hands-on experience operating services on Kubernetes, on-premise or cloud
• Experience owning or reviewing a long-lived server: REST front ends, proxies, or request routers, JDBC or Thrift services
• Experience supporting enterprise or internal production customers, including on-call
• Experience using AI tools in software development

Preferred qualifications:

• Apache Spark internals, Spark Connect, or Kyuubi
• Delta Lake, Apache Iceberg, or Unity Catalog integration work
• GPU data processing with cuDF, or CUDA experience
• Significant contributions to data platform projects committed to collaboration and shared development (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion)

The base salary range is $184,000 - $287,500 USD. You will also be eligible for equity and benefits.