Senior System Software Engineer

NVIDIA is seeking a Sr. Systems Software Engineer for the Apache Spark Acceleration group. The successful candidate will enable C++ native execution of Spark operations on CUDA, develop CUDA/C++ libraries to accelerate DataFrames and I/O operations, and collaborate with distributed systems teams.

Responsibilities:

• Enable C++ native execution of Spark operations on CUDA
• Develop CUDA/C++ libraries to accelerate DataFrames and I/O operations on common file formats such as Parquet, ORC and JSON
• Collaborate with distributed systems teams to craft solutions to distributed processing problems at large scale
• Work with open source communities to enhance libraries like RAPIDS, CCCL and UCX through technical discussion and code contributions
• Provide recommendations and feedback to teams regarding decisions surrounding topics such as infrastructure, continuous integration and testing strategy
• Build, test and optimize across different platforms

Requirements:

• 9+ years of experience in software development
• 5+ years hands-on experience with data platform development
• BS/MS/PhD in computer science or a related field (or equivalent experience)
• Proficiency in C++, Java, Scala
• Experience supporting enterprise customers
• Familiarity with the open source data platform ecosystem is a plus (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, etc.)
• Experience using AI tools in software development