Principal Systems Software Engineer

NVIDIA is seeking a Principal Systems Software Engineer for the Apache Spark Acceleration group. This role involves developing software to accelerate Apache Spark applications on GPUs without requiring code changes. The ideal candidate will have strong programming skills, a deep understanding of software development, and experience working with open-source libraries like cuDF.

Responsibilities:

• Develop Java, Scala, and CUDA/C++ libraries to accelerate DataFrames and I/O operations on common file formats such as Parquet, ORC, and JSON.
• Enable interoperability with table formats like Apache Iceberg and Delta Lake, and metastores such as Unity Catalog.
• Collaborate with open-source communities to enhance libraries like NVIDIA cuDF, CCCL, and UCX through technical discussions and code contributions.
• Work with distributed systems teams to solve large-scale distributed processing challenges.
• Provide recommendations and feedback on infrastructure, continuous integration, and testing strategies.
• Build, test, and optimize CUDA/C++ libraries across different platforms.

Requirements:

• BS, MS, or PhD in Computer Science, Computer Engineering, or a related field (or equivalent experience).
• 15+ years of software development experience.
• Outstanding technical skills in designing and implementing high-quality distributed systems.
• Excellent programming skills in C++, Java, and/or Scala.
• Ability to work with teams across organizational boundaries and geographies.
• Familiarity with the open-source data platform ecosystem (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, etc.).
• Highly motivated with strong interpersonal skills.
• Database query optimization is a strong plus.

Benefits:

• Equity
• Comprehensive benefits package