# Senior System Software Engineer - AI Data Platform - Inference Factory Optimization

**Company**: NVIDIA
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/Vietnam-Hanoi/Senior-System-Software-Engineer---AI-Data-Platform---Inference-Factory-Optimization_JR2021063-1?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_e19c22e6-a68

## Description

Our team is building the foundational infrastructure that powers NVIDIA's cutting-edge innovations in AI and high-performance computing.

We are seeking a Senior Software Engineer to design, build, and optimize highly scalable and reliable automation systems that ensure the peak performance and seamless deployment of our core software offerings across a diverse ecosystem.

This is an opportunity to directly impact how AI models and complex applications are validated, tuned, and delivered globally, from cloud environments to on-premises data centers and specialized hardware.

### Responsibilities

- Develop efficient infrastructure and tools for automating complex software processes.

- Drive Performance Optimization: Implement advanced test harnesses, benchmarking frameworks, and analytical tools to rigorously characterize and optimize the performance and efficiency of our software and hardware platforms.

- Apply deep knowledge of operating systems, kernel internals, device drivers, memory management, storage, networking, and high-speed interconnects to build and troubleshoot highly performant systems.

- Work with engineering teams to understand needs, define requirements, and deliver efficient solutions.

- Set performance goals, monitor feedback, analyze data, and make continuous improvements for system reliability.

- Influence Technical Strategy: Contribute to defining technical strategies and roadmaps for our platform automation initiatives, ensuring alignment with company-wide goals and standard methodologies.

### Requirements

- Bachelor's or equivalent experience in Computer Science, Computer Engineering, or a related technical field, or Master's degree or equivalent experience in a similar field.

- 5+ years of industry experience in software development, focusing on infrastructure, distributed systems, automation, and/or performance engineering.

- Expertise in System-Level Programming: Proven ability to develop robust tools and automation using programming languages such as C++, Python, or Go.

- Deep Understanding of System Software: Experience with operating system internals, device drivers, memory management, and debugging performance issues in complex compute applications.

- Distributed Systems: Experience in designing, building, and operating large-scale distributed systems, with knowledge of networking protocols, cluster management, and high-performance interconnects.

- Automation and CI/CD Proficiency: Experience building and maintaining automated testing, benchmarking, and continuous integration/continuous deployment pipelines.

- Problem-Solving and Analytical Skills: Outstanding analytical, problem-solving, and debugging skills, with a track record of resolving complex technical challenges.

- Collaboration and Communication: Excellent interpersonal and communication skills, with the ability to articulate complex technical concepts to diverse audiences and collaborate effectively across teams.

### Nice to Have

- Experience optimizing performance for AI/Machine Learning workloads, especially inference applications, on diverse hardware platforms.

- Prior experience building or contributing to large-scale compute infrastructure solutions in cloud environments or on-premises data centers.

- Experience with containerization and orchestration technologies, such as Docker and Kubernetes.

- Familiarity with performance profiling tools and methodologies for hardware and software systems.

- Track record of driving significant efficiency gains or architectural improvements in large-scale systems.

NVIDIA offers highly competitive salaries and a comprehensive benefits package.

## Skills

### Required
- C++
- Python
- Go
- System-Level Programming
- Distributed Systems
- Automation
- Performance Engineering
- Operating System Internals
- Device Drivers
- Memory Management
- Networking Protocols
- Cluster Management
- High-Performance Interconnects

### Nice to have
- AI/Machine Learning
- Inference Applications
- Cloud Environments
- On-Premises Data Centers
- Containerization
- Orchestration Technologies
- Docker
- Kubernetes
- Performance Profiling Tools

---

Source: [Apply at nvidia.wd5.myworkdayjobs.com](https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/Vietnam-Hanoi/Senior-System-Software-Engineer---AI-Data-Platform---Inference-Factory-Optimization_JR2021063-1?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)