# Senior Engineer - Factory Infrastructure and Automation for NVIDIA Inference Microservices (NIMs)

**Company**: NVIDIA
**Location**: Santa Clara, CA
**Work arrangement**: remote
**Experience**: senior
**Job type**: full-time
**Salary**: 184,000 USD – 287,500 USD
**Category**: Engineering
**Industry**: Technology

**Apply**: https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Senior-Software-Engineer--Distributed-Systems---NIM-Factory_JR2028628?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_fed5d748-442

## Description

NVIDIA is seeking a senior engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices (NIMs).

The right person for this role brings technical drive and creativity to change the way NVIDIA optimizes and serves performant inferencing for every AI model in heterogeneous cluster environments.

Our NIM offerings are easy to use, highly performant, and tested in all deployment scenarios, in the cloud, on customer's self-hosted infrastructure, and locally on all NVIDIA GPUs.

You will apply your deep technical expertise to design an efficient, scalable, and reliable automation factory infrastructure that will take AI models to become NIMs that are validated for best-in-class performance and accuracy.

**Responsibilities**

- Develop a factory pipeline that will take an AI model in and produce a deployable service that is validated across Cloud, On-prem, and Kubernetes environments.

- Define and deliver rapid iterations on the group's technical strategies and roadmaps to deliver and improve the NIM factory.

- Design interfaces, data modeling, and schema design, and expand observability over the factory pipeline and its compute infrastructure.

- Work with technical leaders designing and developing scalable and reliable factory components.

- Collaborate with multiple AI model teams to understand their requirements to build an efficient infrastructure that improves every team's productivity.

- Define metrics and drive improvements based on user feedback.

**Requirements**

- A history of using advanced programming skills to build distributed and compute systems, backend services, microservices, and cloud technologies.

- Effective experience working with multi-functional teams, principals, and architects, across organizational boundaries.

- Mentorship, growing teams and team members, and the flexibility to adjust your direction and expectations given the needs of our customers.

- Deep technical expertise in distributed containerized applications using technologies such as Docker, K8s, Cloud Endpoints, Helm, and Prometheus.

- Passion for building rich, microservice applications, build, and test automation pipeline.

- Excellent interpersonal skills and the ability to lead multi-functional efforts.

- Proven experience debugging and analyzing the performance of distributed microservices or cloud systems.

- BS or MS in Computer Science, Computer Engineering, or related field (or equivalent experience).

- 8+ years of shown experience developing performant microservice, cloud software, and/or tooling roles.

**Nice to Have**

- Experience delivering event-driven applications using various services such as Temporal, Kafka, Redis, or others.

- A history of building and deploying containers for Microservices, Cloud, and On-prem deployments, and their associated CI/CD pipelines.

- Prior experience in working with large-scale full-stack development.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 184,000 USD – 287,500 USD. You will also be eligible for equity and benefits.

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- Docker
- K8s
- Cloud Endpoints
- Helm
- Prometheus
- distributed systems
- microservices
- cloud technologies

### Nice to have
- Temporal
- Kafka
- Redis
- event-driven applications
- CI/CD pipelines

---

Source: [Apply at nvidia.wd5.myworkdayjobs.com](https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Senior-Software-Engineer--Distributed-Systems---NIM-Factory_JR2028628?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)