Description
We are seeking a Senior Software Engineer to join our NeMo Platform team, which is responsible for developing, evaluating, deploying, and operating AI systems at scale. As a senior engineer/architect, you will work on our Core team to own and ship an open-source, plugin-based AI platform for running and optimizing Agents targeting multiple compute backends.
The NeMo Platform group is building a sophisticated agent execution framework to enable agents to automatically run hundreds of experiments in parallel to find the most efficient agent architectures for our customers. This is important product engineering research for making agents more sustainable.
Responsibilities:
- Work in a product research environment where we place big bets on where the future is heading, adapting in real-time as we build alongside an industry that is constantly evolving with us.
- Design an Agentic Execution system that is flexible enough to work in many environments (local, k8s, Slurm, on-prem/air-gapped).
- Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of ambiguous cross-component problems.
- Build and maintain our Core Platform APIs for running jobs, storing data, entities, secrets, and RBAC and Auth.
- Extend our flexible Plugin Architecture that makes it easy for many teams and external customers to install new capabilities into our system.
- Build in the open in our OSS repo, keeping up the high standards that the open-source community demands.
- Ship code at the speed of light with an unlimited token budget using best-in-class agentic coding tools.
- Improve reliability, observability, debuggability, and performance across NeMo Platform, SDKs, plugins, jobs, and developer workflows.
- Build strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows.
Requirements:
- BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field.
- 10+ years of professional software engineering experience building production systems.
- Comfort working in a very fast and ambiguous environment.
- Exceptional communication, both verbal and written.
- Strong system design skills, with a pragmatic flexibility and phenomenal instincts to invent robust systems quickly without over-complicating.
- Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration.
- Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design.
- Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces.
- Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries.
Nice to Have:
- Experience building, deploying, and iterating on production agentic AI systems at scale in Kubernetes.
- Experience with sophisticated plugin architectures.
- Strong ability to connect technical evaluation work to business outcomes, product quality, user experience, reliability, or operational efficiency.
- Experience with enterprise AI systems where measurement, regression testing, observability, governance, and continuous improvement are required for production deployment.
You will also be eligible for equity and benefits.