Member of Technical Staff (Software Engineer, Models)

We are seeking a deeply technical software engineer to own and evolve our model serving platform, which connects our products and research systems with our inference layers.

You will work at the intersection of distributed systems, AI products, and infrastructure, making it easier for teams to adopt new models, run experiments, and ship dependable products.

The ideal candidate combines sound technical judgment with active curiosity around frontier models.

Responsibilities

• Design core abstractions and lead high-conviction technical decisions.
• Write production Rust and Python for a service serving hundreds of millions of model requests per day.

Required Qualifications

• 5+ years of experience building and shipping large-scale systems and services with high reliability, availability, and performance.
• Strong software engineering craft with special care for developer experience and designing future-proof systems.
• Proficiency with a general-purpose backend language (Python, Rust, C++, Go) and cloud infrastructure (AWS, Kubernetes).
• BS, MS, or PhD in Computer Science, Engineering, or related fields (or equivalent experience).

Compensation

• $220K – $405K • Offers Equity

Benefits

• Full-time U.S. employees enjoy a comprehensive benefits program including equity, health, dental, vision, retirement, fitness, commuter and dependent care accounts, and more.
• Full-time employees outside the U.S. enjoy a comprehensive benefits program tailored to their region of residence.