Description
Summary
Microsoft AI are looking for a talented Member of Technical Staff, Software Co-Design AI HPC Systems at their Mountain View office. This role sits at the boundary between exploration and production, working closely with internal infrastructure, hardware, compiler, and product teams, as well as external partners across the hardware and systems ecosystem.
About the Role
Our team's mission is to architect, co-design, and productionize next-generation AI systems at datacenter scale. We operate at the intersection of models, systems software, networking, storage, and AI hardware, optimizing end-to-end performance, efficiency, reliability, and cost. Our work spans today's frontier AI workloads and directly shapes the next generation of accelerators, system architectures, and large-scale AI platforms. We pursue this mission through deep hardware–software co-design, combining rigorous systems thinking with hands-on engineering.
Accountabilities
- Lead the co-design of AI systems across hardware and software boundaries, spanning accelerators, interconnects, memory systems, storage, runtimes, and distributed training/inference frameworks.
- Drive architectural decisions by analyzing real workloads, identifying bottlenecks across compute, communication, and data movement, and translating findings into actionable system and hardware requirements.
The Candidate we're looking for
Experience:
- 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
Technical skills:
- Proficiency in C, C++, and/or Python.
Personal attributes:
- Strong problem-solving skills, with the ability to analyze complex systems and identify areas for improvement.
Benefits
- Starting January 26, 2026, MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location.
- Comprehensive health and wellbeing benefits.
- Professional development opportunities.
- Financial benefits (bonus, equity, pension, etc.).