Description
About Mistral AI
Mistral AI is a pioneering company shaping the future of AI. We believe in the power of AI to simplify tasks, save time, and enhance learning and creativity.
Role Summary
The Data Infrastructure team at Mistral AI is architecting the backbone of our frontier model training and fine-tuning ecosystem. We are building the specialized compute and data fabrics required to power the development of world-class AI.
In this role, you will be a core contributor to our evolution, helping us design and scale massive compute fleets and storage systems designed for high performance and scalability. You will help us move toward a future of decoupled control and data planes, scaling big data compute and storage platforms while ensuring secure and governed data access for MLOps and research.
Responsibilities
- Build & Scale: Help us reach our goal of operating massive distributed compute and storage systems
- Global Orchestration: Architect and maintain multi-cluster orchestration layers to optimize workload placement across diverse hardware and regions.
- Design Future-Proof Storage: Architect our transition to modern storage formats to handle fine-tuning datasets at a scale that anticipates exabyte growth.
- Platform Engineering: Contribute to the development of our internal training platform, ensuring seamless model training and fine-tuning capabilities across Kubernetes and SLURM based environments.
- Metadata & Lineage: Implement and manage systems to provide clear visibility and lineage as our data and model pipelines grow in complexity.
- Operational Excellence: Use modern deployment workflows to manage cloud-native deployments, ensuring our data platform can scale by orders of magnitude while remaining reliable and efficient.
You might thrive in this role if you:
- Have 4+ years of experience in Data Infrastructure, MLOps, or Infrastructure Engineering.
- Have experience or a strong interest in supporting foundational compute and storage platforms.
- Are proficient in Python and enjoy solving the "brittle data lake" problem with modern, columnar storage standards.
- Are well-versed in Kubernetes-native tooling and excited to debug large-scale distributed systems across multi-cluster environments.
- Take pride in building and operating scalable, reliable, and secure systems from the ground up.
- Are comfortable with ambiguity and the challenges of building high-scale infrastructure in a rapid-growth AI environment.
Benefits
France
- Competitive cash salary and equity
- Food: Daily lunch vouchers
- Sport: Monthly contribution to a Gympass subscription
- Transportation: Monthly contribution to a mobility pass
- Health: Full health insurance for you and your family
- Parental: Generous parental leave policy
UK
- Competitive cash salary and equity
- Insurance
- Transportation: Reimburse office parking charges, or £90 per month for public transport
- Sport: £90 per month reimbursement for gym membership
- Meal voucher: £200 monthly allowance for meals
- Pension plan: SmartPension (percentages are 5% Employee & 3% Employer)