Description
At Instacart, we're transforming the grocery industry by delivering an essential service that customers rely on to get their groceries and household goods. As a Senior Software Engineer II in the Ads Quality team specializing in ML infrastructure, you'll work with a team of software and machine learning engineers to build state-of-the-art systems that optimize Ads performance throughout the ads serving funnel.
You'll own the technical direction of our data, feature processing and model training/serving solutions, enabling next-generation modelling opportunities. You'll eliminate bottlenecks across the training and serving system to optimize stability, latency and cost.
Responsibilities:
- Design, develop, and deploy machine learning infrastructure to tackle practical challenges in our complex marketplace while advancing the training and serving platform.
- Work with the company-wide ML Foundation team to develop solutions to meet Ads unique needs.
- Optimize training and serving funnel bottlenecks,profiling real systems and driving meaningful wins in throughput, cost, and latency.
- Identify instabilities and shortcomings of our systems and operating procedures to deliver best-in-class availability.
- Build real-time feature processing infrastructure,low-latency pipelines that compute, join, and serve fresh features to models on the critical path of every ad request.
- Lead the infrastructure foundation for our real-time sequential foundation model, including online sequence feature stores, streaming update paths, efficient long-context serving, and training pipelines that keep pace with rapidly evolving data.
- Collaborate closely with product managers, data scientists, and MLEs to deeply understand business needs and co-design systems where product, model architecture and infrastructure constraints are solved together.
- Actively engage with diverse stakeholders to ensure that solutions are well-integrated and aligned with business goals.
- Mentor engineers, set technical direction, and conduct thorough code reviews to ensure high code quality and maintainability.
Requirements:
- Graduate degree (masters or PhD) in computer science, artificial intelligence, machine learning, operations research or equivalent self-study and experience.
- 3+ years of industry experience building ML infrastructure or using machine learning to solve real-world problems with large datasets.
- Deep expertise building, scaling and managing ML infrastructure for training and/or serving in production, with a strong understanding of modern machine learning systems and MLOps.
- Strong programming skills in software engineering (e.g., Python, Go), along with expertise in data manipulation using tools (SQL, Spark, and Pandas), and ML frameworks (Torch, Tensorflow, XGBoost).
- Strong analytical and problem-solving skills.
- Excellent communication skills (both verbal and written) and can collaborate with a diverse group of stakeholders across all levels.
Benefits:
- Highly market-competitive compensation
- New hire equity grant
- Annual refresh grants
- Flexible remote work policy