JobPosting
title: Sr. Engineering Manager, Inference
description: CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. As a Senior Engineering Manager for the AI/ML Platform team, you will lead the group responsible for productizing and operating our inference offering. In partnership with CoreWeave AI platform team, you will ensure the service becomes a polished, reliable, developer-friendly product within the AI/ML Platform. Responsibilities Lead and grow the engineering team responsible for evolving and operating the W&B Inference product, focusing on service reliability, orchestration, operational maturity, and developer experience. Drive execution on roadmap initiatives in close partnership with Product, ensuring that platform capabilities are delivered predictably, robustly, and with measurable customer impact. Own the engineering processes for the inference productization layer, including incident response, operational readiness, release management, observability, and engineering quality. Partner with CoreWeave’s infrastructure teams to integrate capabilities from the underlying inference platform into a cohesive, user-facing product. Guide the design and delivery of application-layer enhancements such as tracing and tool calls handling. Ensure the inference offering meets high standards of reliability, usability, compliance, and performance, balancing trade-offs across cost, operational load, and architectural constraints. Create clarity in complex, cross-functional environments, ensuring strong communication, aligned priorities, and smooth execution across multiple teams. Build a culture of ownership, technical excellence, and continuous improvement within the engineering team. Who You Are: 7+ years of experience in software engineering, including 3+ years managing or leading engineering teams responsible for distributed systems, developer platforms, or large-scale services. Flue…
date posted: 2026-07-31T16:24:33.658Z
valid through: 2026-09-29T16:24:33.658Z
direct apply: false
occupational category: Engineering
industry: Technology
skills: distributed systems
skills: developer platforms
skills: large-scale services
skills: observability
skills: autoscaling patterns
skills: reliability engineering
skills: API design
skills: service operations
skills: high-scale systems
skills: real-time APIs
skills: cloud infrastructure
skills: model-serving
skills: inference-adjacent domains
skills: IAM
skills: billing/metering
skills: observability systems
skills: deployment tooling
hiring organization: CoreWeave
job location type: TELECOMMUTE
applicant location requirements: US
employment type: FULL_TIME
base salary: MonetaryAmount
  currency: USD
  value: QuantitativeValue
    min value: 188000
    max value: 303000
    unit text: YEAR