Technical Product Manager

We're hiring a Technical Product Manager to define and execute Alluxio's AI systems strategy , spanning inference, training, and emerging agentic workloads. This role bridges the worlds of AI infrastructure and distributed data systems, guiding how Alluxio evolves to serve next-generation model architectures and large-scale data flows.

Responsibilities

• Define the long-term vision and roadmap for Alluxio's AI data platform, covering inference, training, and agentic workloads.
• Collaborate with engineering to design features that deliver high-throughput, low-latency data access (e.g., GPU-aware caching, streaming reads, tiered prefetching).
• Ensure seamless integration with frameworks like PyTorch, TensorFlow, Ray, and Triton; evolve Alluxio's APIs for AI-native workloads.
• Engage directly with enterprise AI teams to understand workload patterns, validate impact, and prioritize roadmap direction.
• Stay ahead of trends in multi-model serving, retrieval-augmented generation (RAG), and agentic orchestration; translate them into actionable product plans.

Requirements

• 5–9 years of experience in product management or technical leadership within AI infrastructure, ML platforms, or distributed systems.
• Strong understanding of AI/ML workflows , from model training and deployment to inference and data-access pipelines.
• Proven track record of delivering infrastructure features that improve latency, GPU utilization, or total cost of ownership.
• Technical fluency with distributed systems, caching, and cloud orchestration (Kubernetes, AWS/GCP/Azure).
• Familiarity with AI frameworks such as PyTorch, TensorFlow, Triton, Ray, or LangChain.
• Exceptional communication and strategic thinking , ability to translate complex systems work into clear, prioritized roadmaps.

Benefits

• Shape how the world's most advanced AI systems access and process data.
• Work at the intersection of distributed systems, AI acceleration, and open source.
• Collaborate with world-class engineers, researchers, and customers driving the AI frontier.
• Competitive compensation and equity package with comprehensive benefits.
• A culture built on curiosity, empathy, and deep technical rigor.