Frontier Agent Engineering Manager, Enterprise

As a Forward Deployed AI Engineering Manager on our Enterprise team, you'll be the technical bridge between Scale AI's cutting-edge AI capabilities and our most strategic customers.

You'll work with enterprise clients to understand their unique challenges, lead a team that architects specific AI solutions, and ensure successful deployment and adoption of AI systems in production environments.

Key Responsibilities

Customer Integration & Deployment

• Partner directly with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements
• Design and implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
• Build robust data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows
• Deploy and configure AI models and agents within customer security and compliance boundaries

AI Agent Development

• Develop production-grade AI agents tailored to customer use cases across domains like customer support, data analysis, content generation, and workflow automation
• Architect multi-agent systems that orchestrate between different models, tools, and data sources
• Implement evaluation frameworks to measure agent performance and iterate toward business objectives
• Design human-in-the-loop workflows and feedback mechanisms for continuous agent improvement

Prompt Engineering & Optimization

• Create sophisticated prompt engineering strategies optimized for customer-specific domains and data
• Build and maintain prompt libraries, templates, and best practices for customer use cases
• Conduct systematic prompt experimentation and A/B testing to improve model outputs
• Implement RAG (Retrieval Augmented Generation) systems and fine-tuning pipelines where appropriate

Leadership & Collaboration

• Serve as the Engineering Manager and technical point of contact for strategic enterprise accounts
• Lead a team that is collaborating with customer data scientists, ML engineers, and software developers to ensure smooth integration
• Work closely with Scale's product and engineering teams to translate customer needs into product improvements
• Document technical architectures, integration patterns, and best practices

Problem Solving & Innovation

• Debug complex technical issues across the entire stack, from data pipelines to model outputs
• Rapidly prototype solutions to unblock customers and prove out new use cases
• Stay current on the latest AI/ML research and tools, bringing innovative approaches to customer problems
• Identify opportunities for productization based on common customer patterns

Required Qualifications

• 5+ years of software engineering experience with 3+ yrs of Management experience with strong fundamentals in data structures, algorithms, and system design
• Production Python expertise with experience in modern ML/AI frameworks (e.g., LangChain, LlamaIndex, HuggingFace, OpenAI API)
• Experience with cloud platforms (AWS, GCP, or Azure) and modern data infrastructure
• Strong problem-solving skills with the ability to navigate ambiguous requirements and rapidly iterate toward solutions
• Excellent communication skills with the ability to explain complex technical concepts to both technical and non-technical audiences

Preferred Qualifications

• Deep understanding of LLMs including prompting techniques, embeddings, and RAG architectures
• Experience building and deploying AI agents or autonomous systems in production
• Knowledge of vector databases and semantic search systems
• Contributions to open-source AI/ML projects
• Experience with containerization (Docker, Kubernetes) and CI/CD pipelines
• Experience using Terraform, Bicep, or other Infrastructure as Code (IaC) tools
• Previous work in a devops, platform, or infra role
• Proven ability to work with customers in a technical consulting, solutions engineering, or product engineering role
• Domain expertise in verticals like finance, healthcare, government, or manufacturing
• Experience with technical enablement or teaching programs

Compensation The base salary range for this full-time position in New York is: $227,000-$325,000 USD

Benefits

• Comprehensive health, dental and vision coverage
• Retirement benefits
• A learning and development stipend
• Generous PTO
• Additional benefits such as a commuter stipend