Description
We are seeking a Senior AI Applied Engineer to join our team. As a Senior AI Applied Engineer, you will design, build, deploy, and operate production AI systems used at scale within one of the largest health insurers in the United States.
Responsibilities:
- Design, develop, and deploy full-stack AI-powered applications, including frontend experiences, APIs, backend services, and data pipelines.
- Build and optimize LLM-based workflows for information extraction, classification, retrieval, summarization, and agentic processes.
- Develop robust prompt strategies, structured output frameworks, tool-calling capabilities, and fallback mechanisms to improve reliability.
- Design and implement retrieval-augmented generation (RAG) systems using embeddings, vector databases, and semantic search technologies.
- Build evaluation frameworks, including benchmark datasets, regression testing, quality metrics, and human review workflows.
- Develop human-in-the-loop processes that enable clinicians and domain experts to validate AI outputs and provide feedback for continuous improvement.
- Build and maintain document-processing pipelines, including OCR, document ingestion, metadata extraction, indexing, and search capabilities.
- Optimize AI systems for accuracy, latency, reliability, scalability, and cost efficiency.
- Implement observability, monitoring, logging, alerting, and incident response processes for production systems.
- Deploy and operate services in cloud-native environments using Kubernetes, Docker, CI/CD pipelines, and modern infrastructure tooling.
- Collaborate with product, engineering, clinical, and operational stakeholders to translate complex business requirements into scalable solutions.
- Ensure solutions meet privacy, security, compliance, and auditability requirements within a regulated healthcare environment.
Requirements:
- Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or another quantitative or related technical discipline, or an equivalent combination of education and practical experience.
- 5+ years of experience building and operating production software systems.
- Experience developing backend services, APIs, distributed systems, or data-intensive applications.
- Hands-on experience integrating LLMs into production applications beyond simple chat interfaces, including structured outputs, tool calling, retrieval-augmented generation (RAG), agents, or multi-step workflows.
- Experience with at least one major AI platform or model provider such as OpenAI, Anthropic, Google, Azure AI, or AWS Bedrock.
- Strong programming skills in Python and/or TypeScript/JavaScript.
- Experience debugging, monitoring, and supporting production applications used by real customers.
- Ability to work independently, navigate ambiguity, and take ownership of projects from concept through deployment.
Preferred Qualifications:
- Experience building AI systems where LLMs are part of the critical production workflow.
- Experience designing evaluation frameworks, testing strategies, prompt versioning, tracing, and model performance monitoring.
- Experience with agentic architecture, Model Context Protocol (MCP), tool orchestration frameworks, or autonomous workflows.
- Experience with React, Next.js, modern frontend development, and full-stack application architecture.
- Experience deploying and operating workloads in Kubernetes, Docker, and cloud environments.
- Experience with modern CI/CD practices and infrastructure automation.
- Experience working in regulated industries such as healthcare, financial services, or government.
- Familiarity with privacy, compliance, governance, and data protection requirements.
- Experience using AI-assisted development tools to improve engineering productivity and software quality.
- Strong problem-solving, communication, and collaboration skills.
Benefits:
- Medical, dental, and vision benefits
- 401(k) retirement savings plan
- Time off (including paid time off, company and personal holidays, paid parental and caregiver leave)
- Short-term and long-term disability
- Life insurance
Salary: $141,100 - $194,000 per year