# AI Engineer 5 (FM Hosting, LLM Inference)

**Company**: Capital One
**Experience**: senior
**Job type**: full-time
**Salary**: $229,900 - $262,400
**Category**: Engineering
**Industry**: Finance

**Apply**: https://capitalone.wd12.myworkdayjobs.com/en-US/Capital_One/job/McLean-VA/AI-Engineer-5--FM-Hosting--LLM-Inference-_R1002071-1?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_29379f02-472

## Description

At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses. The Intelligent Foundations and Experiences (IFX) team builds and deploys proprietary AI solutions that deliver value to millions of customers.

**Responsibilities**

- Partner with cross-functional teams to deliver AI-powered products

- Design, develop, test, deploy, and support AI software components, including foundation model training and large language model inference

- Leverage a broad stack of Open Source and SaaS AI technologies

- Invent and introduce state-of-the-art foundation model optimization techniques

- Contribute to the technical vision and long-term roadmap of foundational AI systems

- Design, implement, and optimize multi-model orchestration pipelines

- Establish and lead cost-performance governance reviews

- Lead team design councils or design review boards

- Mentor Principal and Manager-level AI engineers

**The Ideal Candidate**

- Loves building systems and takes pride in the quality of work

- Passionate about staying abreast of the latest research and applying novel techniques

- Adapts quickly and thrives on bringing clarity to big, undefined problems

- Deeply technical with a strong foundation in engineering and mathematics

- Resilient trailblazer who can forge new paths to achieve business goals

**Basic Qualifications**

- Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience

- Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience

- At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java

**Preferred Qualifications**

- Experience leading development AI systems with tradeoff decisions around cost, latency, throughput, and accuracy

- 7 years of experience deploying scalable and responsible AI solutions on cloud platforms

- Experience designing, developing, delivering, and supporting complex AI systems

- Experience developing AI and ML algorithms or technologies using Python, C++, C#, Java, CUDA, or Golang

**Salary Information**

- Cambridge, MA: $229,900 - $262,400

- McLean, VA: $229,900 - $262,400

- New York, NY: $250,800 - $286,200

- San Jose, CA: $250,800 - $286,200

**Benefits**

- Comprehensive, competitive, and inclusive set of health, financial, and other benefits

## Skills

### Required
- Python
- Go
- Scala
- CUDA
- Java
- AI
- ML

### Nice to have
- LLM Inference
- Similarity Search
- VectorDBs
- Guardrails
- Memory
- PyTorch
- Huggingface
- AWS Ultraclusters

---

Source: [Apply at capitalone.wd12.myworkdayjobs.com](https://capitalone.wd12.myworkdayjobs.com/en-US/Capital_One/job/McLean-VA/AI-Engineer-5--FM-Hosting--LLM-Inference-_R1002071-1?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)