# Software Engineer - AI Labs

**Company**: Epiq
**Location**: New York, NY
**Experience**: senior
**Job type**: full-time
**Salary**: $180,000 - $285,000 USD annually
**Category**: Engineering
**Industry**: Technology

**Apply**: https://epiqsystems.wd503.myworkdayjobs.com/en-US/Epiq_Careers/job/New-York-NY/Software-Engineer--AI-Agents_R0035438?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/job/software-engineer-ai-labs-0efb08d1-e49/

## Description

You will build the agentic systems at the center of Epiq AI Labs' legal AI platform, including the orchestration runtime used by other teams, the retrieval layer agents reason over, and the evaluation infrastructure used to measure quality.

Responsibilities:

- Design the agentic platform: orchestration of single agents and parallel sub-agents, durable state and memory across long-running jobs, MCP-based tool integration, and trace-level observability.

- Build the safety layer agents run inside: tool registration and permissioning, sandboxing, guardrails and output validation, and defenses against prompt injection from retrieved content.

- Build agent workflows with multi-step reasoning, tool use, human-in-the-loop checkpoints, and recovery from partial failure during long-running execution.

- Evaluate developments in model capabilities, agent-design patterns, and evaluation practices, and translate them into platform architecture.

- Design retrieval-augmented generation systems with hybrid search over legal corpora and citation grounding to specific sources.

- Own and evolve the in-house model services behind classification, extraction, and embeddings , including customer-trained custom models with active learning , and integrate them alongside frontier models.

- Build model-level and end-to-end evaluation datasets, benchmarks, and regression checks for classification, extraction, retrieval, and agent workflows.

- Establish LLMOps practices for running models reliably in production: model routing and fallbacks, latency and cost budgets, prompt and context versioning, caching, and quality and reliability monitoring.

- Use AI coding agents throughout development while owning the outcome , the design, specifications and test plans, code review, and verification of correctness, security, and maintainability , and ship major changes behind automated tests and controlled rollouts, with product and legal-domain validation where appropriate.

- Build scalable backend services and APIs, produce technical design documentation, and partner with product, research, and security stakeholders.

- Participate in the on-call rotation; diagnose and resolve production incidents affecting model and agent services, and turn findings into durable fixes.

Requirements:

- 3+ years of professional software-engineering experience with demonstrated depth in backend, distributed, or AI systems.

- Experience delivering and operating LLM-powered applications in production at scale , beyond prototypes or proofs of concept , including evaluating quality and diagnosing failures.

- Experience building tool-using agent workflows or retrieval-augmented generation systems.

- Strong production-level proficiency in Python.

- Working understanding of the ML lifecycle, including evaluation data, model and dataset versioning, production deployment, and monitoring model quality, with the ability to collaborate with researchers on reliable model updates.

Benefits: The company offers flexibility that's recognized externally, enterprise-wide learning and mobility, and investment in your growth.

Salary: $180,000 - $285,000 USD annually

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- Python
- LLM APIs
- agent frameworks
- Model Context Protocol (MCP)
- Qdrant
- Solr
- PostgreSQL
- RabbitMQ
- Azure
- Kubernetes
- Docker
- Prometheus
- Grafana
- OpenTelemetry

### Nice to have
- Experience training, fine-tuning, or adapting models to domain-specific tasks
- Experience building or contributing to public or domain-specific benchmarks for LLMs or agents
- Experience with large-scale data pipelines or document-processing systems
- Experience with multi-tenant SaaS architectures and data-isolation requirements
- Experience in a startup or scale-up engineering environment
- Experience in legal technology, enterprise workflow, or knowledge-management systems

---

Source: [Apply at epiqsystems.wd503.myworkdayjobs.com](https://epiqsystems.wd503.myworkdayjobs.com/en-US/Epiq_Careers/job/New-York-NY/Software-Engineer--AI-Agents_R0035438?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)