Description
We're building an enterprise platform for AI agents , the shared foundation that lets engineering teams build, deploy, and run agents that are secure, reliable, and cost-effective at scale.
As a Senior Software Engineer on the AI Platform, you will play a crucial role in advancing how the organization builds and operates AI agents , by contributing to the architecture, design, development, and operation of a modern, enterprise-scale agent platform.
Responsibilities:
- Contribute to the design and delivery of the platform, from first design through production operation.
- Write code, review designs and pull requests, and take on hard technical problems.
- Build reusable platform capabilities that other teams can depend on, with clear interfaces, versioning, and documentation.
- Uphold engineering standards for quality, security, observability, and evaluation.
- Improve latency, reliability, and cost for production AI workloads.
- Run what you build: help define SLOs, take part in on-call, and participate in incident reviews.
- Work with technologies like Python, LangGraph/LangChain, FastAPI, MCP, Kafka, PostgreSQL/pgvector, OpenTelemetry, Docker, and Kubernetes.
- Partner with architects, product managers, security, and domain teams to translate business requirements into technical solutions.
- Share knowledge and mentor peers through code reviews, design discussions, and documentation.
Requirements:
- Bachelor's degree +7 or a Masters +4 years of experience in building and running production backend or distributed systems.
- Experience shipping LLM-powered applications or agents to production, and handling failure.
- Experience with Python, and experience designing frameworks, SDKs, or platform APIs that other engineers build on.
- Experience with distributed systems fundamentals: API design, asynchronous and event-driven processing, streaming, caching, rate limiting, and fault tolerance.
Benefits:
- Medical, dental and vision insurance
- 401(k) plan with a Cisco matching contribution
- Paid parental leave
- Short and long-term disability coverage
- Basic life insurance
- Paid time away
- Optional 10 paid days per full calendar year to volunteer
Salary Range: $167,700.00 - $245,200.00
For more fresh new jobs, check out yubhub.co.