Skip to content
Updated How AI-exposed are the skills employers are hiring for? See the data →

From the employer's careers site First seen 19 Nov 2026

Staff Backend AI Platform Engineer

Freshworks San Mateo, CA Hybrid staff full-time

Salary

$225,000- $278,000 per year

Apply on Freshworks

Description

We're seeking a Staff Backend AI Platform Engineer to lead the development of core backend services powering our Agentic AI Platform. You will drive the technical implementation of reasoning-driven agents, multi-agent orchestration, and outcome-based workflows.

Key Responsibilities

  • Platform Backend Development: Lead the implementation of agent runtime orchestration services, focusing on reasoning, planning, and tool invocation. Develop robust APIs and SDKs for internal and external teams to build and deploy agent workflows. Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents. Implement multi-agent communication protocols and shared context systems.
  • System Architecture & Execution: Lead the transition to cloud-native, event-driven backend services using microservices or service mesh architectures. Build and manage task scheduling and long-running operations using tools like Temporal or Airflow. Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring.
  • Integrations & Data Services: Implement and maintain RAG pipelines and integrations with vector databases. Ensure all backend services support LangSmith-based evaluation and comprehensive observability.
  • Security & Reliability: Implement RBAC, API authentication, and multi-tenant isolation logic. Set the standard for automated testing and implement OpenTelemetry for full system visibility. Provide technical guidance and code reviews for junior backend engineers.

Qualifications

  • 6+ years of backend engineering experience
  • 1-2+ years of hands-on experience in AI/ML platform development
  • Expert proficiency in Java and Python
  • Hands-on experience with LangChain, LangGraph, or LangSmith
  • Deep understanding of event-driven architectures, microservices, and Kubernetes
  • Solid experience with AWS, Terraform, and a mix of relational and Vector databases
  • Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka

For more fresh new jobs, check out yubhub.co.

Skills

Nice to have

  • AI-driven planning systems
  • dialog state tracking
  • enterprise security
  • RBAC
  • SSO
  • OAuth2
  • high-growth SaaS
  • startup environment
  • open-source backend or AI frameworks

Ready to apply?

You apply with the employer directly. Their original posting is here: https://jobs.smartrecruiters.com/Freshworks/744000162321220-staff-backend-ai-platform-engineer

Apply on Freshworks