Skip to content
Updated How AI-exposed are the skills employers are hiring for? See the data →

From the employer's careers site First seen 19 Nov 2026

Staff Engineer - Machine Learning

Freshworks San Mateo, CA Hybrid staff full-time

Salary

$211,000 - $261,000 per year

Apply on Freshworks

Description

Software should help a business move as one. But too often, disconnected systems, scattered data, and fragmented workflows get in the way. Freshworks is building a better way: AI-powered, unified service operations that turn complexity into coordinated action.

Our platform brings together people, AI, data, and workflows so IT and service teams can anticipate what matters, act faster, and keep the business moving forward together. Organizations including Bridgestone, McLaren, New Balance, S&P Global, and Sony Music trust Freshworks to power the services their employees and customers depend on every day.

We are seeking a Machine Learning Staff Engineer to lead the development of core backend services powering our Agentic AI Platform. In this role, you will be the primary technical driver for building reasoning-driven agents, multi-agent orchestration, and outcome-based workflows. You will collaborate with the Principal AI Architect to bridge the gap between high-level design and scalable implementation.

Key Responsibilities

  • Platform Backend Development:
  • Lead implementation of agent runtime orchestration services, focusing on reasoning, planning, and tool invocation
  • Own the development of robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows
  • Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents
  • Implement multi-agent communication protocols and shared context systems
  • System Architecture & Execution:
  • Execute the transition to cloud-native, event-driven backend services using microservices or service mesh architectures
  • Build and manage task scheduling and long-running operations using tools like Temporal or Airflow
  • Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring
  • Integrations & Data Services:
  • Implement and maintain RAG pipelines and integrations with vector databases
  • Ensure all backend services support LangSmith-based evaluation and comprehensive observability
  • Security & Reliability:
  • Implement RBAC, API authentication, and multi-tenant isolation logic
  • Set the standard for automated testing and implement OpenTelemetry for full system visibility
  • Provide technical guidance and code reviews for more junior backend engineers on the team

QUALIFICATIONS

  • Required Qualifications:
  • 6+ years of backend engineering experience
  • 1-2+ years of hands-on experience in AI/ML platform development
  • Expert proficiency in Java and Python
  • Hands-on experience with LangChain, LangGraph, or LangSmith
  • Deep understanding of event-driven architectures, microservices, and Kubernetes
  • Solid experience with AWS, Terraform, and a mix of relational and Vector databases
  • Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka
  • Preferred Qualifications:
  • Experience with AI-driven planning systems or dialog state tracking
  • Background in enterprise security
  • Experience working in a high-growth SaaS or startup environment
  • Active contributions to open-source backend or AI frameworks

Additional Information

This is a hybrid role with onsite expectations of 3x/week from our San Mateo, CA headquarters. The annual base salary range for this position is $211,000 - $261,000.

For more fresh new jobs, check out yubhub.co.

Skills

Nice to have

  • AI-driven planning systems
  • Dialog state tracking
  • Enterprise security
  • SaaS
  • Startup environment
  • Open-source backend or AI frameworks

Ready to apply?

You apply with the employer directly. Their original posting is here: https://jobs.smartrecruiters.com/Freshworks/744000162318227-staff-engineer-machine-learning

Apply on Freshworks