Scale

Infrastructure Software Engineer, Enterprise GenAI

Scale
hybrid senior full-time $179,400-$224,250 USD San Francisco, CA; New York, NY
Apply →

First indexed 18 Apr 2026

Description

We are seeking a strong engineer to join our team and help us build and scale our core infrastructure in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems.

You will implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.

Key responsibilities include:

  • Architecting multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers
  • Implementing custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
  • Collaborating with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs
  • Delivering experiments at a high velocity and level of quality to engage our customers

Requirements include:

  • 4+ years of full-time engineering experience, post-graduation
  • Experience scaling products at hyper growth startups
  • Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies
  • Proficient in Python or Javascript/Typescript, and SQL
  • Experience with Kubernetes
  • Experience with major cloud providers (AWS, Azure, GCP)
  • Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences

Compensation packages at Scale for eligible roles include base salary, equity, and benefits.

This listing is enriched and indexed by YubHub. To apply, use the employer's original posting: https://job-boards.greenhouse.io/scaleai/jobs/4665557005