Description
As a Senior Software Engineer, you will lead the development of a large-scale GenAI Platform at Reddit.
The Machine Learning Platform team at Reddit is a high-impact team that owns the infrastructure that powers recommendations, content discovery, user and content quantification, while directly impacting other teams such as Growth, Ads, Feeds, and Core Machine Learning teams.
Key responsibilities include:
- Contributing to the design, implementation, and maintenance of the LLM Gateway, focusing on features like unified API endpoints for internal/externally hosted LLM, rate/token limit management, and intelligent failover mechanisms to boost uptime and reliability.
- Designing and developing ML and Generative AI systems in cloud-based production environments at scale.
- Building and managing enterprise-grade RAG applications using embeddings, vector search, and retrieval pipelines.
- Implementing and operationalizing agentic AI workflows with tool use using frameworks such as LangChain and LangGraph.
- Driving adoption of MLOps / LLMOps practices, including CI/CD automation, versioning, testing, and lifecycle management.
- Establishing best practices for observability, monitoring, evaluation, and governance of GenAI pipelines in production.
The ideal candidate will have:
- 5+ years of experience in ML Engineering, AI Platform Engineering, or Cloud AI Deployment roles.
- Experience operating orchestration systems such as Kubernetes at scale.
- Deep experience with cloud-based technologies for supporting an ML platform, including tools like AWS, Google Cloud Storage, infrastructure-as-code (Terraform), and more.
- Proficiency with the common programming languages and frameworks of ML, such as Go, Python, etc.
- Excellent communication skills with the ability to articulate technical AI concepts to non-technical stakeholders.
- Strong focus on scalability, reliability, performance, and ease of use.
Benefits include comprehensive healthcare benefits, income replacement programs, 401k with employer match, global benefit programs, family planning support, gender-affirming care, mental health & coaching benefits, flexible vacation & paid volunteer time off, and generous paid parental leave.