Description
As a Principal Engineer on the Twilio Segment Data platform/pipelines team, you'll build and scale systems that process several hundred thousands of data points per second. You'll lead the development of high-scale ingestion and data processing systems, guiding the team in designing, operating, and maintaining complex distributed systems, ensuring reliability, performance, and cost-efficiency while querying petabytes of data for our customer data platform (CDP).
Responsibilities:
- Own and deliver robust, high-scale routing experiences for the Data platform/pipelines team for Twilio Segment.
- Architect and operate always-available, complex distributed systems in cloud environments.
- Guide technical decisions, articulating trade-offs between cost, performance, and reliability.
- Translate complex technical strategies into actionable plans for diverse stakeholders, including Product Managers and Architects.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- Hands-on experience with high-scale messaging/streaming systems and processing engines (several thousand events/sec).
- Excellent abilities in high-level service design -- modeling interfaces and internals in a properly modular, composable, and extensible way.
- Expert programming experience in Go or similar object-oriented languages.
- Demonstrated experience identifying, prototyping, and deploying GenAI/LLM solutions to solve real-world engineering or data processing challenges.
- Technical depth in distributed systems, high-scale ingestion, and cloud-native architecture.
- Excellent communication, problem-solving, and operational excellence skills.
Desired:
- Proficiency with datastores, distributed caching, and container technologies (Docker/Kubernetes).
- Experience with modern CI/CD pipelines and observability tools (Datadog, Grafana, Prometheus).
- Familiarity with AI/ML technologies.
- Experience managing and operating AWS infrastructure.
- Experience working in a geographically distributed team.
Location: This role will be remote, and based in India (only in Karnataka, Tamil Nadu, Maharashtra, Telangana, Delhi).
What We Offer: Working at Twilio offers many benefits, including competitive pay, generous time off, ample parental and wellness leave, healthcare, a retirement savings program, and much more.