# Software Engineer (L3) Data Substrate

**Company**: Twilio
**Location**: Remote - US
**Work arrangement**: remote
**Experience**: senior
**Job type**: full-time
**Salary**: $138,700 - $173,400
**Category**: Engineering
**Industry**: Technology

**Apply**: https://job-boards.greenhouse.io/twilio/jobs/7954715?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_e9025143-7e9

## Description

We are looking for a talented and experienced Software Engineer to join our Data Platform team. In this role, you will play a crucial part in designing, building, and optimizing our platform to support a wide range of data-driven initiatives.

You will work closely with cross-functional teams to understand business requirements, architect scalable solutions, and implement data solutions and infrastructure for our Data Platform. The ideal candidate will have a passion for leveraging data to drive business impact, strong technical skills, and experience with modern data technologies.

Responsibilities:

- Design, build, and maintain infrastructure and scalable frameworks to support data ingestion, processing, and analysis.

- Collaborate with stakeholders, analysts, and product teams to understand business requirements and translate them into technical solutions.

- Architect and implement data solutions using modern data technologies such as Kafka, Spark, Hive, Hudi, Presto, Airflow, and cloud-based services like AWS Lakeformation, Glue and Athena.

- Design and implement frameworks and solutions for performance, reliability, and cost-efficiency.

- Ensure data quality, integrity, and security throughout the data lifecycle.

- Stay current with emerging technologies and best practices in big data technologies

- Mentor early in career engineers and contribute to a culture of continuous learning and improvement

Qualifications:

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 5+ years of experience in software development or a related field.

- Strong proficiency in programming languages such as Python, Java, or Scala.

- Strong experience with building frameworks for big data technologies such as Spark, Kafka, Hive, and distributed computing systems.

- Experience with AWS technologies at scale

- Solid understanding of software engineering principles, including object-oriented and functional programming paradigms, design patterns, and code quality practices.

- Excellent problem-solving and analytical skills.

- Strong verbal & written communication skills, with the ability to work effectively in a cross-functional team environment.

Desired:

- Bias to action, ability to iterate and ship rapidly

- Passion to build data products, prior projects in this area

## Skills

### Required
- Python
- Java
- Scala
- Kafka
- Spark
- Hive
- Hudi
- Presto
- Airflow
- AWS Lakeformation
- Glue
- Athena

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/twilio/jobs/7954715?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)