Description
We are seeking an experienced Staff Engineer to join our Data Substrate team. In this role, you will be responsible for architecting scalable and reliable data solutions, collaborating closely with cross-functional partners driving technical innovation, and mentoring a team of talented engineers.
As a Staff Engineer, you will serve as a subject matter expert in distributed systems, data technologies, with strong software engineering skills. You will architect and implement scalable and efficient data systems, storage solutions, and processing frameworks using state-of-the-art technologies.
Key responsibilities include:
- Serving as a subject matter expert in distributed systems, data technologies, with strong software engineering skills
- Architecting and implementing scalable and efficient data systems, storage solutions, and processing frameworks using state-of-the-art technologies
- Driving technical innovation and research to stay at the forefront of emerging data technologies and best practices
- Mentoring and coaching a team of talented engineers, fostering a culture of technical excellence, collaboration, and continuous learning
- Collaborating closely with cross-functional teams to understand business requirements and translate them into scalable and efficient technical solutions
- Ensuring data quality, integrity, and security throughout the data lifecycle, adhering to industry best practices and compliance standards
Required qualifications include:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 8+ years of experience in software development, or a related field
- Proven track record of architecting and delivering complex data projects at scale, with a deep understanding of data infrastructure and distributed systems
- Expertise in big data technologies such as Hadoop, Spark, Kafka, and other distributed computing systems
- Experience designing, building, and operating large-scale systems using AWS technologies
- Proficiency in programming languages such as Python, Java, or Scala, with strong problem-solving skills and attention to detail
- Experience designing or working with Data Lakehouse architectures, including hands-on experience with Hudi, Iceberg, or Delta data formats
- Excellent communication and collaboration skills, with the ability to influence technical decisions and drive alignment across teams
- Strong leadership skills, with a track record of mentoring and developing junior engineers
- Demonstrated ability to thrive in a fast-paced, dynamic environment and deliver results under tight timelines
Desired qualifications include:
- Contributions to OSS projects
- Familiarity with data modeling, data warehousing, and ETL processes
This role will be remote, and based in the United States. Travel may be required to participate in project or team in-person meetings.