Description
We are seeking a Senior Data Engineer to lead the transition of existing data pipelines to a target data platform, leveraging Databricks and AWS services.
Key Responsibilities:
- Partner with the Databricks team to plan and execute pipeline transitions
- Drive implementation of repeatable engineering patterns for ingestion, transformation, testing, deployment, and monitoring
- Ensure pipelines support long-term platform consistency, reliability, observability, and ease of support
- Guide the design and operation of cloud-native data pipelines using AWS services such as S3, Glue, Lambda, Kinesis, and Lake Formation
- Promote secure access to platform resources and data products using IAM, encryption, and environment-level controls
- Support lakehouse technologies and concepts such as Delta Lake, Apache Iceberg, and Databricks Unity Catalog
Requirements:
- 8+ years of experience in data engineering, data platforms, or related domains
- Proven ability to drive technical initiatives and influence engineering outcomes
- Experience with Databricks-based data platforms and AWS cloud-native data engineering
- Strong familiarity with technologies such as Delta Lake, Apache Iceberg, and lakehouse architecture
- Experience with AI tooling and LLM-enabled engineering
Benefits:
- Competitive salary
- Opportunities for growth and development
- Collaborative and dynamic work environment