Description
We are seeking a Cloud Data Engineer to join our team in Pune. As a Cloud Data Engineer, you will play a crucial role in designing and building scalable AWS data platforms, analytics capabilities, and reusable data products.
Responsibilities:
- Build and maintain data architectures, pipelines, data warehouses, and data lakes to ensure accurate, accessible, and secure data.
- Design and implement data warehousing and data lakes that manage data volumes and velocity, adhering to security measures.
- Develop processing and analysis algorithms for complex data.
- Collaborate with data scientists to build and deploy machine learning models.
- Perform prescribed activities in a timely manner, driving continuous improvement.
- Lead and supervise a team, guiding professional development, allocating work, and coordinating resources.
Requirements:
- Relevant data engineering experience, including production-grade data pipelines and analytical data platforms.
- Strong SQL skills and understanding of data warehousing, dimensional modelling, data lake concepts, ETL/ELT patterns, and data lifecycle management.
- Hands-on experience with AWS services such as AWS Glue, Step Functions, Lambda, Athena, S3, and EC2.
- Proficiency in Python and/or PySpark for data processing, automation, and integration.
- Experience ingesting data from relational databases, files, APIs, and other enterprise sources into governed cloud data layers.
Nice to Have:
- Experience with Databricks, including Apache Spark, Delta Lake, notebooks, workflows, and Unity Catalog.
- Knowledge of AWS services such as Redshift, EMR, Lake Formation, Kinesis, DynamoDB, CloudWatch, IAM, and CloudFormation.
- Familiarity with data mesh or data-product principles, including ownership, discoverability, interoperability, and service-level expectations.
For more fresh new jobs, check out yubhub.co.