Description
We are seeking a Senior Data Engineer to join our team at Barclays in Pune. As a Senior Data Engineer, you will be responsible for building and maintaining the systems that collect, store, process, and analyse data.
Responsibilities
- Build and maintain data architectures, pipelines, data warehouses, and data lakes to ensure accurate, accessible, and secure data.
- Design and implement data warehouses and data lakes that manage data volumes and velocity, adhering to required security measures.
- Develop processing and analysis algorithms for complex data.
- Collaborate with data scientists to build and deploy machine learning models.
Vice President Expectations
- Contribute to or set strategy, drive requirements, and make recommendations for change.
- Plan resources, budgets, and policies; manage and maintain policies/processes; deliver continuous improvements.
- Demonstrate leadership and accountability for managing risk and strengthening controls.
- Collaborate with other areas of work to provide business-aligned support.
Requirements
- Experience with AWS cloud services such as S3, Glue, Athena, Lake Formation, CloudFormation.
- Senior-level proficiency in Python for data engineering and automation.
- Experience with Snowflake, ETL frameworks, data transformation, and data quality tools.
Nice to Have
- AWS Data Engineer certification.
- Previous experience in the banking or financial services domain.
- Experience with IAM and Permissions management in AWS cloud.
- Experience with Databricks, Snowflake, Starburst, Iceberg.