Description
We are seeking a Cloud Data Engineer to spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence.
The purpose of this role is to build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses, and data lakes to ensure that all data is accurate, accessible, and secure.
Responsibilities
- Build and maintain data architectures, pipelines that enable the transfer and processing of durable, complete, and consistent data.
- Design and implement data warehouses and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
- Develop processing and analysis algorithms fit for the intended data complexity and volumes.
- Collaborate with data scientists to build and deploy machine learning models.
Requirements
- Experience with container platforms, including OpenShift and Kubernetes environments.
- Knowledge of AWS, including Databricks, S3, EC2, Lambda, RDS, Glue, Athena, data pipelines, and step functions.
- Experience with distributed computing architecture and core Hadoop components (HDFS, Spark, Yarn, HIVE, Impala).
- Expertise in SQL, advanced SQL skills, shell scripting, and programming (Python).
What We Offer
- Competitive salary.
- Opportunity to work with cutting-edge technology.
- Collaborative and dynamic work environment.
About Us At Barclays, we empower, challenge, and drive. We are guided by our values of Respect, Integrity, Service, Excellence, and Stewardship.