Description
We are seeking a Senior ETL Data Engineer to build and maintain the systems that collect, store, process, and analyse data. As a Senior ETL Data Engineer at Barclays, you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence.
Key Responsibilities:
- Build and maintain data architectures, pipelines, data warehouses, and data lakes to ensure accurate, accessible, and secure data.
- Design and implement data warehouses and data lakes that manage data volumes and velocity, adhering to security measures.
- Develop processing and analysis algorithms for complex data.
- Collaborate with data scientists to build and deploy machine learning models.
Analyst Expectations:
- Perform tasks in a timely and high-quality manner, driving continuous improvement.
- Demonstrate in-depth technical knowledge and experience in assigned area of expertise.
- Lead and supervise a team, guiding professional development, allocating work, and coordinating resources.
- Demonstrate leadership behaviours: Listen and be authentic, Energise and inspire, Align across the enterprise, Develop others.
Requirements:
- Practical Ab Initio experience (GDE graphs, plans, psets, EME object/version management, environment migration, object comparison/diff).
- Proficiency in Linux/Unix and Shell scripting.
- Experience in Python and PySpark, with strong knowledge of Dataframes, RDD, and SparkSQL.
- Experience in SQL (DML, DDL, DCL).
- Experience working with Oracle RDBMS and MongoDB NoSQL database.
- Exposure to cloud services like AWS.
Nice to Have:
- Ability to engage with stakeholders, elicit requirements/user stories, and translate them into ETL components.
- Understanding of infrastructure setup and ability to provide solutions.
- Knowledge of Data Marts and Data Warehousing concepts.
- Good analytical and interpersonal skills.