Description
Some careers have more impact than others. If you're looking for a career where you can make a real impression, join HSBC and discover how valued you'll be.
We are currently seeking an experienced professional to join our team in the role of Senior Consultant Specialist.
In this role, you will design and develop ETL processes using various tools such as batch/streaming tools, Control-M, Datastage, Shell Scripting, and Python for cloud migration projects. You will collaborate with stakeholders to gather requirements and ensure that ETL solutions meet business needs.
Key responsibilities include:
- Design and implementation of ETL processes
- Collaboration with stakeholders to gather requirements
- Data pipeline optimization for performance, scalability, and reliability
- Integration of data from diverse sources
- Management and maintenance of data storage solutions in GCP
- Development of Apache Beam based Dataflow Jobs for data extraction, transformation, and analysis
- Implementation of automation for ETL workflows using tools like Apache Airflow or Cloud Composer
- Setting up monitoring and alerting mechanisms to ensure the health of data pipelines and compliance with SLAs
Requirements include:
- Bachelor's degree in Computer Science, Information Systems, or a related field
- Minimum of 10 years of industry experience in data engineering or ETL development
- Strong knowledge of GCP services and their application in data engineering
- Experience of cloud-based solutions, especially in GCP
- Experience and knowledge of Bigdata data processing in batch mode and streaming mode
- Familiarity with Java & Python for data manipulation on Cloud/Bigdata platform
You'll achieve more when you join HSBC. HSBC is an equal opportunity employer committed to building a culture where all employees are valued, respected and opinions count.