Description
We are currently seeking an experienced professional to join our team in the role of Consultant Specialist. As a Consultant Specialist, you will be part of a pod of Data Engineers that supports multiple GCP development projects. You will collaborate with GCP delivery teams to challenge and refine solution designs, ensuring at all times that DevOps best practice is followed.
Key responsibilities include:
- Playing a pivotal role in the delivery of a large-scale IT project, including requirements, design, development, testing, data, and infrastructure, preferably delivered following an Agile approach.
- Translating business requirements into solid, robust technical designs that can withstand scrutiny by various teams involved in governance processes around live deployments.
- Designing solutions that are readily maintainable, easy to extend, and allow for future requirements to be easily implemented, minimising technical debt where possible.
- Implementing a large cloud implementation/migration project, all the way through to go-live.
- Utilising strong working knowledge of cloud architecture solutions that maximise the use of PaaS offerings.
- Understanding the concept of immutable infrastructure and ideally having experience on at least one project.
- Understanding 'infrastructure-as-code' and 'configuration-as-code', and ability to differentiate toolsets/platforms used to implement each one.
- Developing data pipelines/APIs using Python, SQL, potentially BigQuery, Cloud SQL Bigtable etc.
- Building large-scale batch and real-time data pipelines with data processing frameworks in GCP cloud platform.
- Using Terraform to design reusable code and write custom Terraform modules.
- Writing Jenkins pipelines, developing jobs that can be reused across delivery teams.
- Managing cloud infrastructure environments, including admin, users, IAM & service accounts.
- Working in a test-driven development (TDD) approach.
- Understanding the concepts behind effective secrets management, ideally having implemented it on at least one project.
Requirements:
- Automation toolset (Terraform)
- Continuous Integration/delivery servers - Jenkins (Pipeline as Code)
- DevOps principles (CICD, designing & implementing infrastructure/configuration-as-code)
- Knowledge of cloud architecture & services (preferably GCP)
- Security (IAM, roles, service accounts, entitlements)
- SQL experience (SQL/NoSQL scripting, ETL)
- Big Data (Hadoop)
- Atlassian toolset (Bamboo, Bitbucket, JIRA, Confluence)
- GitHub
- Data (databases, management, transformation, metadata)
- Bash/shell scripting and Python development
HSBC is an equal opportunity employer committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and, opportunities to grow within an inclusive and diverse environment.
For more fresh new jobs, check out yubhub.co.