# GCP, Bigquery, Pyspark/Senior Consultant Specialist

**Company**: GCIO
**Location**: Pune, Telangana
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Finance

**Apply**: https://portal.careers.hsbc.com/careers/job/563774612631500?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/job/gcp-bigquery-pyspark-senior-consultant-specialist-206238d0-6de/

## Description

Ready to build cloud-native ledger data pipelines on Google Cloud?

Join Group Function Tech - Finance IT as a Senior Developer (Global Career Band 5) working on Finance Google Cloud applications that deliver Finance Ledger applications and related services.

You’ll build and support high-performance batch data pipelines and microservices with clear non-functional requirements across resilience, scalability, latency, observability and security.

Responsibilities:

- Build, deploy and support core services using Apache Spark for Finance Ledger applications

- Deliver hands-on engineering with regular production releases using trunk-based development practices

- Design high-performance data pipelines and microservices meeting resilience, scalability, latency, observability and security needs

- Establish engineering excellence across batch pipelines, data modelling, testing strategy and operational readiness while managing technical debt

- Partner with engineers on code reviews, pair debugging, performance tuning and production incident resolution

- Create automation to improve engineering efficiency including scripting, tooling and testing across unit, regression and functional coverage

- Implement cloud and platform engineering on GCP across services such as Dataflow, Pub/Sub, GCS, Composer (Google-managed Apache Airflow), Dataproc, BigQuery and GKE

- Govern operational excellence for production workloads including monitoring, alerting, capacity planning, reliability improvements and cost optimisation while ensuring data quality, lineage and security controls

- Coach and mentor engineers across levels and communicate delivery plans, risks and dependencies with senior stakeholders

Requirements:

- Demonstrate substantial hands-on development experience with cloud technologies and strong proficiency in Apache Spark

- Apply advanced SQL skills including data modelling, cloud storage mechanisms and file formats such as Parquet and Iceberg

- Use trunk-based development practices and deliver frequent releases to production

- Build or improve end-to-end DevOps pipelines for automated testing, regression and deployments

- Apply experience with GCP data and platform services such as Dataflow, Pub/Sub, GCS, Composer (Apache Airflow), Dataproc, BigQuery and GKE

- Design and run production-grade data pipelines with monitoring, alerting, capacity planning and reliability improvements

- Communicate technical plans and milestones clearly to senior stakeholders while managing risks and dependencies

- Apply planning and organisation skills to prioritise competing demands and deliver change in an operational context.

Bring knowledge of Accounting or Ledger concepts

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- Apache Spark
- GCP
- BigQuery
- Pyspark
- SQL
- Dataflow
- Pub/Sub
- GCS
- Composer
- Dataproc
- GKE

---

Source: [Apply at portal.careers.hsbc.com](https://portal.careers.hsbc.com/careers/job/563774612631500?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)