Description
We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer. We're seeking an experienced GCP Senior Software Data Engineer to provide technical direction across data engineering and cloud solutions for fraud use cases. The role focuses on shaping end-to-end data solutions on Google Cloud Platform (GCP) that are secure, scalable and cost-effective.
You'll mentor engineers, set reusable engineering patterns and ensure solutions align to platform roadmaps and enterprise architecture. Success means reliable batch and streaming pipelines that perform well, are well monitored and run efficiently at scale.
Responsibilities:
- Build data pipelines across the fraud domain, providing technical direction, mentoring and escalation support and where applicable resource allocation
- Build and optimise batch and streaming pipelines on GCP, guiding implementation of core business logic and reusable engineering patterns
- Establish secure, scalable and cost-effective end-to-end data solutions aligned to platform roadmaps and enterprise architecture
- Optimise performance, reliability and cost across GCP services, embedding engineering best practices
- Establish monitoring and operational practices to strengthen reliability and support effective troubleshooting
- Troubleshoot and resolve production issues using Cloud Monitoring and Logging (formerly Stackdriver)
- Partner with peers and senior stakeholders to share cloud, data and AI insights that inform engineering decisions
Requirements:
- Bring proven hands-on experience building data engineering solutions on Google Cloud Platform (GCP)
- Demonstrate strong working knowledge of GCP data services including Cloud Storage, Pub/Sub, GKE, Cloud SQL, BigQuery, Dataflow, Kafka and Dataproc
- Show experience using serverless patterns with Cloud Functions and/or Cloud Run
- Build and deliver ETL/ELT and data warehousing solutions with strong data modelling capability
- Design and implement pipelines for batch and streaming workloads
- Apply operational practices for monitoring and troubleshooting using Cloud Monitoring and Logging
- Improve platform performance through structured identification and implementation of enhancements
- Building fraud-ready data pipelines