Lead- Data Engineer

Prudential Health India is seeking a Lead-Data Engineer to join their team in Mumbai.

The role involves designing and implementing a cloud-native, microservices-oriented, loosely coupled & open technology platform for health insurance.

Key responsibilities:

• Architect data platform needs and collaborate with stakeholders to understand business requirements
• Design and develop robust data pipelines for batch and streaming data processing
• Implement ETL processes and utilize data engineering technologies such as Parquet format and Iceberg open table format
• Leverage Google Cloud Platform services including Google Cloud Storage, Google Cloud Pub/Sub, and Google Cloud Bigtable
• Ensure data quality and governance throughout its lifecycle

Requirements:

• 12-15 years of experience in data engineering
• Proven hands-on experience with data architecture and engineering for enterprise-grade Datawarehouse/lake/lake-house
• Demonstrated ability to understand technology and architectural strategy & processes
• Deep knowledge of BigQuery, Google Cloud's suite of tools, and data engineering tasks
• Experience with machine learning models and AI solutions on Google Cloud
• Understanding of data governance, security, and compliance measures

Technical Skills:

• Google Cloud Platform
• BigQuery
• Parquet format
• Iceberg open table format
• ETL processes
• Data integration and transformation techniques
• Machine learning models and AI solutions
• Data governance and security measures

Personal Traits:

• Exceptional engineering skills
• High standards of collaboration and teamwork
• Strong communication skills
• Excellent problem analysis skills
• Ability to work independently and handle multiple concurrent initiatives