Asia Group Functions Lead Data Engineer

Manulife is seeking a skilled and motivated Lead Data Engineer to join their diverse team and play a key role in implementing, optimizing, and maintaining assets that deliver new data capabilities.

The ideal candidate possesses a solid background in data engineering, ETL processes, and data integration, with a passion for understanding data to drive strategic business decisions.

Responsibilities:

• Provide technical guidance and leadership to build a high-performing data engineering team
• Mentor and coach data engineers on the team
• Foster a collaborative and high-performing team culture
• Ensure team members meet project timelines and deliver high-quality solutions
• Stay up-to-date with the latest tools and technologies and identify opportunities to enhance Manulife's data infrastructure
• Partner with other lead data engineers, data analysts, business collaborators, and data scientists to understand data requirements
• Design, develop, and manage data pipelines that facilitate the extraction, transformation, and loading of data from diverse sources
• Collaborate with multi-functional teams to understand and design schemas for data from various source systems
• Continuously improve and optimize ETL processes to enhance data flow efficiency
• Implement data cleansing, enrichment, and transformation processes to ensure high-quality data
• Design testing plans, develop and implement data quality checks, and validation rules
• Collaborate with technical resources to identify and implement improvements to the infrastructure
• Work closely with business leads and data architects to design and implement end-to-end architecture
• Develop and maintain detailed documentation for data pipelines, processes, and configurations
• Monitor data pipeline performance and solve issues to ensure efficient data flow
• Ensure consistency with data privacy and compliance standards throughout the data lifecycle

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a related field
• 10+ years of experience as a Data Engineer
• Experience with Azure Data Factory, Databricks, Python/Pyspark, Java, Scala
• Understanding of Azure infrastructure and security principles
• Experience deploying and integrating Azure Data Services using DevOps tools and principles
• Knowledge of Azure Data Lake Storage and its topology
• Proficient in data mart fact and dimension design concepts, ETL/ELT logic

Preferred Qualifications:

• Experience with LLM and AI tools
• Experience using Unity Catalog
• Experience using Power BI to connect to sources with ADLS
• Solid understanding of data privacy and compliance regulations
• Excellent problem-solving skills and effective communication skills