Senior Data Engineer

We are seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and implementing data integration solutions to ingest, transform, and integrate structured and unstructured data from various sources into a scalable data architecture platform.

Job Responsibilities:

• Design and implement data integration solutions to ingest, transform, and integrate structured and unstructured data from various sources into a scalable data architecture platform
• Develop, construct, and maintain large-scale data processing systems that collect data from variety of structured and unstructured data sources
• Store data in a scale-out data lake and prepare the data techniques in preparation for the data science data exploration and analytic modeling
• Ingest, transform, and blend/integrate structured and unstructured data and deliver the data to a MDM, data warehouse, and/or data lake
• Include both technical processes and business logic to transform data from disparate sources into cohesive meaningful data with quality, governance, and compliance considerations
• Use technical and business processes to combine data from disparate sources into meaningful and valuable information
• Design, build, and manage the information and big data infrastructure that helps analyze and process data that the organization requires and optimize systems to perform smoothly
• Prepare the data for the data scientist's exploration and discovery process
• Evaluate, compare, and improve the different approaches including design patterns innovation, data lifecycle design, data ontology alignment, annotated datasets, and elastic search approach

Job Requirements:

• University degree in Computer Science, Engineering, and/or a technically oriented field
• Over 5 years of experience with Flink/Spark, Databricks
• Over 5 years of experience with Azure (DP200 and/or DP201, DP203 certification acts as a plus)
• 3+ years' experience mining data as a data analyst
• 3+ years' using programming languages such as Java, DAX, MDX, SQL, Python
• 3+ years of experience with PowerBI, Tableau, or Qlik
• 3+ years' experience in the life insurance domain is required
• Passionate about analytics, machine learning technology, and applications, and eager to learn
• English communication

Knowledge and Skill:

• Good knowledge of Big Data technologies, such as Spark, Hadoop/MapReduce
• Good knowledge of Azure services like Storage Account, Azure DataBricks, etc.
• Good knowledge of SQL and excellent coding skills
• Strong knowledge of data modeling and data mining
• Self-Development, communication, problem-Solving Skills
• Open-minded, multi-tasking, teamwork, flexible, and interest to learn new things