Consultant Specialist

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist in Guangzhou, Guangdong, China.

Principal responsibilities:

• Design and develop ETL processes using various batch/streaming tools to extract, transform, and load data from multiple sources into GCP.
• Collaborate with stakeholders to gather requirements and ensure ETL solutions meet business needs.
• Optimize data pipelines for performance, scalability, and reliability.
• Integrate data from diverse sources, including databases, APIs, and flat files.
• Manage and maintain data storage solutions in GCP.
• Write Apache Beam-based Dataflow Jobs for data extraction, transformation, and analysis.
• Implement automation for ETL workflows using tools like Apache Airflow or Cloud Composer.
• Develop and implement strategies to improve reliability and performance of applications and infrastructure.
• Oversee incident response processes and conduct post-mortem analyses.
• Drive automation of operational tasks and processes.
• Establish comprehensive monitoring and alerting systems.
• Maintain clear and comprehensive documentation of systems, processes, and procedures.
• Ensure all systems and processes adhere to security best practices and regulatory requirements.

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience in designing and managing ETL solutions, including data modeling, data warehousing, and SQL development.
• Proven experience in Site Reliability Engineering, DevOps, or a related field.
• Experience with cloud-based solutions, especially in GCP.
• Experience with big data processing in batch mode and streaming mode.
• Familiarity with Java and Python for data manipulation on Cloud/Bigdata platform.
• Excellent problem-solving skills and strong communication skills.

What additional skills will be good to have:

• Experience with CI/CD pipelines and tools.
• GenAI prompt engineering, Infra as code, containerization and orchestration, IAM, compliance awareness, design for scalability, cost optimization, multi-cloud and hybrid strategies.
• Cloud certifications (GCP Professional Data Engineer / Cloud Architect).
• Experience with IT application controls and compliance requirements.