Description
TaskUs is seeking an Associate Data Engineer to design, develop, and maintain data pipelines and data warehouses for use by the analytics infrastructure. The successful candidate will assist in making accurate and meaningful data available for consumption of TaskUs Business Intelligence reporting methodology.
Key Responsibilities:
- Configure and set up solutions based on pre-approved patterns to move data from operational and external environments to the business intelligence environment.
- Manage data integration and ETL jobs, including consolidation, aggregation, filtering, validation, data quality routines, dimension creation, etc.
- Design, develop, and verify data models according to business requirements, and continuously optimize the model.
- Collaborate with technical users to define data requirements and establish business rules to be applied.
- Collaborate with key business stakeholders to deliver and continually enhance the BI platform to provide relevant and accurate insights through the delivery of new datasets.
- Validate and verify data models according to business requirements, and continuously optimize the model.
- Perform unit and system integration testing on development projects.
- Monitor error handling and logging tools and processes, troubleshoot configuration and data errors, and identify opportunities to optimize the ETL environment.
Qualifications:
- At least 2 years of experience in Data Engineering.
- Knowledge of Python, Apache Kafka, AWS Redshift, AWS Glue, AWS S3, and Pentaho Data Integration.
- Strong knowledge of Data Warehousing concepts with understanding of traditional and MPP database designs.
- At least 2 years of hands-on development experience using ETL Tools such as Pentaho, SSIS, Informatica, Talend, Fivetran, or Airflow.
- Knowledge of the architecture, design, and implementation of MPP Databases such as Teradata, Snowflake, or Redshift.
- 3 years of development using Cloud-based analytics solutions, preferably AWS or GCP.
- Knowledge of designing and implementing streaming pipelines using Apache Kafka, Apache Spark, or Segment.
- Knowledge of Database Tuning and ETL tuning.
- Experience using Python in a cloud-based environment is preferred.
- Knowledge of NoSQL DBs is preferred.
- Knowledge, experience, and exposure to AI tools is preferred but not required.
Education / Certifications:
- Bachelor's/College Degree in Computer Science/Information Technology, Engineering (Computer/Telecommunication) or 4-8 years of experience in place of a degree.
Work Location / Work Schedule / Travel:
- Site Location: Any TaskUs PH Site (Remote)
- Work Setup: Work from Home
- Work Schedule: 8:00 PM to 5:00 AM PHT (can change depending on business needs)