Description
We're seeking a Data Engineer to join our Aviva Services Excellence Centre in Warsaw. You'll play a crucial role in designing, developing, and optimising scalable data pipelines using Snowflake and modern data stack tools.
Responsibilities:
- Design, develop, and optimise scalable data pipelines using Snowflake and modern data stack tools.
- Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
- Implement best practices for data modelling, performance tuning, and cost-efficient architecture in Snowflake.
- Conduct code reviews to ensure high-quality, maintainable, and secure data engineering solutions.
- Ensure data quality, reliability, and security across all stages of the data lifecycle.
- Automate data workflows and integrate diverse data sources into the Snowflake platform.
- Monitor and troubleshoot data pipeline issues, ensuring high availability and performance.
Requirements:
- Approx. 2-3 years of experience in a relevant role.
- Experience in Snowflake scripting - stored procedures (PLSQL or python), user-defined functions, Common Table expressions, Window functions.
- Knowledge of ETL / ELT and Snowflake architecture.
- Knowledge of various file formats (Parquet, JSON, YAML).
- Understanding Snowflake concepts like data sharing, replication, dynamic data, using masking policies, secure views, row access policies concepts, tags, streams, tasks, external tables, time travel, clone, storage integration, stages, clustering of larger tables on clustering keys, role-based access control.
- Familiarity with git concepts like creation of branches, cloning of repo, creation of pull requests, resolving conflicts, code reviews.
- Understanding basic principles of data structure and data modelling.
- Knowledge of Azure DevOps and/or AWS services (AWS Glue experience is preferred).
- Experience with software engineering best practices such as design patterns, code review, testing, and documentation.
- Fluent English.
Nice to have:
- Knowledge of Apache Airflow to schedule pipelines.
- Experience in using Snowpark.
- DBT (Data build tool or any other commercial ETL tool) hands-on experience in creating models as per requirements, using macros, Jinja scripting, hooks, automated tests, snapshots, DBT packages.
- Snowflake certifications.
Benefits:
- Contract of employment
- Performance Bonus
- Private medical care (ENEL-MED)
- Cafeteria system of benefits (e.g., MultiSport card)
- Additional parent privileges: - baby leave – 6 weeks leave for second parent - shortened working time after parental leave
- Employer-funded group insurance
- Employee Shares Plan
- Extra day off for birthday
- Paid time off to volunteer
- Additional leave acquired over the years in the company (even 5 days more in a year)
- Wellbeing Leave - additional two weeks paid leave after 10 years of service
- Psychological support consultations
- Access to e-learning platforms
- Internal employee referral program
- Hybrid working model from Poland with a few days in Warsaw office per month
- Attractive office location in Warsaw - Gdański Business Center
- Additional entitlements for people with disabilities - Work Without Barriers
- Work environment that promotes diversity - Diversity Charter