Description
The Data Engineer will play a critical role in enabling the data, compute, and engineering foundations of our LLM platforms.
The role focuses on building and operating scalable data pipelines, data lineage, and platform integrations required to support large-scale model training, evaluation, and experimentation across IQVIA market use cases.
Key Responsibilities:
- Support data engineering activities for LLM initiatives, including onboarding and transformation of large-scale healthcare datasets for model training and evaluation.
- Design, evaluate, and evolve data transformation pipelines across Snowflake, and AWS-based environments, including performance evaluation of existing research workflows for production scale up.
- Enable data availability and migration to high-performance compute environments, ensuring data is accessible, performant, and version-controlled for modelling teams.
- Implement data lineage, versioning, and dataset reference management to ensure reproducibility and traceability across training and evaluation pipelines.
- Collaborate with modelling, MLOps, and infrastructure teams to support model lifecycle workflows, including integration with evaluation pipelines and model registries.
- Coordinate with stakeholders to define data requirements and timelines.
Skills & Experience:
- Strong experience in big data engineering and distributed data processing.
- Hands-on expertise with Snowflake/Snowpark, AWS data services, and large-scale datasets.
- Experience supporting ML/AI workloads, including training and evaluation data pipelines.
Why Join?
Those who join us become part of a recognized global leader still willing to challenge the status quo to improve patient care.
You will have access to the most cutting-edge technology, the largest data sets, the best analytics tools and, in our opinion, some of the finest minds in the Healthcare industry.
You can drive your career at IQVIA and choose the path that best defines your development and success.
The potential base pay range for this role, when annualized, is zł142,100.00 - zł263,800.00.