Description
We build the embodied intelligence that moves real vehicles safely, and the ecosystem a billion machines will run on in the future.
You will implement and iterate filtering, retention and offload policies across hot, cold, archive and delete storage. You will build the data movement and pipelines that our pre-ingestion selection model depends on. You will decide where and how selection models run, balancing compute cost against data value.
Responsibilities:
- Implement and iterate filtering, retention and offload policies across hot, cold, archive and delete storage
- Build the data movement and pipelines that our pre-ingestion selection model depends on
- Decide where and how selection models run, balancing compute cost against data value
- Build early, low-compute decision points that avoid expensive standardisation and enrichment of low-value data
- Work with the storage and data infra teams, and monitor data quality to make sure our datasets reflect what model training needs
Requirements:
- You’re a senior data or software engineer who has run data ingestion or data quality pipelines at petabyte scale
- You’re strong in Python and Spark, with cloud data engineering experience
- You have good judgement on data filtering and quality, and know how to check you haven’t discarded valuable data
- You ship practical solutions quickly and are comfortable iterating on live systems
- You’re a software engineer at heart, building the systems around models rather than the models themselves
Benefits:
- Salaries benchmarked against the market annually
- Meaningful equity, sharing in the ownership and long term success of Wayve
- Relocation support and visa sponsorship where applicable
- Hybrid working, core hours and the chance to work hands on in vehicle workshops and labs
- Learning and development budgets with support for training, conferences and growth
- Comprehensive benefits including health insurance, dental, enhanced maternity and paternity leave, retirement or pension where applicable, access to therapists, wellbeing partner discounts and more