Description
Flow Traders is looking for a Core Data Engineer to own the end-to-end lifecycle of their most fundamental data products.
High-quality data is crucial for Flow Traders' strategic direction, reducing complexity and BAU for stakeholders, and driving growth through quantitative trading styles.
As a Core Data Engineer, you will craft and execute the blueprint for these products, leveraging the Data Platform to build and monitor automated pipelines, ensuring reliable data for users across the organization.
You will become an expert in these data sets, optimizing their use and exploring new sources for additional value.
You will collaborate with teams to ensure in-house systems are designed with data in mind, streamlining data-related workflows, and maximizing the value stakeholders extract from the data.
Responsibilities:
- Craft datasets with quants, turning underspecified research questions into aligned, adjusted, point-in-time correct, documented, and reproducible datasets.
- Develop and own the end-to-end lifecycle of data products, building and maintaining pipelines, developing quality checks, and correcting day-to-day operational issues.
- Own data quality, designing checks and alerts that catch problems that would hurt a strategy.
- Build shared foundations, including reference data, instrument identifiers, corporate actions, and vendor feeds.
- Keep critical pipelines running, supporting markets in several regions and digital asset markets.
Requirements:
- Analytics or data engineering experience, ideally at a startup or scale-up.
- Strong data modelling and data quality practice.
- Strong proficiency in Python, working proficiency with SQL and relational databases, and version control systems.
- Demonstrated ability to work with large datasets and familiarity with big data solutions.
- Experience owning something in production.
- Strong interpersonal and communication skills.
Preferred qualifications:
- Experience with financial data.
- Familiarity with point-in-time data, look-ahead bias, and survivorship bias.
- Experience with a modern cloud data stack.
- Experience with Airflow, Kafka, and GCP.
- Experience with Polars, Pandas, Spark, Apache Beam, Apache NiFi.
- Experience at a trading firm, systematic fund, brokerage, crypto exchange, or market data company.
- On-call or incident response experience.
Benefits:
- Flow Academy and opportunities to attend domain-related conferences.
- Daily catered lunch, great coffee, and a fully stocked kitchen and snack bar.
- In-house Bar and Lounge with arcade, table tennis, billiards, and game consoles.
- Company boat.
- In-house gym and sessions with a nutritionist or personal trainer.
- Bi-weekly massages.
- Annual company trip and various events throughout the year.
- Global rotations across offices worldwide.