# Core Data Engineer

**Company**: Flow Traders
**Location**: New York
**Experience**: senior
**Job type**: full-time
**Salary**: $165,000 to $210,000
**Category**: Data Science
**Industry**: Finance

**Apply**: https://job-boards.greenhouse.io/flowtraders/jobs/8304623?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/job/core-data-engineer-28a7c888-c78/

## Description

Flow Traders is looking for a Core Data Engineer to own the end-to-end lifecycle of their most fundamental data products.

High-quality data is crucial for Flow Traders' strategic direction, reducing complexity, and supporting growth.

The successful candidate will craft and execute the blueprint for these products, leveraging the Data Platform to build and monitor automated pipelines, ensuring reliable data for users across the organization.

They will become an expert in these data sets, optimizing their use and exploring new sources for additional value.

The Core Data Engineer will collaborate with teams to ensure in-house systems are designed with data in mind, streamlining data-related workflows, and maximizing the value stakeholders extract from their data.

As the architect and guardian of their most valuable data, the Core Data Engineer will have a unique opportunity to make a significant impact on Flow Traders.

They will be accountable for delivering these data products at an exceptional level of quality, ensuring they are timely, pristine, and powerful enough to drive future growth.

### What you will do

- Craft datasets with quants, turning underspecified research questions into aligned, adjusted, point-in-time correct, documented, and reproducible datasets.

- Develop and own the end-to-end lifecycle of these data products, building and maintaining pipelines, developing quality checks, correcting operational issues, and systematizing/automating manual processing steps.

- Own data quality where it matters, designing checks and alerts that catch problems that would hurt a strategy.

- Build shared foundations, including reference data, instrument identifiers, corporate actions, and vendor feeds.

- Keep critical pipelines running, supporting markets in several regions and digital asset markets.

### What you need to succeed

#### Required

- Analytics or data engineering experience, ideally at a startup or scale-up.

- Strong data modelling and data quality practice.

- Strong proficiency in Python.

- Working proficiency with SQL and relational databases, and version control systems.

- Demonstrated ability to work with large datasets and familiarity with big data solutions.

- Experience owning something in production.

- Strong interpersonal and communication skills.

- Ability to balance individual stakeholder requirements with data quality, consistency, and broad applicability.

#### Strongly preferred

- Experience with financial data.

- Familiarity with point-in-time data, look-ahead bias, and survivorship bias.

- Experience with a modern cloud data stack.

- Experience with Airflow, Kafka, and GCP.

- Experience with Polars, Pandas, Spark, Apache Beam, Apache NiFi.

- Experience at a trading firm, systematic fund, brokerage, crypto exchange, or market data company.

- On-call or incident response experience.

The total compensation for this role includes a base range of $165,000 to $210,000 plus annual discretionary variable remuneration.

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- Analytics
- Data Engineering
- Data Modelling
- Data Quality
- Python
- SQL
- Relational Databases
- Version Control Systems
- Big Data Solutions

### Nice to have
- Financial Data
- Point-in-time Data
- Look-ahead Bias
- Survivorship Bias
- Cloud Data Stack
- Airflow
- Kafka
- GCP
- Polars
- Pandas
- Spark
- Apache Beam
- Apache NiFi

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/flowtraders/jobs/8304623?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)