# Senior Data Engineer, Cloudforce One

**Company**: Cloudflare
**Location**: Hybrid
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://job-boards.greenhouse.io/cloudflare/jobs/8395358?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/job/senior-data-engineer-cloudforce-one-f3a709b5-ecc/

## Description

## About the role

Cloudforce One is Cloudflare's threat operations and research team, responsible for identifying and disrupting cyber threats. As a Senior Data Engineer on the team, you will build the data foundation that makes this possible: designing and operating scalable pipelines, analytical data stores, and data marts that turn raw Cloudflare telemetry into trusted datasets for threat researchers, data scientists, analysts, and customers.

## Responsibilities

- Design, build, and operate scalable batch data pipelines on Kubernetes-hosted Airflow and Spark clusters that extract, enrich, and publish threat and abuse signals from Cloudflare's network and platform telemetry.

- Build and evolve data stores in Apache Iceberg (R2) and curated data marts that serve Threat Events, Trust & Safety initiatives, and Threat Intelligence investigations.

- Model datasets deliberately , choosing grain, partitioning, and schema evolution strategies that keep data correct, queryable, and cost-efficient.

- Write and optimize SQL against large-scale analytical data in ClickHouse, balancing completeness, performance, and cost.

- Make pipelines safe to retry, resume, and backfill, so downstream consumers receive exactly the data intended to publish.

- Build data quality checks, reconciliation, and monitoring that catch problems before they reach analysts, detections, or customers.

- Treat privacy and data minimization as design requirements from the start.

- Enable Threat Intelligence and Trust & Safety partners with the data they need for tooling and investigations, translating ad hoc requests into reusable datasets.

- Partner with data scientists to turn exploratory analysis into repeatable, production-quality data products and ML-ready datasets.

- Raise the team's engineering bar through code review, testing, CI/CD, and documentation.

## Requirements

- 7+ years of experience designing, building, and operating scalable production data pipelines.

- Proven experience building analytical data stores and data marts, including data modeling, partitioning, and schema evolution.

- Strong Python for data engineering, including testing and maintainable, well-structured code.

- Strong SQL, including window functions, query optimization, and performance tuning on large datasets.

- Hands-on experience with Apache Airflow in production, including Kubernetes-hosted deployments.

- Experience with distributed data processing (e.g., Spark) at large scale.

- Experience with Apache Iceberg (or comparable open table format) on object storage such as R2 or S3.

- Experience with ClickHouse or comparable columnar analytical database.

- Experience with CI/CD, version control, and containerized deployments.

- Clear communication and ability to turn ambiguous requirements into well-defined data products.

## Nice to Have

- Experience with security, threat intelligence, fraud, or trust & safety / abuse data.

- Solid understanding of how the Internet works (DNS, HTTP, TLS, BGP).

- Experience supporting data science or ML workflows (feature stores, training datasets).

- Experience with Cloudflare's developer platform (Workers, R2, R2 Data Catalog).

- Trino/Presto or other distributed query engines.

- Experience using AI-assisted development tools as part of workflow.

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- Python
- SQL
- Apache Airflow
- Spark
- Apache Iceberg
- ClickHouse
- CI/CD
- Kubernetes

### Nice to have
- security
- threat intelligence
- fraud
- trust & safety
- abuse data
- DNS
- HTTP
- TLS
- BGP
- data science
- ML workflows
- Cloudflare developer platform
- Trino/Presto

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/cloudflare/jobs/8395358?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)
