Skip to content
Updated How AI-exposed are the skills employers are hiring for? See the data →

From the employer's careers site First seen 21 Nov 2026

Senior Data Engineer, Cloudforce One

Cloudflare Hybrid senior full-time

The employer hasn't listed a salary.

Apply on Cloudflare

Description

About the role

Cloudforce One is Cloudflare's threat operations and research team, responsible for identifying and disrupting cyber threats. As a Senior Data Engineer on the team, you will build the data foundation that makes this possible: designing and operating scalable pipelines, analytical data stores, and data marts that turn raw Cloudflare telemetry into trusted datasets for threat researchers, data scientists, analysts, and customers.

Responsibilities

  • Design, build, and operate scalable batch data pipelines on Kubernetes-hosted Airflow and Spark clusters that extract, enrich, and publish threat and abuse signals from Cloudflare's network and platform telemetry.
  • Build and evolve data stores in Apache Iceberg (R2) and curated data marts that serve Threat Events, Trust & Safety initiatives, and Threat Intelligence investigations.
  • Model datasets deliberately , choosing grain, partitioning, and schema evolution strategies that keep data correct, queryable, and cost-efficient.
  • Write and optimize SQL against large-scale analytical data in ClickHouse, balancing completeness, performance, and cost.
  • Make pipelines safe to retry, resume, and backfill, so downstream consumers receive exactly the data intended to publish.
  • Build data quality checks, reconciliation, and monitoring that catch problems before they reach analysts, detections, or customers.
  • Treat privacy and data minimization as design requirements from the start.
  • Enable Threat Intelligence and Trust & Safety partners with the data they need for tooling and investigations, translating ad hoc requests into reusable datasets.
  • Partner with data scientists to turn exploratory analysis into repeatable, production-quality data products and ML-ready datasets.
  • Raise the team's engineering bar through code review, testing, CI/CD, and documentation.

Requirements

  • 7+ years of experience designing, building, and operating scalable production data pipelines.
  • Proven experience building analytical data stores and data marts, including data modeling, partitioning, and schema evolution.
  • Strong Python for data engineering, including testing and maintainable, well-structured code.
  • Strong SQL, including window functions, query optimization, and performance tuning on large datasets.
  • Hands-on experience with Apache Airflow in production, including Kubernetes-hosted deployments.
  • Experience with distributed data processing (e.g., Spark) at large scale.
  • Experience with Apache Iceberg (or comparable open table format) on object storage such as R2 or S3.
  • Experience with ClickHouse or comparable columnar analytical database.
  • Experience with CI/CD, version control, and containerized deployments.
  • Clear communication and ability to turn ambiguous requirements into well-defined data products.

Nice to Have

  • Experience with security, threat intelligence, fraud, or trust & safety / abuse data.
  • Solid understanding of how the Internet works (DNS, HTTP, TLS, BGP).
  • Experience supporting data science or ML workflows (feature stores, training datasets).
  • Experience with Cloudflare's developer platform (Workers, R2, R2 Data Catalog).
  • Trino/Presto or other distributed query engines.
  • Experience using AI-assisted development tools as part of workflow.

For more fresh new jobs, check out yubhub.co.

Skills

Required

Nice to have

  • security
  • threat intelligence
  • fraud
  • trust & safety
  • abuse data
  • DNS
  • HTTP
  • TLS
  • BGP
  • data science
  • ML workflows
  • Cloudflare developer platform
  • Trino/Presto

Ready to apply?

You apply with the employer directly. Their original posting is here: https://job-boards.greenhouse.io/cloudflare/jobs/8395358

Apply on Cloudflare