# Senior Data Infrastructure Engineer

**Company**: SpaceXSI
**Location**: Palo Alto
**Work arrangement**: onsite
**Experience**: senior
**Job type**: full-time
**Salary**: $220,000 - $357,000 USD
**Category**: Engineering
**Industry**: Technology

**Apply**: https://cursor.com/careers/sr-software-engineer-pretraining-data?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/job/senior-data-infrastructure-engineer-c8414d1e-2c2/

## Description

We are seeking a Senior Data Infrastructure Engineer to join our team. You will design, build, and scale the distributed infrastructure that transforms raw web, code, multimodal, and acquired data into training-ready datasets for frontier model pretraining.

**Responsibilities:**

- **Data Platform:** Design, build, and scale the distributed infrastructure that transforms raw web, code, multimodal, and acquired data into training-ready datasets for frontier model pretraining. Own high-throughput data pipelines, orchestration systems, and tooling that enable fast, reliable, observable, and reproducible data processing at massive scale, with end-to-end visibility into data lineage, freshness, and pipeline health.

- **Data Quality:** Build and deploy high-performance models and algorithms to classify, rank, deduplicate, filter, and clean training data at extreme throughput. Design and execute rigorous experiments across data mixtures, sampling strategies, and quality thresholds to quantify their impact on training loss, downstream evaluations, and model capabilities, translating research findings into production systems.

- **Crawling:** Build and optimize large-scale web crawling infrastructure spanning URL discovery, prioritization, host scheduling, fetching, parsing, and content extraction. Improve crawl coverage, efficiency, and reliability through intelligent scheduling, anti-bot resilience, robust extraction systems, and automated recovery, ensuring high-quality web data flows seamlessly into downstream training pipelines.

- **Technical Leadership & Collaboration:** Lead complex engineering initiatives across Data Platform, Data Quality, Crawling, Acquisition, and model training teams. Influence technical direction, drive architectural decisions, mentor engineers, and translate improvements in data infrastructure, coverage, and quality into measurable gains in model performance.

**Requirements:**

- 5+ years of professional software engineering experience building distributed systems and/or large-scale data infrastructure

- Strong infrastructure or data platform background, ideally with a spike of outlier depth

- High-slope engineer who has moved unusually fast (e.g., staff-level ownership within a few years) or brings relevant domain experience

- Able to architect and ship end-to-end with high ownership, debug complex systems independently, and work alongside AI agents

- Strong intuitions about large-scale distributed systems, including running them reliably at frontier scale

- Track record of leading technical projects across teams and mentoring other engineers

- Excited to learn how pre-training data shapes model quality, and want the ownership and visibility that comes with building systems that feed frontier training runs

**Compensation and Benefits:**

- The annual compensation range for this role is $220,000 - $357,000 USD.

- Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.

- Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- distributed systems
- large-scale data infrastructure
- data platform
- data quality
- web crawling infrastructure

### Nice to have
- strong infrastructure or data platform background
- high-slope engineer
- relevant domain experience

---

Source: [Apply at cursor.com](https://cursor.com/careers/sr-software-engineer-pretraining-data?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)