Member of Technical Staff - Evaluation Infrastructure

SpaceXAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.

The RL infrastructure team is looking for an engineer to help develop evaluation infrastructure.

Responsibilities:

• Build highly reliable, efficient, and easy-to-use infrastructure that runs all evaluations at scale.
• Collaborate closely with modeling and evaluation teams on developing new evaluations, maintaining evaluation signal quality, and building internal tooling to support training the next generation of models.
• Identify and resolve performance bottlenecks in all layers of the evaluation infrastructure stack, including inference, capacity fleet management, asynchronous evaluation orchestration, and more.

Basic Qualifications:

• Experience in building, debugging, and optimizing the efficiency of large-scale distributed systems.
• Willingness to dive deep and solve hard problems at all levels of the stack.

Preferred Skills and Experience:

• Experience in LLM inference.
• Experience in GPU compute management, workload scheduling, and dynamic resource optimization.
• Experience in developing interfaces for comparing models and evaluations.

Compensation and Benefits:

The salary range is $180,000 - $440,000 USD. The total rewards package at SpaceXAI also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short and long-term disability insurance, life insurance, and various other discounts and perks.