Description
The Role
Nebius AI R&D is a team focused on applied research in AI. As a Senior ML Engineer, you will work on research in areas such as:
- Guided search and reinforcement learning for agentic systems
- Reinforcement learning for reasoning models
- Web-scale problem collection for training agents
- Efficient model distillation
Your responsibilities might include:
- Conducting experiments to figure out efficient ways to train a large language model on traces of interactions with various environments
- Exploring methods of guided generation and search in the trajectory space
- Coming up with ways to mine relevant data at web scale and figuring out efficient ways to use this data in model post-training
- Conducting experiments with different reinforcement learning configurations in verifiable domains
- Exploring methods to train AI agents on tasks with non-verifiable reward signals
Requirements
- A profound understanding of theoretical foundations of machine learning and reinforcement learning
- Deep expertise in modern deep learning for language processing and generation
- Substantial experience with training large models on multiple computational nodes
- Strong software engineering skills (Python)
- Deep experience with modern deep learning frameworks (JAX)
- Strong communication and leadership abilities
- Experience designing, executing, and analyzing machine learning experiments with proper statistical rigor
- Ability to formulate research questions, design experiments to test hypotheses, and draw meaningful conclusions from results
- Ability to document research findings clearly and contribute to technical publications or reports
Nice to Have
- Experience with deep reinforcement learning for LLMs, including techniques such as reward modeling, DPO, PPO etc
- Familiarity with important ideas in LLM space, such as RoPE, ZeRO/FSDP, Flash Attention, quantization
- Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, or a related field; Master’s or PhD preferred
- Track record of building and delivering products in a dynamic startup-like environment
- Experience in engineering complex systems, such as large distributed data processing systems or high-load web services
- Open-source projects that showcase your engineering prowess
- Excellent command of the English language, alongside superior writing, articulation, and communication skills
- Proficiency in contemporary software engineering approaches, including CI/CD, version control, and unit testing
Benefits & Perks
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams