Description
Compensation
$295K – $555K • Offers Equity
The base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. If the role is non-exempt, overtime pay will be provided consistent with applicable laws. In addition to the salary range listed above, total compensation also includes generous equity, performance-related bonus(es) for eligible employees, and the following benefits.
- Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
- Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
- 401(k) retirement plan with employer match
- Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
- Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
- 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
- Mental health and wellness support
- Employer-paid basic life and disability coverage
- Annual learning and development stipend to fuel your professional growth
- Daily meals in our offices, and meal delivery credits as eligible
- Relocation support for eligible employees
- Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.
About the Team
The Personality & Model Behavior team, within OpenAI’s broader Personal AGI team conducts research on how to shape personalities and guide the behavior of models. We think about topics such as emotional intelligence, reasoning, and how models interact thoughtfully with users. We’re particularly interested in understanding how individual users want ChatGPT to behave, and creating personalized models that feel uniquely tailored to each user. We integrate this research into ChatGPT and other OpenAI products that are used by hundreds of millions of users.
About the Role
We're looking for individuals with strong ML engineering skills and research experience, especially with novel and highly capable models, and in areas like reinforcement learning and reward modeling. An ideal candidate is passionate about product-driven research.
In this role, you will:
- Conduct research around personalization, personality, and model behavior by leveraging and developing tools such as synthetic data, reward modeling, and reinforcement learning.
- Build robust evaluations and model training pipelines to facilitate our research.
- Innovate new post-training methods.
Requirements
- Have a deep understanding of machine learning and its applications.
- Have prior knowledge in training and optimizing models and building evaluations.
- Are willing to dive into large ML codebases to debug issues.
- Thrive in dynamic and technically complex environments.
- Have a track record of delivering innovative, out-of-the-box solutions to address real-world constraints.