Description
At Databricks, we enable data teams to solve complex problems by building and running the world's best Data Intelligence Platform.
As one of the first engineers in the NYC Engineering office, you'll join a small team building CustomerLake, the Customer Data Platform on Databricks, to bring enterprise-grade ML and AI personalization to companies.
Responsibilities:
- Evaluate ML and LLM approaches for CustomerLake's personalization use cases and continuously improve quality over time.
- Inspect individual model traces, understand how models reason, and tune and improve them.
- Build the platform and evaluation framework for CustomerLake customers to optimize for real business value.
- Push the team toward new directions and novel methods.
- Partner with product management, engineering, and design to turn ambiguous customer problems into scalable solutions.
- Set the technical foundation and best practices for ML/AI personalization work.
Requirements:
- 10+ years of engineering experience with a strong foundation in shipping and improving ML/AI products.
- Hands-on experience building and evaluating ML models and/or LLM systems for real product or business use cases.
- Experience with personalization based on customer behavior or transactions.
- Proficiency in Python and modern ML frameworks like PyTorch.
- Familiarity with LLMs and generative AI, including techniques like retrieval-augmented generation and prompt design.
- A demonstrated product mindset with the ability to translate ambiguous customer problems into scrappy MVPs.
Nice to have:
- Experience in martech or an analytical angle.
- An academic or research background that can help innovate and develop novel methods.
The pay range for this role is $190,000-$253,400 USD.