Description
We are seeking a Senior Machine Learning Engineer to own evaluation systems and model-side quality improvements for Pattern's generative content platform. The platform produces AI-generated titles, bullets, A+ modules, and imagery across hundreds of thousands of listings.
Responsibilities:
- Build and maintain datasets, rubrics, and automated judges to evaluate the efficacy of changes to the content engine.
- Convert brand rejection reasons into structured, labeled training data to feed model improvements.
- Find ways to quantify qualitative improvements to generated content.
- Decide and defend approval thresholds for generated content in partnership with data science and brand teams.
- Build quality gates to catch problematic outputs before they reach brand review.
Requirements:
- Strong code and system design experience in any language or stack.
- 3+ years owning production software services end to end.
- Formal statistics or machine learning training, or equivalent depth built on the job.
- Experience engineering systems with non-deterministic outputs.
Nice to have:
- Fine-tuning experience (LoRA/PEFT).
- Hands-on LLM or generative media production work.
- Evaluation-system ownership.
- Multimodal evaluation.
- E-commerce domain knowledge.
- Human-labeling operations.
- A/B testing infrastructure.
Career Growth: At Pattern, we prioritize internal mobility and professional development. This role prepares you for senior IC or technical leadership tracks across Pattern's broader AI and generative content initiatives.
Success Metrics:
- 30 Days: Complete onboarding and make initial contributions to an existing regression suite.
- 60 Days: Own a defined slice of the evaluation system end to end.
- 90 Days: Independently drive a fine-tuning or retrieval experiment from hypothesis to validated result.
We Value:
- Game Changers.
- Data Fanatics.
- Partner Obsessed.
- Team of Doers.
Benefits:
- Unlimited PTO.
- Paid Holidays.
- Onsite Fitness Center.
- Company Paid Life Insurance.
- Casual Dress Code.
- Competitive Pay.
- Health, Vision, and Dental Insurance.
- 401(k) match.