Description
We are seeking a Staff Software Engineer to join our Trust & Safety team. As a key member of our team, you will design and implement LLM guardrails that detect abuse scenarios in AI-generated code and agent interactions. You will also build AI-powered detection systems that use LLMs to identify malicious patterns, classify threats, and automate response decisions.
In this role, you will:
- Design and implement LLM guardrails that detect abuse scenarios in AI-generated code and agent interactions
- Build AI-powered detection systems that use LLMs to identify malicious patterns, classify threats, and automate response decisions
- Build and operate abuse detection systems that identify phishing, cryptomining, account takeover, and financial fraud across millions of daily user actions
- Design automated response mechanisms that enforce platform policies without manual intervention
- Own the full abuse response lifecycle: detection, investigation, enforcement, and handling appeals alongside Support and Legal
- Analyze attack patterns using BigQuery and Hex, turning investigation findings into new detection rules
- Maintain and extend internal detection tools (Slurper, Netwatch) that continuously monitor user activity
- Integrate and tune security scanners (SAST, SCA) in CI pipelines with tight performance SLAs
Our ideal candidate will have 8+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection, with strong programming skills in Python and/or TypeScript, and experience with SQL and data analysis at scale.
We offer a competitive salary and equity, as well as a range of benefits including health, dental, and vision insurance, 401(k) program, paid parental leave, and flexible time off.