Sr. SDET

As a Sr. SDET in Agentic QA at Dialpad, you will own the test automation and quality frameworks that support Dialpad's AI Voice Agent services.

You will develop automated tests for end-to-end product experiences, from frontend UI to backend services to APIs to audio/text interactions.

Your responsibilities include:

• Owning end-to-end quality for agentic features and workflows
• Designing and building automation tooling and frameworks for AI/LLM-driven systems
• Developing and maintaining evaluation frameworks to measure response quality, accuracy, and hallucination rates
• Driving automation coverage using deterministic and probabilistic validation approaches
• Integrating AI quality checks into CI/CD pipelines
• Building tooling for LLM observability and debugging
• Partnering with Applied AI teams on prompt engineering, model selection, and evaluation strategies
• Designing and executing performance and load tests for AI services
• Identifying and mitigating risks related to hallucinations, bias, safety, and edge cases
• Defining and tracking AI quality KPIs
• Participating in design and architecture reviews
• Mentoring engineers and contributing to raising the bar on AI quality engineering practices

To succeed in this role, you will need:

• 5+ years of experience in software engineering or SDET roles
• Strong programming skills in Python, Java, or JavaScript
• Experience testing distributed, cloud-native SaaS systems and APIs
• Demonstrated proficiency in coding with AI agents
• Hands-on exposure to LLMs or AI/ML systems
• Understanding of non-deterministic systems and probabilistic testing approaches
• Experience building test frameworks and scalable automation systems
• Familiarity with AI evaluation techniques
• Experience with CI/CD pipelines
• Strong collaboration skills
• Bachelor's degree in Computer Science or equivalent practical experience

The target base salary range for this position is $135,500-$158,000 CAD.

Benefits include competitive salary, comprehensive benefits, and real opportunities for growth.