Description
We are seeking a Systems Evaluation Engineer to define measurement methodology and benchmarks to quantify customer outcomes, platform performance, and AI workload effectiveness. The successful candidate will play a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools.
Responsibilities
- Define success metrics
- Create benchmarking frameworks
- Analyze customer outcomes
- Produce executive performance reports
- Contribute to technology strategy and engineering roadmaps around software engineering
- Execute strategic software engineering proof of concepts
- Interact with user management regarding project status and user requirements
- Supervise the work of external engineering vendors
- Identify, recommend, and implement changes to enhance effectiveness of engineering, implementation, and service strategies
Education & Experience Recommended
- Four-year or Graduate Degree in Computer Science, Statistics, Software Engineering, or any other related discipline
- Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field
Preferred Qualifications
- AI systems evaluation
- Telemetry analytics
- Performance benchmarking
- Linux and Windows validation experience
Benefits
- Health insurance
- Dental insurance
- Vision insurance
- Long term/short term disability insurance
- Employee assistance program
- Flexible spending account
- Life insurance
- Generous time off policies, including 4-12 weeks fully paid parental leave based on tenure, 11 paid holidays, and additional flexible paid vacation and sick leave