Description
We are seeking an experienced AI Runtime / ML Model Systems Engineer to join our team in Houston. You will play a crucial role in developing runtime abstraction layers and intelligent model placement systems across heterogeneous compute resources. The successful candidate will have a strong background in software design and development, with a focus on AI runtime expertise.
Responsibilities:
- Build runtime abstraction frameworks
- Implement model placement policies
- Develop xPU routing logic
- Optimize inference execution
- Lead the building of various software development projects and platforms while aligning them with business and security strategies and requirements
- Build standards, design, and automate the deployment of software
- Design and develop solutions that protect and manage software products and data
- Contribute to technology strategy and engineering roadmaps around software engineering
- Execute strategic software engineering proof of concepts
- Supervise the work of external engineering vendors, analyze testing performed by vendors, and provide feedback and expertise to technicians
Education and Experience:
- Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or a related discipline
- Typically has 7-10 years of work experience in software designing and development, software architecture, programming languages, or a related field
- Strong AI runtime expertise
Required Qualifications:
- ONNX
- TensorRT
- OpenVINO
- NPU/GPU scheduling
- Edge AI deployment
Knowledge and Skills:
- Agile Methodology
- Amazon Web Services
- Application Programming Interface (API)
- Automation
- C++
- Computer Science
- DevOps
- Docker
- Full Stack Development
- Java
- JavaScript
- Kubernetes
- Microservices
- Microsoft Azure
- Python
- React.js
- Scalability
- Software Development
- Software Engineering
- SQL
Benefits:
- Health insurance
- Dental insurance
- Vision insurance
- Long-term/short-term disability insurance
- Employee assistance program
- Flexible spending account
- Life insurance
- Generous time off policies, including 4-12 weeks fully paid parental leave and 11 paid holidays