Description
This role is responsible for bridging system memory architecture with AI model behavior, ensuring optimal performance through HW/SW co-design and workload-aware tuning.
The role develops AI workload optimization strategies for faster model startup, improved inferencing efficiency, and reduced memory needs.
Responsibilities:
- Analyze system bandwidth, latency, and compute bottlenecks
- Model performance across CPU/GPU/NPU for AI workloads
- Simulate workload execution (PnP tradeoffs, resource contention)
- Optimize model execution (initialization time, caching, KV reuse)
- Drive HW/SW co-design (memory, caching, scheduling)
- Partner with ML teams to align model structure with system architecture
- Leverage recognized technical and business expertise to define long-term vision and strategy for electrical hardware design and development across multiple feature areas and divisional boundaries
- Develop technology roadmaps for electrical/hardware engineering teams; identify gaps and solutions for future growth
- Communicate strategy and technology roadmaps to executive staff, industry partners, and customers
- Provide innovative solutions and integrate advanced technologies, theories, or techniques with a significant impact across disciplines
- Provide consultation, design input, and feedback for new product development and design reviews across multiple organizations and architectures
- Work closely with product management, engineering stakeholders from related departments, and empower teams to deliver outstanding and impactful results
- Initiate industry-leading research and development, serving as a recognized lead authority internally and externally
- Provide mentoring and guidance to less-experienced staff members to set an example of electrical hardware design and development, innovation, and excellence
- Participate in and provide input on the process for the selection of future technical leaders
Education & Experience Recommended:
- Four-year or Graduate Degree in Electrical Engineering, or any other related discipline or commensurate work experience or demonstrated competence
- Typically has 12+ years of work experience, preferably in electrical design and tools, software packages, architecture of electronic hardware, or a related field
Benefits:
- Health insurance
- Dental insurance
- Vision insurance
- Long-term/short-term disability insurance
- Employee assistance program
- Flexible spending account
- Life insurance
- Generous time-off policies, including 4-12 weeks fully-paid parental leave based on tenure, 11 paid holidays, and additional flexible paid vacation and sick leave