Description
We are seeking a Senior AI Infrastructure Systems Engineer to join our team. The role involves forming technical hypotheses, designing targeted tests, analyzing system logs and low-level hardware data, and distinguishing between GPU, host, firmware, interconnect, thermal, and physical hardware failures.
Responsibilities:
- Diagnose and resolve complex hardware and platform failures in high-performance AI infrastructure
- Work across Linux, GPU servers, PCIe, firmware, power, and cooling to determine the true root cause of issues
- Form technical hypotheses, design targeted tests, analyze system logs and low-level hardware data
- Distinguish between GPU, host, firmware, interconnect, thermal, and physical hardware failures
Requirements:
- Minimum 5 years of hands-on systems engineering experience across Linux, server hardware, firmware, PCIe, and GPU or high-performance computing platforms
- Extensive Linux experience, particularly using Linux as an environment for hardware debugging, system-level troubleshooting, and platform investigation
- Knowledge of the Linux kernel and experience with kernel-level debugging or troubleshooting
- Strong knowledge of modern server architecture, particularly in high-performance, GPU-based environments
- Strong knowledge of NVIDIA GPU platforms and diagnostic tooling
- Deep knowledge of PCIe, including topology, enumeration, root complexes, endpoints, switches, bridges, retimers, link speed and width, AER and DPC errors, completion timeouts, and link failures
- Experience benchmarking systems for performance, stability, power efficiency, thermal behaviour, and workload characteristics
- In-depth understanding of firmware interactions across BIOS/UEFI, BMC, CPLD/FPGA, GPU firmware, NIC firmware, and other platform components
- Experience with low-level hardware communication and debugging using I²C, SMBus, PMBus, register maps, bit masks, byte- and word-level data, and device datasheets
- Demonstrated ability to troubleshoot complex hardware, software, and networking issues
- Experience with deep problem investigation, root cause analysis, and performance optimization in cloud or high-performance computing environments
- Strong analytical and problem-solving skills with a performance-first mindset
- Scripting and automation using various languages (Python, Go)
Benefits:
- Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families
- 401(k) plan: up to 4% company match with immediate vesting
- Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers
- Remote work reimbursement: up to $85/month for mobile and internet
- Disability & life insurance: company-paid short-term, long-term and life insurance coverage
Compensation:
- Competitive salary ranging from $179,500- $224,300 + quarterly performance bonuses