Description
We are seeking a Senior System Software Engineer to join our team, focusing on developing tools for AI researchers and SW/HW teams running AI workloads in GPU clusters.
As a member of our software development team, you will work with users from different departments, including Architecture teams and Software teams. Your work will bring users intuitive, rich, and accurate insights into workloads and systems, empowering them to find opportunities in software and hardware, build high-level models to propose and deliver the best hardware and software to our customers, or debug tricky failures and issues to help improve the performance and efficiency of the system.
Key responsibilities include building internal profiling and analysis tools for AI workloads at large scales, building debugging tools for common encountered problems like memory or networking, creating benchmarking and simulation technologies for AI systems or GPU clusters, and partnering with HW architects to propose new features or improve existing features with real-world use cases.
To succeed in this role, you will need a Bachelor's degree in Computer Science or a related field (or equivalent experience) and 6+ years of software development experience. You should have strong software skills in design, coding (C++ and Python), analytical, and debugging, as well as a good understanding of Deep Learning frameworks like PyTorch and TensorFlow, distributed training and inference.
Additionally, you should have knowledge of GPU cluster job scheduling (Slurm or Kubernetes), storage and networking, experience with NVIDIA GPUs, CUDA Programming, and NCCL, motivated self-starters with strong problem-solving skills and customer-facing communication skills, and a passion for continuous learning.
If you have proven experience in GPU cluster scale continuous profiling & analysis tools/platforms, solid experience in large AI job performance analysis for training/inference workloads, knowledge of Linux device drivers and/or compiler implementation, knowledge of GPU and/or CPU architecture and general computer architecture principles, this role could be an excellent fit for you.
You will also be eligible for equity and benefits.