Software Engineer - GeForce G-Assist

We're building GeForce G-Assist, an on-device AI assistant that combines Small Language Models (SLMs), retrieval systems, and hybrid cloud capabilities. You will work closely across engineering and product teams to ensure G-Assist performs reliably in real-world scenarios.

Responsibilities:

• Evaluate and improve Small Language Models used in GeForce G-Assist, focusing on accuracy, robustness, and conversational reliability.
• Work with SLM and VLM architectures to support text and multimodal interactions.
• Optimize local inference using llama.cpp, including quantization, memory usage, and performance tuning.
• Design and integrate retrieval-augmented generation (RAG) systems that ground responses in system and user context.

Requirements:

• 5+ years of experience in system software or a related field, with an M.S. or higher degree in Computer Science, Data Science, Engineering, or a related field.
• Strong ability to read and write C/C++ code in systems-level or performance-sensitive environments, along with proficiency in Python.
• Hands-on experience evaluating Small Language Models, including task-based and conversational testing.
• Knowledge of SLM and VLM architectures and their trade-offs, experience with retrieval technologies and language-model integration.

Nice to Have:

• Experience contributing to language or multimodal models that power user-facing products.
• A track record of collaborating with product, platform, or systems teams to balance model capability, performance, and user experience.
• Demonstrated ability to translate user needs or feedback into measurable improvements in model behavior or system reliability.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits.