NVIDIA

Senior System Software Engineer, ML and Vector Search

United States full-time Senior $184,000 - $287,500
full-time Senior level Technology & IT Salary listed Curated
Sign in to apply Free account — we bring you straight back to this role.

About the role

It’s an exciting time for NVIDIA as we expand our capabilities into the world of data science, data processing, and database acceleration. We're looking for an outstanding software engineer to apply their skills in the development of our unstructured data processing libraries, NVIDIA cuVS and cuML.
These libraries compile highly optimized C++ and CUDA algorithms and expose them to higher-level languages like Java and Python. These higher-level languages are then used directly or to accelerate other libraries and database systems. In this role, you will research, develop, benchmark, and explore novel tuned custom algorithms for accelerating vector preprocessing, indexing, and search, as well as building high-performance ML algorithms for clustering and visualization. This is a great chance to take advantage of your CUDA/C++ skills and make a huge impact across a rapidly growing industry. Vector search is an exciting new field at the intersection of database and machine learning. You’ll work closely with a team of stellar engineers redefining what’s possible.
What you will be doing:

Analyze, design, and implement optimized GPU algorithms for large-scale vector search, databases, and machine learning.

Drive performance analysis, benchmarking, and optimization of associated libraries.

Collaborate with a multi-functional team to understand requirements and implement or improve solutions

Developing and improving machine learning algorithms.

Implementing solutions in C++, CUDA and Python.

Contributing to open source projects (like cuML, cuVS, and RAFT)

What we need to see:

BS, MS, or PhD in Computer Science, Data Science or AI, Applied Math, or related field (or equivalent experience).

8+ years of experience programming in C++ or ability to learn it, by moving from a similar language: C, Rust, Java

Experience with ML: ML concepts (approximation vs exact, iterative vs. closed-form), writing ML algorithms, and using ML to solve problems.

Strong analytical problem-solving skills, algorithms and mathematics fundamentals.

Excellent software development skills: programming, debugging, performance analysis, and test design

Ability to work independently and manage your own development efforts.

Good communication and documentation habits.

You care deeply about robust, readable, high-performance code

Familiar with at least one parallel programming or concurrency framework, such as CUDA, OpenMP, OpenACC, Java concurrency, pthreads, etc

Ways to stand out from the crowd:

Experience developing distributed algorithms and running on distributed systems: HPC, Cloud, etc

Strong debugging skills, including for complex multi-language, multi-hardware systems.

Familiarity with vector databases and nearest-neighbor algorithms (for example, Milvus, Pinecone, LanceDB; graph and IVF indexes).

ML background, including clustering and dimensionality reduction; probability and formal methods; applied research

GPU programming is a plus, though we’re happy to teach GPU development.

With a competitive salary package and benefits, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you a creative and autonomous Systems Software Engineer who loves challenges? Do you have a genuine passion for advancing the state of Systems Analytics and Data Intelligence across a variety of industries? If so, we want to hear from you.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 12, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Originally posted on Himalayas

Interview prep

Walk in with sharper answers.

Use this as a quick practice sheet before you speak with the employer.

Senior
Technology & IT Data Analysis MySQL Writing Senior System Senior level

Likely questions

  1. Tell us about work you have done that is close to the Senior System Software Engineer, ML and Vector Search role.
  2. How would you approach your first 30 days at NVIDIA?
  3. Which of Data Analysis, MySQL and Writing have you used recently, and what did it help you achieve?
  4. How have you led people, improved a process, or made a hard decision in a previous role?
  5. How do you handle busy days, changing priorities, or pressure at work?

Prepare before the call

  • A recent example that proves your experience with Data Analysis, MySQL and Writing.
  • One short story with a problem, your action, and the result.
  • Two examples that show the strengths listed on your CV.
  • A clear reason why this role and company interest you.
  • Your availability, preferred work style, and salary expectations.

Ask them

  • What would success look like in the first 90 days?
  • What are the main problems this hire should help solve?
  • How does the team give feedback and measure good work?
  • What does a normal working week look like for this role?
Practice line

I am interested in the Senior System Software Engineer, ML and Vector Search role because I can bring practical experience in Data Analysis, MySQL and Writing, learn the team quickly, and contribute to the outcomes NVIDIA needs from this hire.

Related jobs.

More roles from this company or category.