NVIDIA

Senior Datacenter Technical Program Manager, At-Scale AI Clusters

United States full-time Senior $168,000 - $322,000
full-time Senior level Technology & IT Salary listed Curated
Sign in to apply Free account — we bring you straight back to this role.

About the role

NVIDIA is looking for a highly-motivated Technical Program Manager (TPM) to join our Applied Systems Engineering Team to drive datacenter integration for the next generation of NVIDIA AI supercomputing systems. This TPM will play a crucial role throughout the lifecycle of the latest AI systems at scale, from datacenter design and requirements definition, through systems integration of AI clusters into the datacenter environment, and support for these systems as they enter production.
This role will drive collaboration between engineering leaders across multiple hardware and software teams, helping us work together to build AI supercomputers for NVIDIA engineers and develop reference architectures to advise customers and partners.
What you’ll be doing:

Collaborate with outstanding engineers and architects to build and deploy large scale GPU computing systems based on NVIDIA's reference supercomputing architectures

Lead the integration of new AI clusters with datacenter facilities with demanding requirements on power, cooling, and instrumentation

Coordinate design and fit-out of new datacenter builds, working with both internal engineering teams and external contractors

Own and produce detailed documentation for the end-to-end process for datacenter fit-out and integration

Communicate internally with engineering leadership to prioritize and address key issues essential to the success of our largest customers

What we need to see:

BS in Applied Science or Engineering (or equivalent experience)

8+ years of overall experience

Experience with high-performance computing systems and GPU clusters deployed in on-premises datacenters

A passion for understanding challenging technical problems and driving the process of finding a solution

Strong teamwork and interpersonal skills, to facilitate building a collaborative workflow for coordination between many teams

Ways to stand out from the crowd:

Understanding of datacenter design, including familiarity with power and cooling technologies

Expertise in system monitoring and instrumentation of large clusters, using technologies such as Prometheus, Grafana, Splunk, Modbus, and BACNet

Experience working with the engineering or academic research community supporting high-performance computing or deep learning

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 4, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Originally posted on Himalayas

Interview prep

Walk in with sharper answers.

Use this as a quick practice sheet before you speak with the employer.

Senior
Technology & IT API integration Writing Senior Datacenter Technical Senior level

Likely questions

  1. Tell us about work you have done that is close to the Senior Datacenter Technical Program Manager, At-Scale AI Clusters role.
  2. How would you approach your first 30 days at NVIDIA?
  3. Which of API integration, Writing and Senior have you used recently, and what did it help you achieve?
  4. How have you led people, improved a process, or made a hard decision in a previous role?
  5. How do you handle busy days, changing priorities, or pressure at work?

Prepare before the call

  • A recent example that proves your experience with API integration, Writing and Senior.
  • One short story with a problem, your action, and the result.
  • Two examples that show the strengths listed on your CV.
  • A clear reason why this role and company interest you.
  • Your availability, preferred work style, and salary expectations.

Ask them

  • What would success look like in the first 90 days?
  • What are the main problems this hire should help solve?
  • How does the team give feedback and measure good work?
  • What does a normal working week look like for this role?
Practice line

I am interested in the Senior Datacenter Technical Program Manager, At-Scale AI Clusters role because I can bring practical experience in API integration, Writing and Senior, learn the team quickly, and contribute to the outcomes NVIDIA needs from this hire.

Related jobs.

More roles from this company or category.