Toptal

Senior Deployment Engineer with LLM and GPU Infrastructure experience

Remote, United States remote Entry Salary not listed
remote Design & Creative Curated
Sign in to apply Free account — we bring you straight back to this role.

About the role

Headquarters:

Summary
We are seeking an Infrastructure Engineer for Air-gapped LLM Deployments to support secure, large-scale software deployments in GPU-based environments. The role focuses on deploying LLM workloads in air-gapped settings and establishing observability with Grafana and Prometheus, with onsite presence in Riyadh required for two weeks per month.
General information
They need a senior engineer who can take ownership of complex deployments across isolated or air-gapped environments. The role will involve working with GPU infrastructure for LLM workloads and ensuring systems can be deployed, monitored, and maintained reliably at scale.
The engineer should be comfortable troubleshooting infrastructure and deployment issues, automating deployment processes, and working with observability platforms such as Grafana and Prometheus.
Location: Riyadh, Saudi Arabia
Onsite requirement: A few times per quarter in Riyadh
Tasks and Deliverables
Design and support air-gapped deployment environments for LLM-based systems.
Deploy and optimize LLM workloads on GPU infrastructure.
Support large-scale software deployments across secure environments.
Implement and maintain observability using Grafana and Prometheus.
Collaborate onsite in Riyadh to assess, deploy, and troubleshoot environment-specific issues.
Required experience
Expertise in air-gapped deployments.
Experience with large-scale software deployments.
Experience deploying LLMs on GPUs.
Hands-on experience with Grafana and Prometheus.
Engagement highlights
Senior-level infrastructure/deployment engineering role.
Work on large-scale GPU and LLM infrastructure.
Challenging deployment scenarios involving air-gapped environments.
Full-time, long-term position

To apply: https://weworkremotely.com/remote-jobs/toptal-senior-deployment-engineer-with-llm-and-gpu-infrastructure-experience

Interview prep

Walk in with sharper answers.

Use this as a quick practice sheet before you speak with the employer.

Role
Design & Creative Remote Collaboration Senior Deployment Engineer Llm remote

Likely questions

  1. Tell us about work you have done that is close to the Senior Deployment Engineer with LLM and GPU Infrastructure experience role.
  2. How would you approach your first 30 days at Toptal?
  3. Which of Remote Collaboration, Senior and Deployment have you used recently, and what did it help you achieve?
  4. Describe a time you solved a problem without waiting to be told exactly what to do.
  5. How do you stay organised and communicate clearly when working remotely?

Prepare before the call

  • A recent example that proves your experience with Remote Collaboration, Senior and Deployment.
  • One short story with a problem, your action, and the result.
  • Two examples that show the strengths listed on your CV.
  • A clear reason why this role and company interest you.
  • Your availability, preferred work style, and salary expectations.

Ask them

  • What would success look like in the first 90 days?
  • What are the main problems this hire should help solve?
  • How does the team give feedback and measure good work?
  • What does a normal working week look like for this role?
Practice line

I am interested in the Senior Deployment Engineer with LLM and GPU Infrastructure experience role because I can bring practical experience in Remote Collaboration, Senior and Deployment, learn the team quickly, and contribute to the outcomes Toptal needs from this hire.

Related jobs.

More roles from this company or category.