Senior HPC Scheduler Engineer



Santa Clara, CA, USA
Posted on Friday, September 22, 2023

NVIDIA has been continually redefining computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s an outstanding legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you will be immersed in a diverse, encouraging environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world. We are looking for an outstanding HPC scheduler/resource manager engineer for architecture, deployment and performance optimization of large datacenter cluster systems and applications.

Be a key player to the most exciting computing hardware and software to driving the latest breakthroughs in artificial intelligence and GPU computing. Provide insights on at-scale system design for collecting, visualizing, and acting on a wide variety of data. You will work with the latest Accelerated computing and Deep Learning software and hardware platforms, and with many scientific researchers, developers, and customers to craft state of the art scheduling strategies which enable new systems and interconnects. You will interact with OS, GPU compute, and networking specialists to envision, develop and bring up large scale systems.

What you’ll be doing:

  • Provide engineering solutions and prototypes to enable efficient resource management and job scheduling for large scale clusters, ensure technical relationships with internal and external engineering teams, and assist system architects and machine learning/deep learning engineers in building creative solutions based on NVIDIA technology.

  • Be an internal reference for scheduling and resource management concepts and methodologies among the NVIDIA technical community. Test, evaluate, and benchmark new technologies and products and work with vendors, partners and peers to improve functionality and optimize performance.

What we need to see:

  • 5+ years of experience designing and running scheduling and resource management systems in large datacenter/AI/HPC solutions.

  • Knowledge and experience with resource management / scheduling code bases: SLURM preferred, other implementations (LSF, SGE, Torque...).

  • Proven understanding of performance clusters, infrastructure and workload patterns.

  • Experience using and installing Linux-based server platforms.

  • C/Python/Bash/Lua programming/scripting experience.

  • Experience working with engineering or academic research community supporting HPC or deep learning.

  • Strong teamwork and both verbal and written communication skills.

  • Ability to multitask efficiently in a very dynamic environment!

  • Action driven with strong analytical and troubleshooting skills.

  • Desire to be involved in multiple diverse and innovative projects.

  • BS in Engineering, Mathematics, Physics, or Computer Science or equivalent experience. MS or PhD desirable.

Ways to stand out from the crowd:

  • Experience with HPC cluster administration for AI.

  • Experience deploying containerized services.

  • Experience with orchestrators (e.g. Kubernetes).

  • Demonstrated work with Open-Source software: building, debugging, patching and contributing code.

  • Experience tuning memory, storage, and networking settings for performance on Linux systems.

  • Exposure to monitoring and telemetry systems.voyager

The base salary range is $144,000 - $270,250. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.#deeplearning