Senior CUDA Mathematical Libraries Engineer



Santa Clara, CA, USA
Posted on Saturday, October 14, 2023

We are now looking for a Sr. CUDA Mathematical Libraries Engineer (Dense Linear Algebra)! NVIDIA is hiring software engineers for its GPU-accelerated Deep Learning (DL) and high-performance computing (HPC) mathematical libraries team. Did you know these GPU accelerated mathematical libraries developed by NVIDIA are being used in a wide range of applications in scientific computing, engineering, and deep learning? Around the world, leading commercial and academic organizations are revolutionizing AI, scientific and engineering simulations, and data analytics, using data centers powered by GPUs. Applications include: healthcare, VR, deep learning, quantum computing simulations, autonomous vehicles and countless others. If the idea of pushing the boundaries of state-of-the-art research and development excites you, come join our dynamic team and help us build GPU accelerated software libraries which will be used by the entire world.

In this role you will be interacting and collaborating with internal partners, industry professionals, and members of the scientific community to define and implement highly optimized new numerical algorithms. Your responsibilities include the design of public APIs, implementation of new algorithms, performance tuning and analysis, and other general software engineering work. You will need great interpersonal and communication skills and a strong focus on delivering high-quality and performance software.

What you’ll be doing:

  • Prototype, develop, and optimize software for deep learning, data analytics, scientific research, and engineering applications that use high-performance computing.

  • Analyze the performance of GPU or CPU implementations.

  • Collaborate with internal and external partners to understand software use cases and requirements.

  • Capitalize on opportunities for adding new functionality or for improving performance.

  • Attend conferences and engage with the larger community on relevant topics

What we need to see:

  • PhD in Computer Science, Applied Math, or related science or engineering field of study with 3+ years of experience. or a Masters or Bachelors degree in those fields with additional experience.

  • Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.

  • Experience developing parallel numerical software libraries on HPC platforms using multi-threading and/or MPI.

  • Deep understanding of dense linear algebra and computations in science, engineering, or deep learning.

  • Ability to work independently, define project goals and scope, and manage your own development effort.

  • Good teamwork, communication, and documentation habits.

Ways to stand out from the crowd:

  • Strong fundamentals in algorithms.

  • Prior experience with low level programming in assembly and performance tuning.

  • GPU programming experience (CUDA or OpenCL) is a strong plus but not required.

  • Good knowledge of CPU and/or GPU hardware architecture.

  • A scripting language, preferably Python.

As NVIDIA makes inroads into the Datacenter business, our team plays a central role in getting the most out of our exponentially growing datacenter deployments as well as establishing a data-driven approach to hardware design and system software development. We collaborate with a broad cross section of teams at NVIDIA ranging from DL research teams to CUDA Kernel and DL Framework development teams, to Silicon Architecture Teams. As our team grows, and as we seek to identify and take advantage of long term opportunities, our skillset needs are expanding as well.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative and autonomous, we want to hear from you!

The base salary range is $176,000 - $333,500. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.