Senior Applied Deep Learning Research Scientist, multi-modal LLMs



Santa Clara, CA, USA
Posted on Friday, September 22, 2023

We are now looking for Senior Applied Deep Learning Research Scientists for multi-modal large generative models!

NVIDIA is searching for expert researchers in audio, deep learning, generative models and large language models to join our applied deep learning research team that pioneered Megatron, DLSS, and several models for Audio (BigVGAN, One TTS Aligner To Rule Them All, RADMM, ZenFlow, P-Flow). Our team is pushing the boundaries of "Generative AI" by building state-of-the-art multi-modal generative models and applying them to solve real-world problems. If you are passionate about the latest research and technologies revolutionizing "Generative AI" and want to explore creative new paradigms for multi-modal generative models with a focus on LLMs and audio, this team will be a great fit for you. After building prototypes that demonstrate the promise of your research, you will collaborate with product teams to apply your ideas into industry-leading real-world applications.

What you will be doing:

  • Research, design, implement and publish novel, large-scale generative models that improve multi-modal LLMs with a focus on audio.

  • Design and implement machine learning techniques to adapt generative models to downstream tasks of interest such as audio understanding and synthesis.

  • Construct and curate datasets for large-scale machine learning and specific domains of applications.

  • Collaborate with other team members, research teams, as well as product teams to integrate your research and developments into products.

What we need to see:

  • Must hold a Ph.D. in Computer Science/Engineering, Statistics, Electrical Engineering, etc., or equivalent experience.

  • Excellent knowledge of the theory and practice of "generative AI".

  • 5+ years of relevant research experience, with at least 3+ years of industry experience, in deep learning, audio, generative models, or related machine learning fields.

  • Strong knowledge of application areas such as audio and natural language processing.

  • Excellent programming skills in some rapid prototyping environments such as Python; C++ and parallel programming (e.g., CUDA) is a plus.

  • Expertise with deep learning frameworks such as PyTorch.

  • Outstanding research track record.

  • Excellent communication skills.

With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you passionate about generative AI, deep learning, and having your ideas impact industry-leading real-world applications? If so, we'd love to hear from you!

The base salary range is $180,000 - $333,500. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.