Skip to content
New Job?Nejo!

The AI Job Search Engine

NVNVIDIA

HPC and AI Software Architect(m/w/x)

Zürich
Full-timeOn-siteExperienced
AI/ML

Optimizing distributed AI training and inference systems, enhancing communication libraries (NCCL, UCX, UCC) and co-designing hardware for data movement acceleration for AI/VR solutions. Ph.D. or equivalent industry experience in computer science, with 2+ years in high-performance data movement or distributed computing, required. Direct impact on groundbreaking AI/VR/Autonomous Vehicle solutions.

Requirements

  • Ph.D. or equivalent industry experience in computer science, computer engineering, or a closely related field
  • 2+ years of experience in systems programming, parallel or distributed computing, or high-performance data movement
  • Strong programming background in C++, Python, and ideally CUDA or other GPU programming models
  • Practical experience with AI frameworks (e.g., PyTorch, TensorFlow) and familiarity with communication libraries
  • Experience in designing or optimizing software for high-throughput, low-latency systems
  • Strong collaboration skills in a multi-national, interdisciplinary environment
  • Expertise with NCCL, Gloo, UCX, or similar libraries used in distributed AI workloads
  • Background in networking and communication protocols, RDMA, collective communications, or accelerator-aware networking
  • Deep understanding of large model training, inference serving at scale, and associated communication bottlenecks
  • Knowledge of quantization, tensor/activation fusion, or memory optimization for inference
  • Familiarity with infrastructure for deployment of LLMs or transformer-based models, including sharding, pipelining, or hybrid parallelism

Tasks

  • Design and prototype scalable software systems for distributed AI training and inference
  • Optimize throughput, latency, and memory efficiency
  • Develop and evaluate enhancements to communication libraries like NCCL, UCX, and UCC
  • Collaborate with AI framework teams to improve communication backend integration and performance
  • Co-design hardware features to accelerate data movement for inference and model serving
  • Contribute to the evolution of runtime systems and AI-specific protocol layers

Work Experience

  • 2 years

Education

  • Doctoral / PhD

Languages

  • EnglishBusiness Fluent

Tools & Technologies

  • C++
  • Python
  • CUDA
  • PyTorch
  • TensorFlow
  • NCCL
  • Gloo
  • UCX
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of NVIDIA and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

  • NVIDIA Switzerland AG

    HPC and AI Software Architecture Intern(m/w/x)

    Full-timeInternshipOn-site
    Zürich
  • NVIDIA Switzerland AG

    Principal Software Architect, GPU Networking Research(m/w/x)

    Full-timeOn-siteSenior
    Zürich
  • NVIDIA

    Deep Learning Solutions Architect – Inference Optimization(m/w/x)

    Full-timeOn-siteSenior
    Zürich
  • NVIDIA Switzerland AG

    Research Scientist, ML Systems - PhD New College Grad(m/w/x)

    Full-timeOn-siteExperienced
    Zürich
  • Hewlett Packard Enterprise

    Research Engineer HPC/AI Focus Daedalus System(m/w/x)

    Full-timeOn-siteExperienced
    Basel, Zürich
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes