« All Events

GPU MODE IRL Hackathon

April 9 @ 9:30 am - 11:59 pm

PyTorch Foundation is sponsoring the GPU MODE IRL hackathon in Paris, following PyTorch Conference EU. This technical sprint focuses on ML systems optimization and large-scale distributed training. This is a PyTorch Conference EU side event.

Event Details

  • Focus: LLM speedruns and systems performance.
  • Hardware: Access to NVIDIA Blackwell Ultra from Verda and Hopper from Sesterce.
  • Technical Tracks: Pre-training an LLM from scratch in a limited time on a Blackwell Ultra cluster, utilizing 360 PFLOP/s (BF16).

Speakers

  • Erik Schultheis (ISTA-DASLab): Low-precision training.
  • Will Feng (Helion team, PyTorch): ML systems optimization.
  • Matej Sirovatka (Prime Intellect): Technical session TBA.
  • Infrastructure Insights: Paul Chang (Verda) and Youssef El Manssouri (Sesterce).

Schedule

  • 09:30: Doors Open
  • 10:00: Kick off
  • 11:00: Tasks start
  • 19:00: Tasks end
  • 20:00: Closing ceremony

Learn more!

Details

Related Events