CUDA Atomics, Reductions, and Warp Shuffle -- Part 5 of 9 CUDA Training Series, May 13, 2020

Introduction

CUDA^® is a parallel computing platform and programming model that extends C++ to allow developers to program GPUs with a familiar programming language and simple APIs.

NVIDIA will present a 9-part CUDA training series intended to help new and existing GPU programmers understand the main concepts of the CUDA platform and its programming model. Each part will include a 1-hour presentation and example exercises. The exercises are meant to reinforce the material from the presentation and can be completed during a 1-hour hands-on session following each lecture (for in-person participants) or on your own (for remote participants).  OLCF and NERSC will both be holding in-person events for each part of the series. Please see the topics of each part and dates here.

Part 5 of 9:  CUDA Atomics, Reductions, and Warp Shuffle

Date and Time: 10 am - 12 pm (Pacific time), Wednesday, May 13, 2020

The format of this event will be online only. This CUDA programming model does not enforce any order of thread execution. This requires attention when performing operations like reductions on the GPU. This module introduces atomic operations, parallel reductions, and warp shuffle, which can help you in cases where exposing parallelism is not immediately obvious due to potential thread contention.

After the presentation, there will be a hands-on session where participants can complete example exercises meant to reinforce the presented concepts and get help from the experts. 

Registration

Please register here.  This event is online only.

Remote Connection Information

Zoom Connection Details: https://lbnl.zoom.us/j/5104865180
Meeting ID: 510 486 5180
Call In: +1 669 900 6833

Exercise Walk Through

The exercise for this module of the training series is expected to take longer than the time allocated for the hands-on session, so NVIDIA has kindly offered to walk through the exercise during a separate session. Please see the details below.

Module 5 Exercise Walk-Through
May 19, 2020, 12:30 – 1:30 PM  (Pacific Time)

• Slides
• Recording
• Exercises: The example exercises for this module can be found in the "exercises/hw5" folder of this GitHub repo. 
• Survey: Please help us to provide feedback by completing a 3-min short survey (access via the "Survey" tab located in the middle of this page)