NERSC End-to-End LLM Bootcamp, May 2024

The NERSC End-to-End LLM Bootcamp will be hosted virtually for three days from May 7-9, 2024 and is co-organized by NERSC with support from OpenACC organization and NVIDIA.

The End-to-End LLM (Large Language Model) Bootcamp is designed from a real-world perspective that follows the data processing, development, and deployment pipeline paradigm. Attendees walk through the workflow of preprocessing the SQuAD (Stanford Question Answering Dataset) dataset for Question Answering task, training the dataset using BERT (Bidirectional Encoder Representations from Transformers), and executing prompt learning strategy using NVIDIA® NeMo™ and a transformer-based language model, NVIDIA Megatron. Attendees will also learn to optimize an LLM using NVIDIA TensorRT™, an SDK for high-performance deep learning inference, guardrail prompts and responses from the LLM model using NeMo Guardrails, and deploy the AI pipeline using NVIDIA Triton™ Inference Server, an open-source software that standardizes AI model deployment and execution across every workload.

This virtual bootcamp is a hands-on learning experience where you will be guided through step-by-step instructions with teaching assistants on hand to help throughout. 

Eligibility and Prerequisites

This event is open to the general HPC community. However, due to limited capacity, active NERSC, ALCF, and OLCF users will receive priority consideration. Prerequisites: 

• Basic experience with Python and PyTorch. 
• No GPU programming experience is required.

Agenda

All times are in Pacific time zone.

Application

The application deadline is April 24, 2024. For application and more details, please visit the event page. Please note acceptance is not confirmed until you have received a confirmation email.

Presentation Materials

Please find the presentation materials (password-protected) for this event here.