HP3 CUDA Programming

Parallel Programming on the GPU

Tutorial 1: Basic CUDA Programs for vector addition and matrix multiplication

Objective

This assignment will simply help you understand the basics of understanding and running a standard CUDA project in google colab environment and HPC server. After going through this, you should have a clear idea of the following points.

  1. Using Google Colab environment for compiling and executing CUDA program.
  2. Understand the basic keywords associated with kernel functions and important functions in the host code for vector addition.
  3. Logging into a remote GPU cluster and using a workload manager to execute CUDA applications.
  4. Profiling and executing CUDA programs using nvprof.
  5. Understanding execution of 2D CUDA kernel for simple matrix multiplication.

Setting up Google Colab environment for running CUDA program.

Login to your gmail account and open google colab. Change the runtime type to GPU. Open the following colab file and follow the steps specified in every cell.

   Colab link for CUDA program (Tutorial 1) 

CUDA matrix Multiplication Program


 Colab link for CUDA Matrix Multiplication Program