Deep Learning- CS60010

Spring Semester - 2023-24

Instructors

Pawan Goyal

Course Timings

Lectures

Wednesday - 11:00 - 12:00 (NC321)

Thursday - 12:00 - 13:00 (NC321)

Friday - 8:00 - 9:00 (NC321)

Teaching Assistants

Subhendu Khatuya, Sujeet Jaiswal, Sourjyadip Ray, Pretam Ray, Kunal Kingkar Das

Announcements

First Class on January 3trd, 11:00 AM.

Syllabus

  1. Introduction to Deep Learning, Supervised learning
  2. Shallow and Deep Neural Networks
  3. Mathematics for Deep Learning
  4. Loss Functions, Training Models, Gradients and Initialization, Measuring Performance, Regularization
  5. Recurrent Neural Networks, Convolutional Neural Networks
  6. Transformers
  7. Pretraining, Large Language Models and other multi-modal Foundational Models
  8. Generative Adversarial Networks, Variational Autoencoders
  9. Diffusion Models

Text and Reference Literature

  1. Simon J.D. Prince. Understanding Deep Learning. MIT Press. (2023).
  2. Ian J. Goodfellow, Yoshua Bengio, and Aaron Courville. Deep learning. MIT Press. (2016).