Natural Language Processing - CS60075

Spring Semester - 2022-23

Instructor

Pawan Goyal

Course Timings

Lectures

Monday - 10:00 - 10:55 (NC 443)

Wednesday - 08:00 - 09:55 (NC 443)

Teaching Assistants

Aniruddha Roy, Abhilash Nandy, Ankan Mullick, Sourjyadip Ray, Akash Ghosh, Kalyani Roy

Lecture Material

The lecture material of the course will be uploaded every week.

Announcements

The course will start from Jan 4th from 8-10 AM.

Reference Books

  1. Daniel Jurafsky and James H. Martin. 2021. Speech and Language Processing. 3rd Edition (draft)
  2. Christopher D. Manning and Hinrich Schütze. 1999. Foundations of Statistical Natural Language Processing. MIT Press.
  3. Yoav Goldberg. A Primer on Neural Network Models for Natural Language Processing Online.

Course Contents

Major Components of the Course include
  1. Introduction: What is NLP? Why is it Hard?
  2. Representing Word Meaning: Distributional Semantics, Word Embeddings
  3. Language Modeling, Recurrent Neural Networks (RNNs) based Language Modeling, LSTMs, GRU
  4. RNNs for Sequence Tagging, Text Classification, Sequence to Sequence
  5. Transformers and Pretraining: BERT, GPT, BART, T5
  6. Applications: Question Answering, Summarization, Dialog Modeling
  7. Analysis and Interpretability
  8. Prompt-based methods, low-resource and multilingual NLP