CS60075: Natural Language Processing

Course Timings ( NR411 Nalanda Classroom Complex )

Content

What is this course about?

Natural language processing (NLP) or computational linguistics is one of the most important technologies of the information age. Applications of NLP are everywhere because people communicate almost everything in language: web search, advertising, emails, customer service, language translation, virtual agents, medical reports, etc. In recent years, Deep Learning approaches have obtained very high performance across many different NLP tasks, using single end-to-end neural models that do not require traditional, task-specific feature engineering. In this course, students will gain a thorough introduction to cutting-edge research in Deep Learning for NLP. Through lectures, assignments and a final project, students will learn the necessary skills to design, implement, and understand their own neural network models, using the PyTorch framework.

Prerequisites

• Proficiency in Python
  All class assignments will be in Python (using NumPy and PyTorch). If you have a lot of programming experience but in a different language, you will probably be fine.
• College Calculus, Linear Algebra
  You should be comfortable taking (multivariable) derivatives and understanding matrix/vector notation and operations.
• Basic Probability and Statistics
  You should know basics of probabilities, gaussian distributions, mean, standard deviation, etc.
• Foundations of Machine Learning
  We will be formulating cost functions, taking derivatives and performing optimization with gradient descent. Knowing basic ML concepts will be very helpful.

Plagiarism policy

• Plagiarism in any form - copying from other students or from online resources - will be severely penalized. Every assignment should be done individually or in designated groups. Also you should not use / copy any code that is available online.
• While you can discuss the concepts and assignments with other students/groups, you should NOT share your code/answers for any assignment with any other student (or with students outside your designated group), until the grading of the assignment is completed. It is your responsibility to ensure that your codes/answers are not available to others.
• We will use standard plagiarism detection software to check the similarity of submitted assignments. If we find submissions that are too similar (beyond what can be expected by chance, or due to discussion), all such submissions will be severely penalized. We will NOT attempt to differentiate between who gave the codes and who copied; all involved students will be penalized equally. The minimum penalty for plagiarism in an assignment is a zero on that assignment. There can be more severe penalties for repeat offences, including grade reduction and de-registration from the course.