MAI4CAREU - Natural Language Processing – Language Modeling
The University of Cyprus's course on Natural Language Processing is part of the Master programmes in Artificial Intelligence 4 Careers in Europe (MAI4CAREU). One of Master's programme's courses is split up into several lectures and is taught by Demetris Paschalides from the Department of Computer Science, whose research interest is focused on the use of Natural Language Processing (NLP) and Machine Learning (ML) to address social and ethical challenges.
Learning outcomes
This lecture on ‘Language Modeling’ follows a first short introductory lecture into the course, and a lecture on ‘Fundamental Text Pre-Processing’.
This lecture looks at:
- Language models, their applications, and their importance within NLP
- Calculating the Sentence/Word Porbability P(W)
- N-Gram Models: Uni-grams, Bi-grams, and Tri-grams
- N-Gram Smoothing and Language Modeling Properties
The lecture illustrates the theory with a lot of practical examples, illustrations, and interactive diagrams to offer students a comprehensive understanding of the course material. The instructor also provides a list of resources for further learning.
Course outline
The Natural Language Processing course is divided into 7 subsections:
- Text Pre-processing
- Language Modeling
- Text Classification
- Word Vector Representation
- Distributed Contextual Embeddings
- Application of NLP in:
- Hate-speech Identification
- Fake News Detection
- Political Polarization
- Introduction to Large Language Models