Skip to main content
Search by keyword

MAI4CAREU - Natural Language Processing – Language Modeling

MAI4CAREU - Natural Language Processing – Language Modeling

The University of Cyprus's course on Natural Language Processing is part of the Master programmes in Artificial Intelligence 4 Careers in Europe (MAI4CAREU). One of Master's programme's courses is split up into several lectures and is taught by Demetris Paschalides from the Department of Computer Science, whose research interest is focused on the use of Natural Language Processing (NLP) and Machine Learning (ML) to address social and ethical challenges.

Learning outcomes 

This lecture on ‘Language Modeling’ follows a first short introductory lecture into the course, and a lecture on ‘Fundamental Text Pre-Processing’.

This lecture looks at:

  • Language models, their applications, and their importance within NLP 
  • Calculating the Sentence/Word Porbability P(W)
  • N-Gram Models: Uni-grams, Bi-grams, and Tri-grams
  • N-Gram Smoothing and Language Modeling Properties

The lecture illustrates the theory with a lot of practical examples, illustrations, and interactive diagrams to offer students a comprehensive understanding of the course material. The instructor also provides a list of resources for further learning.

Course outline

The Natural Language Processing course is divided into 7 subsections: 

  1. Text Pre-processing
  2. Language Modeling
  3. Text Classification
  4. Word Vector Representation
  5. Distributed Contextual Embeddings
  6. Application of NLP in:
    1. Hate-speech Identification
    2. Fake News Detection
    3. Political Polarization
  7. Introduction to Large Language Models
     

Learning content

Target audience
Digital skills in education.
Digital skill level
Geographic scope - Country
Austria
Belgium
Bulgaria
Cyprus