The University of Cyprus's MSc Deep Learning is part of the Master programmes in Artificial Intelligence 4 Careers in Europe (MAI4CAREU). One of Master's programme's courses, MAI642 - Deep Learning is split up into several lectures and is taught by Associate Professor Theocharis Theocharides. The seventh lecture will focus on the objectives and need for further optimization of deep neural network models. Students will learn various techniques to improve model training and performance.

This lecture focuses on - Optimization of Deep Neural Networks, and in particular :

• Understanding the role of optimization algorithms such as stochastic gradient descent (SGD) and its variants like Adam and RMSprop
• Regularization techniques like dropout and batch normalization
• Strategies for hyperparameter tuning, such as grid search and random search, to fine-tune model performance
• Learning rate scheduling and early stopping to further optimize model training

Course content and schedule 

The MAI642 - Deep Learning course is spread out over 13 weeks of lectures, which are split into 13 lectures covering 4 broader topics:

• Week 1-3: Basics 
• Week 4: Fundamentals of Deep (Convolutional) Learning 
• Week 5-9: Deep Neural Networks – Deep into deep learning 
• Week 10-13: Emerging Deep Learning research and applications The course then wraps up with a comprehensive final exam.