MAI4CAREU - Deep Learning - Transfer Learning and Residual Neural Networks

The University of Cyprus's MSc Deep Learning is part of the Master programmes in Artificial Intelligence 4 Careers in Europe (MAI4CAREU). One of Master's programme's courses, MAI642 - Deep Learning is split up into several lectures and is taught by Associate Professor Theocharis Theocharides. This sixth lecture introduces transfer learning for deep neural networks, where students are introduced to the concept of leveraging pre-trained models for new tasks, reducing the need for large labelled datasets and computational resources.
This lecture focuses on Transfer Learning and Neural Networks, and in particular :
- Transfer learning for deep neural networks
- Introduction of Residual networks (ResNets)
- ResNets degradation problems
Course content and schedule
The MAI642 - Deep Learning course is spread out over 13 weeks of lectures, which are split into 13 lectures covering 4 broader topics:
Week 1-3: Basics
Week 4: Fundamentals of Deep (Convolutional) Learning
Week 5-9: Deep Neural Networks – Deep into deep learning
Week 10-13: Emerging Deep Learning research and applications The course then wraps up with a comprehensive final exam.