Глубинное обучение (курс лекций)/2020
Материал из MachineLearning.
This is an introductory course on deep learning models and their application for solving different applied problems of image and text analysis.
Instructors: Dmitry Kropotov, Victor Kitov, Nadezhda Chirkova, Oleg Ivanov and Evgeny Nizhibitsky.
The timetable in Autumn 2020: Fridays, lectures begin at 10-30, seminars begin at 12-15, zoom-link
Lectures and seminars video recordings: link
Anytask invite code: ldQ0L2R
Course chat in Telegram: link
Rules and grades
TBA
Exam
Exam questions + theoretical minimum
Student presentations
Each student may prepare a presentation on some recent DL topic. This activity is compulsory for the final course grade 5 and optional for all the other cases. Presentation must be in English, 10-minutes long and cover some papers from the last 3 years (2018, 2019 and 2020). Please register for particular talk on either 11th or 18th of December here. The maximum capacity for each of two days - 12 presentations.
Lectures and seminars
Date | No. | Topic | Materials |
---|---|---|---|
11 Sep. 2020 | 1 | Introduction. Fully-connected networks. | |
Matrix calculus, automatic differentiation. | Synopsis | ||
18 Sep. 2020 | 2 | Stochastic optimization for neural networks, drop out, batch normalization. | |
Convolutional neural networks, basic architectures. | Presentation | ||
25 Sep. 2020 | 3 | Pytorch and implementation of convolutional neural networks. | ipynb 1 ipynb 2 |
02 Oct. 2020 | 4 | Semantic image segmentation. | Presentation (pdf) Portrait Demo (source) |
09 Oct. 2020 | 5 | Object detection. | Presentation (pdf) DS Bowl 2018 (pdf) |
16 Oct. 2020 | 6 | Neural style transfer. | Presentation |
23 Oct. 2020 | 7 | Recurrent neural networks. | Presentation |
30 Oct. 2020 | 8 | Recurrent neural networks memory and attention mechanisms. | |
06 Nov. 2020 | 9 | Reinforcement learning. Q-learning. DQN model. | |
13 Nov. 2020 | 10 | Policy gradient in reinforcement learning. REINFORCE and A2C algorithms. | |
Reinforcement learning implementation and multi-armed bandits. | RL notebook Multi-Agent Hide and Seek video Bandits notebook Bayesian Bandit Explorer | ||
20 Nov. 2020 | 11 | Generative adversarial networks | Part1 Part2 |
27 Nov. 2020 | 12 | Variational Autoencoders | |
04 Dec. 2020 | 13 | Reparameterization methods | |
11 Dec. 2020 | 14 | Student presentations | |
18 Dec. 2020 | 15 | Student presentations |