Learning Outcomes
Participants should learn basic concepts, their theoretical foundation, and the most common algorithms used in machine learning and artificial intelligence. After completing the module, participants should understand strengths and limitations of the different paradigms, should be able to correctly and successfully apply methods and algorithms to real world problems, should be aware of performance criteria, and should be able to critically evaluate results obtained with those methods. More specifically, participants should be able to demonstrate:
1) Knowledge of theory and methods of inductive learning
2) Application to problems of regression and classification (pattern recognition)
3) Understanding regarding basic concepts of neural information processing
4) Understanding regarding theoretical foundations to develop new machine learning techniques
Content
1) Foundations of inductive learning: empirical risk minimization, structural risk minimization, Bayesian inference
2) Learning and generalisation: gradient-based optimization, overfitting-underfitting, regularisation, application to regression and classification problems
3) Artificial neural networks (connectionist neurons, multilayer perceptrons, radial basis functions, deep networks, recurrent networks)
4) Statistical learning theory and support vector machines
5) Probabilistic methods and graphical models: reasoning under uncertainty, Bayesian learning for neural networks
6) Reinforcement Learning (MDP, value iteration, policy iteration, Q-learning)
Description of Teaching and Learning Methods
Lecture: Teaching in front of the class to convey the content.
Exercise: Discussion of exercises which cover the mathematical derivation and analysis of neuronal methods as well as the implementation and practical usage of these methods.
Registration Procedures
The registration for the written exam is possible at the end of the term through the electronic system of TU Berlin (QISPOS) or alternatively in written form via the examination office. The written exam is held in English. The examination procedure is regulated by the General Examination Regulation of the TU Berlin (AllgStuPO) and by the Examination Regulation of the Master Program Computational Neuroscience.
Further information regarding registration and course material are available via the respectively current ISIS course.
