Theoretical Concepts of Machine Learning (2VL)
Course no.: | 365.041 |
Lecturer: | Ulrich Bodenhofer |
Dates and Times: | Wed, Oct 3, 2012, 1:45pm-3:15pm Wed, Oct 10, 2012, 1:45pm-4:15pm Wed, Oct 17, 2012, 1:45pm-4:15pm Wed, Oct 24, 2012, 1:45pm-3:15pm Wed, Oct 31, 2012, 1:45pm-4:15pm No lecture on November 7! Wed, Nov 14, 2012, 1:45pm-3:15pm Wed, Nov 21, 2012, 1:45pm-4:15pm Wed, Nov 28, 2012, 1:45pm-3:15pm Wed, Dec 5, 2012, 1:45pm-4:15pm Wed, Dec 12, 2012, 1:45pm-3:15pm Wed, Jan 9, 2013, 1:45pm-4:15pm Wed, Jan 16, 2013, 1:45pm-3:15pm Wed, Jan 23, 2013, 1:45pm-4:15pm Wed, Jan 30, 2013, 1:45pm-3:15pm |
Location: | MT 327 |
Mode: | VL, 2h, weekly |
Registration: | KUSSS |
Motivation
Machine learning methods, i.e. methods that infer models/relationships by learning from data, are still gaining importance in various fields, such as, process modeling, speech and image processing, bioinformatics, and so forth. Their ability to cope with tasks for which no analytical model is available ideally complements classical approaches. One has to acknowledge, however, that machine learning methods also bear great risks if they are applied inappropriately. The given lecture provides a look behind the curtain of machine learning. The goal is to make students acquainted with the basic concepts and methods to analyze, evaluate and understand models created by machine learning. In the sequel, we will also have a closer look at support vector machines and neural networks from this foundational perspective.Contents
- Repetition of the basic concepts of machine learning
- Evaluation criteria
- Statistical learning theory
- Support vector machines: advanced topics and applications
- Neural networks: short overview
Necessary Background
Parts of the lecture will be quite mathematical, so a profound background in calculus, probability and statistics is necessary. This should not be a problem for graduate students of mathematics, computer science, physics, mechatronics, and statistics. Prior knowledge of machine learning (e.g. attendance of Prof. Widmer's lecture "Machine Learning and Pattern Classification") is surely helpful, but not an absolute pre-requisite. Students of bioinformatics should take into account that there is a significant overlap with the lecture "Bioinformatics II: Theoretical Bioinformatics and Machine Learning".Course Material
Slides
- Introduction
pages i-xii; last update 2012-12-12; [PDF, 191KB] - Unit 1: Introduction to Machine Learning
pages 1-28; last update 2012-09-24; [PDF, 741KB] - Unit 2: Model Evaluation in Supervised Machine Learning
pages 29-113; last update 2012-09-24; [PDF, 741KB] - Unit 3: Statistical Learning Theory
pages 114-164; last update 2012-09-24; [PDF, 741KB] - Unit 4: Support Vector Machines
pages 165-299; last update 2012-09-24; [PDF, 741KB] - Unit 5: Artificial Neural Networks
pages 300-326; last update 2012-09-24; [PDF, 741KB]
© 2012 Ulrich Bodenhofer
This material, no matter whether in printed or electronic form, may be used for personal and educational use
only. Any reproduction of this material, no matter whether as a whole or in parts, no matter whether in printed or in
electronic form, requires explicit prior acceptance of the author.
Software demos
Notes for further reading
- Lecture Notes Bioinformatics II (PDF, 8.3MB)
Books recommended for further reading
- C. M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, 1995. ISBN 0-19-853864-2. [link]
- R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. Second edition. John Wiley & Sons, 2001. ISBN 0-471-05669-3. [link]
- T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer, 2001. ISBN 0-387-95284-5. [link]
- R. Herbrich. Learning Kernel Classifiers. MIT Press, 2002. ISBN 0-262-08306-X. [link]
- B. Schölkopf and A. J. Smola. Learning With Kernels. MIT Press, 2002. ISBN 0-262-19475-9. [link]
- V. N. Vapnik. The Nature of Statistical Learning Theory. Springer, 1995. ISBN 0-387-98780-0. [link]
- V. N. Vapnik. Statistical Learning Theory. John Wiley &Sons, 1998. ISBN 0-471-03003-1. [link]