EECS 498: Principles of Machine Learning, Fall 2021
(listed in alpha beta order, please contact Prof. Qing Qu for more details)
Teaching Assistant: TBA
Title: Principles of Machine Learning
Course Time: Mon/Wed 1:30 PM – 3:00 PM, 3 credit hour
Office Hour: TBA
Notice: This class is an entry-level undergraduate course in machine learning mainly targeted for senior undergraduate and master students in the ECE program. This course could have a significant overlap with EECS 445, but with more emphasis on mathematical principles.
Overview: The class will cover basic principles in machine learning, such as unsupervised learning (e.g., clustering, mixture models, dimension reduction), supervised learning (e.g., regression, classification, neural networks & deep learning), and reinforcement learning. For each topic, key algorithmic ideas/intuitions and basic theoretical insights will be highlighted.
Course Materials: slides and videos will be accessed via Canvas (TBA). Tentative topics that will be covered in this course:
- Basics of probability, linear algebra, and optimization
- Dimension reduction: PCA and kernel PCA
- Unlock relations: ICA and CCA
- Clustering (spectral, hierarchical)
- Generative models (GMM, GAN, variational autoencoder)
- Regression and linear prediction
- Support vector machines and kernel methods
- Neural networks
- Online/reinforcement learning
Assessment: (i) homework assignment (bi-monthly, 40%), (ii) mid-term exam (30%), (iii) Final exam (30%)
Textbook: We recommend the following books and articles, although we will not follow them closely.
- Foundations of Machine Learning, by Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar.
- The Elements of Statistical Learning: Data Mining, Inference, and Prediction, by Trevor Hastie, Robert Tibshirani, and Jerome Friedman.
- Deep Learning, by Ian Goodfellow, Yoshua Bengio, and Aaron Courville.
- Mathematics for Machine Learning, by Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong.
- Linear Algebra and Optimization for Machine Learning, by Charu C. Aggarwal.
- EECS 445. Introduction to Machine Learning
- EECS 453. Applied Matrix Algorithms for Signal Processing, Data Analysis, and Machine Learning
- EECS 505. Computational Data Science and Machine Learning
- EECS 545. Machine Learning