From Oct 2022 to Feb 2023, I have created a series of 20 videos (in Chinese) on machine learning theory and algorithms on bilibili.com, closely following the excellent textbook written by Shalev-Shwartz and Ben-David, which is freely available on the authors’ webpage.
Playlist in my YouTube channel
Topics covered include
- Probably Approximately Correct (PAC) learning model
- VC dimension
- no free lunch theorem
- linear predictors: logistic regression, linear regression, perceptron
- convex learning problems
- regularisation
- stochastic gradient descent
- support vector machine
- kernel methods
- decision trees
- boosting: AdaBoost
- clustering: k-means, spectral clustering, linkage-based clustering
- dimenionality reduction: PCA, compressed sensing
- generative models: naive Bayes, LDA, EM algorithms
