Introduction to machine learning. |
Logistics, Slides, Notes, Scribbles | Bishop section 1.1 | Computing Machinery and Intelligence Probability Review-1 Probability Review-2 Linear Algebra Review |
||
Introduction to machine learning. |
Notes, Scribbles | Bishop section 1.1, HTF section 2.3 |
|||
Statistical Decision Theory. |
Notes, Scribbles | HTF section 2.4, 2.5 | Singular Value Decomposition. Tutorial-1: Intro to Python. 14 Sep 6pm-8pm at ENGMC 304. |
||
Linear Regression, Gradient Descent. |
Notes, Scribbles | Bishop section 3.1 | |||
Bias-variance tradeoff, Regularization. |
Notes, Scribbles | Bishop section 1.5.5, 3.1.4, 3.2 HTF section 3.4.1, 3.4.2 |
Linear Algebra review (7.1) in this pdf Lagrange Multiplier (Appendix E in Bishop) |
||
Linear Classification. |
Notes, Scribbles | Bishop section 1.5.4, 4.1.1, 4.1.2 | |||
Indicator Regression, PCA, LDA. |
Notes, Scribbles | Bishop section 4.1.3, 4.1.4 this pdf for pca. |
Intro to convex optimization (page 91 to 102 in this book) | ||
Election Day. |
Tutorial-2: Intro to scikit-learn. 03 Oct 6pm-8pm at ENGMC 204. | ||||
GLMs, GDA, Evaluation metrics for classification. |
Notes, Scribbles | Bishop section 4.2 | No new reading. Finish previous reading. | ||
Thanksgiving. |
|||||
Naive Bayes, Logistic Regression |
Notes, Scribbles | Bishop section 4.2.3, 4.3, 3.1.1. | Generative and discriminative classifiers by Tom Mitchell. | ||
Logistic Regression, Newton-Raphson Method. |
Notes, Scribbles | Bishop section 4.3.3, 1.5.4. | |||
Perceptron. |
Notes, no scribble. | Bishop section 4.1.7 HTF section 4.5 |
Bishop section 2.3 Tutorial-2: Intro to scikit-learn. 22 Oct 6pm-8pm at ENGMC 204. |
||
Separating hyperplane, SVM. |
Notes, Scribbles | Bishop section 7.1 | |||
SVM, Non parametric Methods. |
Notes, Scribbles | Bishop section 7.1.2 | A Few Useful Things to Know about Machine Learning by Pedro Domingos | ||
Decision Trees. |
Notes, Scribbles | TSKK section 3.3 Mitchell Chapter 3 |
|||
Ensemble Learning: Bagging, Boosting. |
Notes, Scribbles | Bishop Chapter 14 | No new reading. Finish previous reading. | ||
Stacking, Neural Networks. |
Notes, Scribbles | Bishop Chapter 14, stacking paper |
|||
Backpropagation Algorithm |
Notes | Rojas Chapter 7. | Efficient Backprop by LeCun et al. | ||
No Class. |
|||||
Training Deep Neural Nets, Optimization. |
Notes | [1], [2], [3] Optimization-1, Optimization-2 |
Optimization-1, Optimization-2 | ||
Convnets |
Notes | ConvNets | |||
Recurrent Neural Networks. |
Notes | GBC Chapter 10. | LSTMs, ConvNets | ||
MLE, MAP, Bayesian Learning. |
Notes | Parameter Estimation | |||
Bayesian Linear Regression. |
Notes | Bishop section 3.3 | No new reading. Focus on your project. | ||
Kernel Methods, Gaussian Processes. |
Notes | Bishop section 6.1, 6.2, 6.4 | |||
Frontiers in ML, What Next? |
Notes | No new reading. Focus on your project. |