TENTATIVE EEL 6825 COURSE OUTLINE
08/23 L01 Introduction
08/25 L02 Bayes Decision Rule, 1D example, Bayes error is optimal
08/28 L03 Univariate Normal, multivariate, covariance matrix,
eigenvectors/values
08/30 L04 Mahalanobis distance, plotting equiprob distributions,
linear transforms.
09/01 L05 General quadratic decision boundaries
sigma_i same => linear boundaries
09/04 LABOR DAY
09/06 L06 Review HW#1 questions,
How to compute and estimate error, Bhatacharrya bound
09/08 L07 HW#1 due, Generating random Gaussian data,
review linear transforms, Orthonormal transform,
distance is preserved
09/11 L08 whitening, distance is not preserved
simultaneous diagonalization
09/13 L09 Maximum Liklihood estimates of mean and variance
bias, consistency
09/15 L10 Finish max liklihood, MAP
09/18 L11 Bayesian Estimation
09/20 L12 HW#2 questions, Introductions to Linear Classifiers,
geometric interp.
09/22 L13 HW#2 due, Fisher Criterion
extend Fisher to multi-dim
nonlinear features
quadratic classifier
09/25 L14 Linear classifiers
09/27 L15 resubstitution, hold-out, leave-one-out
test set vs. training set
bad use of test and training
How much data do you need?
how much data for classifier, for estimating error?
09/29 L16 Review for Exam 1
10/02 NO CLASS--Exam 1, in NEB101, period E1-E3 (7:20pm-10:10pm)
10/04 L17 Parzen Windows (Dr. Zhao)
10/06 L18 Parzen Windows, (Dr. Zhao)
10/09 L19 1-NN
10/11 L20 1-NN, K-NN
10/13 L21 error of 1-NN
10/16 L22 Go over Exam I
10/18 L23 HW#3 questions, Projects handout
10/20 L24 HW#3 due, begin to motivate neural networks, perceptron,
linear system solution
10/23 L25 single-layer perceptron
10/25 L26 multi-layer perceptrons
10/27 L27 backpropagation learning
10/30 L28 KL dimensionality reduction
11/01 L29 KL dimensionality reduction
11/03 L30 HW#4 questions, KL summary and examples
11/06 L31 HW#4 due, Alternative Dimensionality Reduction Methods
11/08 L32 HW#4 due, Review for Exam 2
11/10 HOMECOMING, NO CLASS
11/13 NO CLASS--Exam 2, in NEB202, period E1-E3 (7:20pm-10:10pm)
11/15 L33 Unsupervised learning and clustering
11/17 L34 Speech applications
11/20 L35 Go over Exam 2
11/22 THANKSGIVING VACATION, NO CLASS
11/24 THANKSGIVING VACATION, NO CLASS
11/27 L36 Project questions
11/29 L37 FINAL PROJECTS
12/01 L38 FINAL PROJECTS
12/04 L39 FINAL PROJECTS
12/06 L40 FINAL PROJECTS