Home Courses Microsoft Malware Detection Curse of dimensionality

Curse of dimensionality

Instructor: Applied AI Course Duration: 21 mins

This content is restricted. Please Login

Prev
Next
Handling missing values by imputation
Bias-Variance tradeoff
1.1
Dataset overview: Amazon Fine Food reviews(EDA)
23 min
1.2
Data Cleaning: Deduplication
15 min
1.3
Why convert text to a vector?
14 min
1.4
Bag of Words (BoW)
18 min
1.5
Text Preprocessing: Stemming, Stop-word removal, Tokenization, Lemmatization.
15 min
1.6
uni-gram, bi-gram, n-grams.
9 min
1.7
tf-idf (term frequency- inverse document frequency)
22 min
1.8
Why use log in IDF?
14 min
1.9
Word2Vec.
16 min
1.10
Avg-Word2Vec, tf-idf weighted Word2Vec
9 min
1.11
Bag of Words( Code Sample)
19 min
1.12
Text Preprocessing( Code Sample)
11 min
1.13
Bi-Grams and n-grams (Code Sample)
5 min
1.14
TF-IDF (Code Sample)
6 min
1.15
Word2Vec (Code Sample)
12 min
1.16
Avg-Word2Vec and TFIDF-Word2Vec (Code Sample)
2 min
1.17
Exercise: t-SNE visualization of Amazon reviews with polarity based color-coding
6 min
2.1
How “Classification” works?
10 min
2.2
Data matrix notation
7 min
2.3
Classification vs Regression (examples)
6 min
2.4
K-Nearest Neighbours Geometric intuition with a toy example
11 min
2.5
Failure cases of KNN
7 min
2.6
Distance measures: Euclidean(L2) , Manhattan(L1), Minkowski, Hamming
20 min
2.7
Cosine Distance & Cosine Similarity
19 min
2.8
How to measure the effectiveness of k-NN?
16 min
2.9
Test/Evaluation time and space complexity
12 min
2.10
KNN Limitations
9 min
2.11
Decision surface for K-NN as K changes
23 min
2.12
Overfitting and Underfitting
12 min
2.13
Need for Cross validation
22 min
2.14
K-fold cross validation
17 min
2.15
Visualizing train, validation and test datasets
13 min
2.16
How to determine overfitting and underfitting?
19 min
2.17
Time based splitting
19 min
2.18
k-NN for regression
5 min
2.19
Weighted k-NN
8 min
2.20
Voronoi diagram
4 min
2.21
Binary search tree
16 min
2.22
How to build a kd-tree
17 min
2.23
Find nearest neighbours using kd-tree
13 min
2.24
Limitations of Kd tree
9 min
2.25
Extensions
3 min
2.26
Hashing vs LSH
10 min
2.27
LSH for cosine similarity
40 min
2.28
LSH for euclidean distance
13 min
2.29
Probabilistic class label
8 min
2.30
Code Sample:Decision boundary .
23 min
2.31
Code Sample:Cross Validation
13 min
2.32
Exercise: Apply k-NN on Amazon reviews dataset
5 min
4.1
Accuracy
15 min
4.2
Confusion matrix, TPR, FPR, FNR, TNR
25 min
4.3
Precision and recall,F1 score
10 min
4.4
Receiver Operating Characteristic Curve (ROC) curve and AUC
19 min
4.5
Log-loss
12 min
4.6
R-Squared/Coefficient of determination
14 min
4.7
Median absolute deviation (MAD)
5 min
4.8
Distribution of errors
7 min
5.1
Geometric intuition of Logistic Regression
31 min
5.2
Sigmoid function: Squashing
37 min
5.3
Mathematical formulation of Objective function
24 min
5.4
Weight vector
11 min
5.5
L2 Regularization: Overfitting and Underfitting
26 min
5.6
L1 regularization and sparsity
11 min
5.7
Probabilistic Interpretation: Gaussian Naive Bayes
19 min
5.8
Loss minimization interpretation
24 min
5.9
Hyperparameter search: Grid Search and Random Search
16 min
5.10
Column Standardization
5 min
5.11
Feature importance and Model interpretability
14 min
5.12
Collinearity of features
14 min
5.13
Test/Run time space and time complexity
10 min
5.14
Real world cases
11 min
5.15
Non-linearly separable data & feature engineering
28 min
5.16
Code sample: Logistic regression, GridSearchCV, RandomSearchCV
23 min
5.17
Exercise: Apply Logistic regression to Amazon reviews dataset.
6 min
5.18
Extensions to Logistic Regression: Generalized linear models
9 min
6.1
Differentiation
29 min
6.2
Online differentiation tools
8 min
6.3
Maxima and Minima
12 min
6.4
Vector calculus: Grad
10 min
6.5
Gradient descent: geometric intuition
19 min
6.6
Learning rate
8 min
6.7
Gradient descent for linear regression
8 min
6.8
SGD algorithm
9 min
6.9
Constrained Optimization & PCA
6 min
6.10
Logistic regression formulation revisited
6 min
6.11
Why L1 regularization creates sparsity?
17 min
6.12
Exercise: Implement SGD for linear regression
6 min