Mathematics for AI (Dr Tran Anh Tuan)

Wee Title Content

k
1 Introduction to - Overview of AI Applications
Mathematics for AI - Overview of Applied Mathematics
- Introduction to Algebra
- Introduction to Calculus
- Introduction to Statistics and Probabilities
- Introduction to Graph Theory
- Introduction to Information Theory
- Introduction to Optimization
2-3 Linear Algebra - Matrices and Vectors
- Inner Products
- Matrix Multiplication
- Orthogonal and Diagonal Matrix
- Transpose Matrix and Inverse Matrix in
Normal Equation
- Solving Systems of Linear Equations
- L1 norm or Manhattan Norm
- L2 norm or Euclidean Norm
- Regularization in Machine Learning
- Lasso and Ridge
- Feature Extraction and Feature Selection
- Covariance Matrix
- Eigenvalues and Eigenvectors
- Orthogonality and Orthonormal Set
- Span, Vector Spaces, Rank and Basis
- Determinant and Trace
- Principal Component Analysis (PCA)
- Singular Value Decomposition
- Matrix Decomposition or Matrix
Factorization
- Affine Spaces
4-5 Calculus - Derivative
- Partial derivative
- Second derivative
- Hessian matrix
- Gradient
- Gradient descent
- Critical points
- Stationary points
- Local maximum
- Global minimum
- Saddle points
- Jacobian matrix
6 Statistics and Probabilities - What Is Data?
- Categories Of Data
- What Is Statistics?
- Basic Terminologies In Statistics
- Sampling Techniques
- Types Of Statistics
Descriptive Statistics
- Measures Of Centre
- Measures Of Spread
- Information Gain And Entropy
- Confusion Matrix
Probability
- What Is Probability?
- Terminologies In Probability
- Probability Distribution
- Types Of Probability
- Bayes’ Theorem
- Gaussian Distribution
- Conjugacy and the Exponential Family
Inferential Statistics
- Point Estimation
- Interval Estimation

7 Graph Theory
8 Information Theory
9 Continuous Optimization
10 Linear Regression
11 Dimensional Reduction
with PCA
- Estimating Level Of Confidence
- Hypothesis Testing
- Directed and Undirected Graph
- Path analysis
- Connectivity analysis
- Community analysis:
- Centrality analysis
- Information
- Self-Information
- Entropy
- Mutual Information (Joint Entropy,
Conditional Entropy )
- Kullback–Leibler Divergence
- Cross Entropy
- Cross Entropy as An Objective Function of
Multi-class Classification
- Optimization using Gradient Descent
- Constrained Optimization and Lagrange
Multipliers
- Convex Optimization
- Problem Formulation
- Parameter Estimation
- Bayesian Linear Regression
- Maximum Likelihood as Orthogonal
Projection
- Maximum Variance Perspective
- Projection Perspective
- Eigenvector Computation and Low-Rank
Approximations
- PCA in High Dimensions
- Latent Variable Perspective
12 Density Estimation with
Gaussian Mixture Models
13 Classification with Support
Vector Machine
14 Outlier Detection
15 Recommendation System
- Gaussian Mixture Model
- Parameter Learning via Maximum
Likelihood
- EM Algorithm
- Latent-Variable Perspective
- Separating Hyperplanes
- Primal Support Vector Machine
- Dual Support Vector Machine
- Kernel
- Numerical Solution
- Interquartile Range (IQR)
- Isolation Forest
- Minimum Covariance Determinant
- Local Outlier Factor
- One-Class SVM
- Singular value decomposition techniques -
svd
- Hybrid and context aware recommender
systems
- Factorization machines