
- Linear algebra: vectors, matrices, and tensors — the data structures used to represent images, audio, and model parameters.
- Calculus: derivatives, gradients, and partial derivatives — the math of change used to optimize models and tune parameters.
- Gradient-based optimization and backpropagation: how models learn by propagating error gradients through layered architectures.
- Probability and statistics: modeling uncertainty, Bayes’ theorem, and statistical inference for decision-making and estimation.
- Practical examples and intuition: applying theory to real problems in machine learning, graphics, and optimization.
- Build and manipulate vector/matrix/tensor representations.
- Compute gradients and partial derivatives for multivariable functions.
- Explain and implement backpropagation and basic gradient descent algorithms.
- Use probability distributions and Bayes’ theorem to reason under uncertainty.
- Translate mathematical concepts into working code and model implementations.
- Vector and matrix operations: addition, scalar multiplication, dot products, and matrix multiplication.
- Matrix decompositions and their uses (conceptual overview).
- Tensors and higher-dimensional arrays used in deep learning frameworks.
- Single-variable derivatives and gradients.
- Partial derivatives for multivariable functions.
- Using gradients in optimization algorithms such as gradient descent.

- Gradient descent variants (batch, stochastic, mini-batch).
- Backpropagation: computing gradients efficiently through layered models.
- Practical considerations: learning rates, momentum, and convergence.

- Probability distributions and expectations.
- Bayes’ theorem and Bayesian thinking for updating beliefs.
- Statistical inference and hypothesis testing for data-driven decisions.

This course focuses on the core mathematical concepts that enable computing systems. Expect hands-on examples and intuitive explanations to help bridge theory and practice.
| Module | Core concepts | Practical examples |
|---|---|---|
| Linear Algebra | Vectors, matrices, tensors | Image representation, matrix transforms |
| Calculus | Derivatives, gradients, partial derivatives | Loss functions, sensitivity analysis |
| Optimization | Gradient descent, backpropagation | Training neural networks, tuning hyperparameters |
| Probability & Stats | Distributions, Bayes’ theorem, inference | Classification confidence, filtering noisy data |
- 3Blue1Brown — Essence of Linear Algebra (video series): https://www.3blue1brown.com/
- MIT OpenCourseWare — Linear Algebra: https://ocw.mit.edu/courses/18-06-linear-algebra/
- Deep Learning Book — Goodfellow, Bengio, Courville: https://www.deeplearningbook.org/
- Khan Academy — Calculus and Probability: https://www.khanacademy.org/