Session 5
Conditional density,
Conditional Expectation.
Bayesian Statistical Theory and Learning
Session 6
The Rule of Double Expectation Conditional variance, The Formula Var(Y) = E (Var(Y|X)) + Var( E(Y | X)) and its applications. Conditional expectation w.r.t. a sigma-field.
Bias-Variance Decomposition of data science
Session 7
Characteristic function, examples and properties, table of formulas, characteristic function of a normal distribution.
Sums of a random number of random variables
Session 8
Probability generating function, examples and properties
Session 9
Concepts of convergence in probability theory,
Convergence of sums and functions of random variables. Borel Cantelli, strong law of large numbers. Handout
Session 10
Multivariate Gaussian variables
Session 11
Gaussian process, covariance kernel,
the Wiener process
Session 12
Kernels, Gaussian Processes in Learning
COURSE OUTLINE
Session 3
Distribution functions.
Multivariate random variables
Session 4
Multivariate random variables.
Marginal density, Independence,
Density of a transformed random vector,
Exponential families of distributions
Session 2
Some Theorems of Probability calculus.
Probability on propositional logic.
PAC-theory of machine learning
Session 1
Sigma-fields,
Probability space.
Axioms of probability calculus
Session 13
Maximum likelihood. Model choice. Confidence intervals.
Confidence intervals for model choice in machine learning
Session 14
More on Expected Risk Minimisation. Expectation – Maximisation Algorithm
Session 15
Data science and high dimensional data