Session 5

Conditional density,
Conditional Expectation.
Bayesian Statistical Theory and Learning

Session 6

The Rule of Double Expectation Conditional variance, The Formula Var(Y) = E (Var(Y|X)) + Var( E(Y | X)) and its applications.  Conditional expectation w.r.t. a sigma-field.
Bias-Variance Decomposition of data science

Session 7

Characteristic function, examples and properties, table of formulas, characteristic function of a normal distribution.
Sums of a random number of random variables

Session 8

Probability generating function, examples and properties

Session 9

Concepts of convergence in probability theory,  
Convergence of sums and functions of random variables. Borel Cantelli, strong law of large numbers. Handout  

Session 10

Multivariate Gaussian variables

Session 11

Gaussian process, covariance kernel,
 the Wiener process

Session 12

Kernels, Gaussian Processes in Learning

COURSE OUTLINE

Session 3

Distribution functions.
 Multivariate random variables

Session 4

Multivariate random variables.
 Marginal density, Independence,
Density of a transformed random vector,
Exponential families of distributions

Session 2

Some Theorems of Probability calculus.
Probability on propositional logic.  
PAC-theory of machine learning 

Session 1

Sigma-fields,
Probability space.
Axioms of probability calculus

Session 13

Maximum likelihood. Model choice. Confidence intervals.
Confidence intervals for model choice in machine learning 

Session 14

More on Expected Risk Minimisation. Expectation – Maximisation Algorithm

Session 15

Data science and high dimensional data