What are we actually doing with those features?
let’s look at that algebra again
p(fx | y, φX ) = N (fx ; φ!x µ + φ!x ΣφX (φ!X ΣφX + σ 2 I)−1 (y − φ!X µ),
φ!x Σφx − φ!x ΣφX (φ!X ΣφX + σ 2 I)−1 φ!X Σφx )
= N (fx ; mx + kxX (kXX + σ 2 I)−1 (y − mX ),
kxx − kxX (kXX + σ 2 I)−1 kXx )
using the abstraction / encapsulation
mx := φ!x µ m : X!R mean function
kab := φ!a Σφb k : X × X!R covariance function, aka. kernel
Probabilistic ML — P. Hennig, SS 2021 — Lecture 09: Gaussian Processes— © Philipp Hennig, 2021 CC BY-NC-SA 3.0 5