Linear regression is possibly the most well-known machine learning algorithm. It tries to find a linear relationship between a given of set of input-output pairs. One notable aspect is that linear regression, unlike most of its peers, has a closed-form solution.
The mathematics involved in the derivation of this solution (also known as the Normal equation) is pretty basic.