Ordinary Least Squares Multivariate Proof
The model is constructed like:
where:
y and ε are vectors of size n
β is a vector of size p
X is a matrix of shape n by p
This is estimated as:
with the constraint:
The partial derivative of this constraint with regard to b is calculated like: