The pseudo-inverse of the design matrix can be used to directly calculate the optimal weights of a linear model.

Prove: If the columns of the design matrix are linearly independent, then the matrix is invertible.

Hint: Prove first that if for an arbitrary vector , then .

Haeusler Stefan 2010-01-19