Data Scientist Greg Hogg clearly explains the difference between Absolute Error and Squared Error, and why MSE is vital for calculus-based optimization.
Line of Best Fit
Drag the white points or adjust the sliders to see how the penalty squares visually expand.