Assume that we have i.i.d data (x1,y1),...,(xn,yn), where yi is the response variable and xi is the covariate. For simplicity, let us consider the case that xi is univariate. We fit a simple linear regression without intercept,