This homework is to practice on the basics of the simple linear regression. Total: 90 points.
(30 points) Understanding the simple linear regression model.
(10 pt) When asked to state the simple linear regression model, a student wrote it as follows: E(Yi) = 0 + 1Xi + "i. Do you agree? Why?
(20 pt) Consider the normal error simple linear regression model. Suppose that the parameter values are 0 = 49, 1 = 4, and = 3. State the distributions of Y at X = 10; 24; and 38, and brie y explain why.
(35 points) Data analysis. We are interested in establishing the relationship between weight and height of men. We set weight as the response variable and use height as the predictor variable. We are provided by researchers 150 pairs of observations collected by them and the data is in \weight full.txt" on canvas.
(10 pt) Draw a scatter plot using R with height on x-axis and weight on the y-axis. Use proper labels on both axes. Report what you feel on the data.
(15 pt) Calculate the least squares estimates of the intercept and slope using formulas given in the lecture. Add the estimated line onto the plot in (a). Does the line look like to t the data well?
(5 pt) Report the values of X and Y . Does the line you obtain in (b) pass through the
point (X; Y )?
(d) (5 pt) Report the following four quantities:
n
n
n
n
X
X
Xi
X
(Xi
XiYi:
(Xi X)(Yi
Y );
X)Yi;
Xi(Yi Y );
i=1
i=1
=1
i=1
Are they all the same? If not, are some of them the same?
(25 points) Rigorous deviations.
(10 pt) Based on part (c) in Problem 2, do you think the statement \The least squares
line in simple linear regression always passes the center of the data (X; Y )" is correct? If so, show it rigorously.
(15 pt) If you found the some quantities in part (d) of Problem 2 to be the same, are these quantities always the same no matter what Xi’s and Yi’s are? If so, show it rigorously.
1
