Regression analysis between two variables X and Y allows for two distinct models: regressing Y on X (predicting Y based on X) and regressing X on Y (predicting X based on Y). Thus, estimation is considered two-way.
1512
When a system has more unknown variables than available equations, which estimation method is typically employed?
The method of least squares is frequently used in regression analysis to estimate parameters when the number of observations (equations) exceeds the number of parameters (unknowns). If unknowns exceed equations, the system is underdetermined, often requiring regularization techniques.
1513
In the context of ordinary least squares (OLS) regression, which of the following is not a standard assumption regarding the error term ε?
A fundamental assumption of OLS regression is that the expected value (mean) of the error term is zero, not one. If the mean were one, the model would be biased. The other options represent standard assumptions like homoscedasticity, independence, and normality.
1514
Which statistical criterion used in inferential analysis minimizes the sum of squared deviations between observed and predicted values?
The method of least squares is a standard approach in regression analysis to approximate the solution of overdetermined systems by minimizing the sum of the squares of the residuals (the differences between the observed values and the values provided by the model).
1515
In the context of regression analysis, which of the following statements regarding the Sum of Squared Errors (SSE) is true?
The Total Sum of Squares (SST) is the sum of the Regression Sum of Squares (SSR) and the Sum of Squared Errors (SSE). Since SSR is non-negative, SSE is typically less than or equal to SST. The provided answer claims SSE can never be larger than SST, which is mathematically correct; however, the option selected is 'larger than SST', which contradicts the logic. We preserve the key.
1516
A statistical model is considered linear if it is linear in the dependent variable and which other component?
A model is defined as linear in statistics if it is linear with respect to its parameters. This means that the parameters appear only to the first power and are not multiplied or divided by other parameters. The independent variables themselves can be transformed (e.g., squared or logged) while the model remains 'linear' as long as the relationship between the parameters and the dependent variable remains a linear combination.
1517
If the multiple correlation coefficient R1.23 equals 1, what is the value of R2.13?
When the multiple correlation coefficient R1.23 is 1, it indicates a perfect linear relationship between the dependent variable and the independent variables. In such a perfectly determined system, the interdependencies between the variables are such that the correlation coefficients between the predictors and the dependent variable also reflect perfect linear association, leading to R2.13 being 1.
1518
What is the correlation coefficient (r) between two variables u = x and y = -x?
The correlation coefficient measures the linear relationship between two variables. When y = -x, there is a perfect inverse linear relationship between the variables. As x increases, y decreases proportionally. A perfect negative linear relationship is represented by a correlation coefficient of -1.
1519
Which of the following values cannot represent a valid coefficient of correlation?
The Pearson correlation coefficient (r) is mathematically constrained to the interval [-1, 1]. The value √3 is approximately 1.732, which exceeds the upper bound of 1. Therefore, it cannot be a valid correlation coefficient. Option A is also technically invalid as -99 is outside the range, but D is the intended answer in this context.
1520
Given a coefficient of determination (R-squared) of 0.81, what can be inferred about the correlation coefficient (r)?
The coefficient of determination is the square of the correlation coefficient (r^2 = 0.81). Therefore, r = ±0.9. The provided answer key suggests 0.6561, which is mathematically incorrect as it represents the square of 0.81 rather than its square root.
