Page 1 of 1
When is R square significant?
Posted: September 1st, 2010, 8:43 am
by Fnut
Hi,This question is usually subjective, and people always have in mind some arbitrary levels over which the R square shows a significant regression.Is there a way to know if the R-square is good enough for a particular regression?Thanks,
When is R square significant?
Posted: September 1st, 2010, 11:28 am
by Traden4Alpha
Yes, the queston usually is subjective but it shouldn't be. (Hint: run far away from anyone who uses fixed standards for "poor"-"good"-"excellent" R-square values)If your variables are bivariate normal, then the Fisher transformation is very useful tool.
When is R square significant?
Posted: September 1st, 2010, 11:47 am
by fab10ab
The Fisher transform is useful for getting confidence intervals. To get CI for more general cases, you can use bootstrapping.
When is R square significant?
Posted: September 1st, 2010, 1:33 pm
by crmorcom
If you want to test the significance of your regression, you should use the F-statistic, which is related to the adjusted r-squared. R^2 is not the right statistic to use because it doesn't adjust for the number of degrees of freedom you have used up by adding independent variables.Of course, if you want to know if your R-squared is "big enough", that does depend on your application. Suppose you have trading profitability regressed on some set of predictive variables. 1-R^2 is your residual variance. Whether that's too much or not will depend how big the mean of your profit is. If the mean is small, even a relative large R^2 could still give you a tragically bad Sharpe-ratio. On the other habd, if your predicted mean is high enough, even quite small R^2 can be useful, so long as your relationship is stable.The problem with the Fisher transform is that, if your variables are not bivariate normal, it gives you very bizarre results. The same is true of any confidence intervals/analysis of second or higher order moments. Particularly with financial time-series, your second moment is going to be unstable or non-finite. Any confidence intervals for risk or correlation is likely to be garbage unless you are very, very careful indeed.
When is R square significant?
Posted: September 3rd, 2010, 12:34 pm
by willsmith
Quick reminder, also make sure both your series are stationary (I.e. No drift) or you can get spurious correlation and a high R^2 where no actual relationship exists.
When is R square significant?
Posted: September 3rd, 2010, 1:23 pm
by pnrodriguez
I agree with fab10ab that you can use bootstrap. However, you have to simulate the null hypothesis first. Once you obtain the R-square distribution of the null hypothesis, it is very easy to verify if your R-square is significant.