August 31st, 2006, 11:07 am
Alternatively to backtesting (which is often problematic due to intraday trading, valuation errors due to bad price feeds, etc) you can try doing an attribution. If your risk model, whatever it may be, can explain a lot of the real daily or weekly performance given real market inputs (e.g. yield move, stock market move, vol move, ....), then it is a good model. What you will probably find is that every VaR model leaves an error term of unexplained variation/performance. From my experience, VaR is hard to bring in line with the real world (model and real world seem to be in different "units"), for many practical and theoretical reasons, but it can be useful to just use the VaR model output itself as a decision making variable without trying to reconcile it 100% with reality. (i.e. if the number is high vs history we are taking a lot of risk, and vice versa...develop an intuition for the model numbers).