Serving the Quantitative Finance Community

 
User avatar
frenchX
Topic Author
Posts: 11
Joined: March 29th, 2010, 6:54 pm

Problem with performance measure

March 13th, 2012, 4:36 pm

I have a very basic problem for performance measure usually used in finance.The very basic performance measure is :(measure expected return-benchmark return)/measure of riskThe problem I have is how you distinguish low risk-low return from high risk-high return with numbers such as sharpe ratio ?For me when a guy disclaimes his sharpe ratio for his strategy it provides not enough info.
 
User avatar
Alan
Posts: 3050
Joined: December 19th, 2001, 4:01 am
Location: California
Contact:

Problem with performance measure

March 13th, 2012, 5:22 pm

Yeah, even apart from the question of whether the past has any implication for the future, performance measurement is quite an involved subject, certainly never captured by a single number.There are various ways of measuring returns: time-weighted vs. internal rate of returnThere are issues of annualization, compounding, averaging, and selection of time horizons. There are various ways of measuring risk: std. deviation, semi-deviation, etc -- of course, you should look at the entire distribution of returns. There are issues of suitable benchmarks, universe comparisons, perfomance attribution, and sector analysis.There are problems with survivor bias, selective disclosure, closed accounts, incubating funds, etc.So, yeah, by itself the sharpe ratio tells you virtually nothing.Even after a lengthy 20 page performance analysis report, laboriously discussing all the items in my list above,you still can know very little if you don't know the details and the rationale of the strategy. Even if you know the details and the rationale of the strategy, how much was really luck? A good marketing staff can invent a good story that goes with anything. Welcome to the world of investment management!
Last edited by Alan on March 12th, 2012, 11:00 pm, edited 1 time in total.
 
User avatar
bearish
Posts: 5906
Joined: February 3rd, 2011, 2:19 pm

Problem with performance measure

March 13th, 2012, 10:49 pm

I don't completely disagree, but you can use a version of the classical Modigliani-Miller argument to say that any positive Sharpe ratio strategy can always be levered up or down to the level of risk you can tolerate (or the level of expected excess return you need).
 
User avatar
frenchX
Topic Author
Posts: 11
Joined: March 29th, 2010, 6:54 pm

Problem with performance measure

March 14th, 2012, 9:44 am

Sure but what do people prefer ?Invest a lot in low risk low return strategy or invest a little in high risk high return strategy ? Moreover I believe that for large amount of investment the return decreases and the risk increases (market feedback effect).
 
User avatar
daveangel
Posts: 5
Joined: October 20th, 2003, 4:05 pm

Problem with performance measure

March 14th, 2012, 9:52 am

a High Sharpe ratio says you can take those returns and leverage and given an assumption of normality then its fine. However, we all know that returns are anything but normal.A good way of measuring and ranking performance is the Omega ratio. It effectively is a measure of the upside to the downside and captures the who distribution of returns - assuming you have an empirical distribution.
knowledge comes, wisdom lingers
 
User avatar
samirkhan
Posts: 0
Joined: August 9th, 2011, 10:14 am

Problem with performance measure

March 22nd, 2012, 5:12 pm

In case anyone is interested, there's an Excel spreadsheet to calculate the Omega Ratio here: Omega Ratio in Excel.I prefer the Omega Ratio to other performance measures because it captures all the information in the empirical returns distribution, without place any assumptions on the data.
 
User avatar
daveangel
Posts: 5
Joined: October 20th, 2003, 4:05 pm

Problem with performance measure

March 22nd, 2012, 5:31 pm

the Omega ratio can even evaluate lottery tickets as was explained by Shadwick and Keating.
knowledge comes, wisdom lingers
 
User avatar
yuryr
Posts: 0
Joined: November 5th, 2007, 12:47 pm

Problem with performance measure

March 26th, 2012, 8:11 am

the only thing I don't understand about either Sharpe or Omega ratio is that they are indifferent as to how many data points are used in estimating it. 2 trades or 2 million, 12 monthly returns or 250 daily returns - which one would be more trustworthy?forgive my trading illiteracy...
 
User avatar
sm1
Posts: 0
Joined: June 1st, 2013, 3:41 pm

Problem with performance measure

September 13th, 2013, 10:46 pm

QuoteOriginally posted by: frenchXI have a very basic problem for performance measure usually used in finance.The very basic performance measure is :(measure expected return-benchmark return)/measure of riskThe problem I have is how you distinguish low risk-low return from high risk-high return with numbers such as sharpe ratio ?For me when a guy disclaimes his sharpe ratio for his strategy it provides not enough info.When you do sensitivity tests, most reward-risk measures point to the same areas. Choose whatever you like (I assume you are a trader/researcher, not an academic searching for some ultimate truth which does not exist).