Case 081Strategy evaluation and backtestsHard
Palashvan reports a monthly Sharpe ratio of 0.35, annualised to 1.21 with the square root of 12, but its monthly returns have a lag-one autocorrelation of 0.4 because illiquid positions are marked slowly. What is the corrected annual Sharpe, and what does the smoothing hide?
1The situation
Palashvan Capital runs a credit fund that holds unlisted loans and thinly traded bonds. Most positions have no daily price, so they are marked each month from a pricing model and a handful of dealer quotes. Over 96 months the fund has earned an average excess return of 0.70% a month with a monthly standard deviation of 2.0%, a monthly Sharpe ratio of 0.35.
The marketing deck multiplies by the square root of 12 and shows an annual Sharpe of 1.21. An allocator's analyst notices that each month's return is correlated with the month before, with a lag-one autocorrelationThe correlation of a series with its own earlier values; here, how much one month’s return resembles the previous month’s. of 0.4, and asks you to check the headline.
2Your task
Correct the annualised Sharpe ratio for the autocorrelation, cross-check it another way, and explain what the smoothing hides from an investor.
Quick check
With monthly autocorrelation of 0.4, what is the honest annual Sharpe ratio?
Worked solution
Try it on paper, then open one step at a time.
30-second answerThe answer to give first
The honest annual Sharpe ratio is about 0.83, not 1.21: the smoothing hides roughly a third of the risk-adjusted return. With autocorrelation of 0.4, a year's variance is 2.15 times what twelve independent months would give, so annual volatility is about 10.2%, not 6.93%. Unsmoothing the returns first gives a similar 0.79. Smoothing also hides drawdowns, market exposure and the timing of losses.
Step 1Why does the square root of 12 fail here?
Picture a thermometer that reports the average of today and the past few days instead of today's reading. A sudden cold snap shows up as a gentle slide over a week, so each day's change looks small, and anyone who scaled the daily changes to guess the yearly range would underestimate it. Slow marking does the same to a fund's returns: a loss is booked across several months, so each month looks calm while the year is not. The square root rule assumes each month is independent, so that variances add: twelve months give twelve monthly variances. When this month resembles last month, the covariances between months add as well, and they are positive.
| sigma | monthly standard deviation, 2.0% |
| rho | lag-one autocorrelation, 0.4, assumed to decay as rho to the power k at lag k |
| 12 - k | number of month pairs in a year that are k months apart |
Step 2How much of the Sharpe survives the correction?
Work it through. With 0.4 at lag one, 0.16 at lag two and so on, the covariance terms add 13.8 monthly variances to the twelve. The year's variance is 2.15 times the naive figure, so annual volatility is 1.47 times larger: about 10.2% rather than 6.93%. The mean is unaffected, still 8.4% a year, so the Sharpe ratio becomes 8.4 over 10.2, about 0.83. That removes 32% of the headline. The autocorrelation is no accident of sampling: with 96 months its standard error is about 0.10, so 0.4 sits four standard errors from zero.
Cross-check by undoing the smoothing. If each reported return is a blend of this month's true return and last month's reported one, with weight 0.4 on the past, the true returns are more volatile than the reported ones by the square root of (1 + 0.4) / (1 - 0.4), a factor of 1.53. Recover the true series, annualise it with the plain square root rule, and the Sharpe is 0.79, close to the 0.83 from the variance formula. Two methods built on different assumptions landing near 0.8 is a better answer than either alone.
Step 3What else does the smoothing hide?
Three things, each worth more to an allocator than the Sharpe itself. Drawdowns are understated, because a true 8% fall that is booked over four months never shows as one bad month. Market exposure is understated, because a regression of this month's fund return on this month's market return misses the part of the fall that is booked next month; adding lagged market returns to the regression usually shows a much larger total beta. And investors who redeem after a crash leave at a stale, too high price, which transfers value from those who stay. The test asked for one number, but the reason the number matters is that smoothing makes an illiquid fund look like a low-risk one.
Step 4What do you tell the allocator?
Report the corrected Sharpe of about 0.83 with the method, and the annual volatility of about 10%. Ask for the regression of fund returns on current and lagged market returns, and for the worst rolling twelve-month return, not the worst single month. The limitation to state: the correction assumes autocorrelation decays geometrically from 0.4, and a fund whose marks are stale in a crash, when dealer quotes dry up, may be smoother exactly when it matters, so 0.83 is a ceiling as much as an estimate.
Where candidates lose it
The usual loss is annualising with the square root of 12 without checking the autocorrelation, or seeing it and calling it a sign of a trending, skilful strategy. For an illiquid book, positive autocorrelation is mostly an artefact of slow marks, and it flatters volatility, not returns.
The second is correcting only the volatility and forgetting the beta. A fund that looks uncorrelated with markets month by month can carry most of its market exposure in the lagged months, which is what an allocator buying diversification needs to know.
What the interviewer asks next
- How would you estimate the fund's true market beta from monthly data?
- What would negative autocorrelation of -0.3 do to the annualised Sharpe, and what might cause it?
- Why is the worst rolling twelve-month return a better risk number than the worst month here?
- How would you test whether the autocorrelation comes from marking or from the strategy itself?
Company names and figures are illustrative.
