Case 012Signal research and data tasksCore
In a take-home, a stock's monthly returns are regressed on a factor over 60 months, but one month shows a data error of +250%. Compare the slope with and without it, winsorising at the 1st and 99th percentiles against deleting, and choose.
1The situation
Vaikhra Investments sends a take-home: 60 months of returns for one stock and for a factor, and the instruction to estimate the stock's factor loading. One row stands out. In the month the factor had its best return, 8.4%, the stock's return is recorded as +250%. The company's filings for that month show nothing unusual, and the price series around it moves by a few per cent.
Every other month the stock's return lies between -17% and 17%.
2Your task
Estimate the slope with the bad month in, with the returns winsorised at the 1st and 99th percentiles, and with the month deleted. Which do you report, and why?
Quick check
What does winsorising at the 1st and 99th percentiles do to the +250% month in a sample of 60?
Worked solution
Try it on paper, then open one step at a time.
30-second answerThe answer to give first
Report the slope with the month corrected or deleted, about 0.94; the raw slope of 2.91 is an artefact and winsorising still leaves 1.79. The +250% is a recording error, almost certainly 2.5% with the decimal moved. With 60 points the 99th percentile is set by the error itself, about 113%, so winsorising shrinks the damage without removing it. Winsorise genuine extreme returns; correct or remove proven errors, and say which you did.
Step 1How much does one month move the slope?
A lot, because of where it sits. The bad month is also the month with the largest factor return, 8.4%, so it is the point with the most leverageIn regression, how far an observation lies from the average of the explanatory variable. A point far out on the x-axis has more pull on the fitted slope. on the slope. Least squares penalises the squared miss, so a single point about 247 points too high drags the line up at the right-hand end, and the slope jumps from 0.94 without it to 2.91 with it, more than three times the true loading. Think of a seesaw with sixty children of normal weight and one elephant sitting at the far end.
| Treatment | Slope | Standard error | What the bad month becomes |
|---|---|---|---|
| Raw data | 2.91 | 0.94 | +250% |
| Winsorised at 1st and 99th percentiles | 1.79 | 0.43 | capped at +112.6% |
| Deleted | 0.94 | 0.17 | dropped, 59 months |
| Corrected to +2.5% | 0.89 | 0.17 | fixed at source |
Step 2Why does winsorising not rescue it here?
Look at how the percentile is computed. With 60 values the 99th percentile sits 0.99 times 59, or 58.41 places along the sorted list: between the second-largest value, 17.2%, and the largest, which is the error. The cap is therefore set by the error itself, about 113%, and a month that should read 2.5% still reads over a hundred. WinsorisingReplacing values beyond a chosen percentile with the value at that percentile, so extreme points are pulled in rather than removed. works when there are many observations beyond the cutoff and each is a real but extreme draw. With one gross error in 60 rows it is the wrong tool.
Step 3So which do you report?
Decide first whether the point is an error or an event. A +250% month with no news, in a price series that moves a few per cent around it, is a recording error; 2.5% with the decimal shifted fits every fact. Errors are corrected where you can prove the true value and deleted where you cannot; real extreme events are kept and handled with winsorising or a robust regression. Here the correction is provable, so report 0.89 and show the deleted version, 0.94, as a check. A robust flag would have caught it before any regression: the month lies about 58 median absolute deviations from the median, where five or so would already earn a second look.
Write the decision down in the submission. Graders of a take-home read the cleaning notes as closely as the estimate, because a quant who silently drops awkward rows will one day drop the crash month from a risk model. One line is enough: what the point was, why you judged it an error, what you did, and how much the answer moved.
Where candidates lose it
The common loss is running the regression straight away and reporting a slope of over 3, or noticing the point and winsorising by reflex. Winsorising at fixed percentiles sounds rigorous, but in 60 rows the cap is set by the outlier itself.
The opposite error is deleting every point that looks big. A genuine crash month is information, not noise, and a candidate who removes it understates the stock's risk. The interviewer wants the reason for the choice, not just the choice.
What the interviewer asks next
- The +250% turns out to be a real takeover month. What do you do now?
- How would a Huber or least-absolute-deviation regression treat this point?
- How would you screen 3,000 stocks automatically for errors like this one?
Asked at Balyasny Asset Management, Quantitative Research, New York, 2024 (Wall Street Oasis): The take home exam is pretty untraditional, but not difficult. You need to take care of data outliers
Company names and figures are illustrative.
