Case 071Model risk and validationCore
An interest rate risk spreadsheet reports that a 100 basis point rise adds Rs 12 crore to earnings. Review finds a gap bucket with the wrong sign and a rate hard-coded from last year; corrected, the answer is a Rs 9 crore loss. How are such errors found, and what controls do end-user models need?
1The situation
Yashvel Capital, a mid-sized lender, estimates the effect of rate changes on its net interest income with a spreadsheet built by one analyst in treasury. For the last quarter it reported that a 100 basis point rise would add Rs 12 crore to NII over a year, and the ALCO minutes record rising rates as good news.
A validator rebuilding the numbers finds two problems. The gap for the 3 to 6 month bucket, minus Rs 1,200 crore, was entered as plus Rs 1,200 crore. And the base rate cell used to compute the shock is a typed 6.00% from last year, while the scenario rate is linked to today's 7.00% plus 1%, so the sheet applied a 2% shock. Corrected, the sensitivity is minus Rs 9 crore.
2Your task
Show how each error moves the answer, explain how a reviewer would catch errors like these, and set out the controls end-user models need.
Quick check
If only the hard-coded rate were fixed, what would the sheet report?
Worked solution
Try it on paper, then open one step at a time.
30-second answerThe answer to give first
The sheet reported plus Rs 12 crore because a flipped sign turned a Rs 7.5 crore cost into a gain and a stale base rate doubled the shock; corrected, a 100 bp rise costs about Rs 9 crore. Errors like these are caught by sense checks against the gap profile, independent rebuilds and formula audits. Any spreadsheet feeding a decision needs an owner, a tier, locked inputs linked to source, reconciliation and independent review, the same controls as a system model.
Step 1How does each error move the answer?
Separate them, because a reviewer who fixes one error and sees a plausible number may stop. The flipped bucket alone turns a Rs 7.5 crore cost into a Rs 7.5 crore gain, a Rs 15 crore swing at a 1% shock; the stale base rate alone doubles every bucket's effect. Together they produce plus Rs 12 crore. Fix only the rate and the sheet says plus Rs 6 crore; fix only the sign and it says minus Rs 18 crore, twice the truth. Only both give minus Rs 9 crore.
| Rs crore, +100 bp | Shock applied | 3 to 6 month sign | NII change |
|---|---|---|---|
| As reported | 2% | wrong | +12.0 |
| Rate fixed only | 1% | wrong | +6.0 |
| Sign fixed only | 2% | right | -18.0 |
| Both fixed | 1% | right | -9.0 |
Step 2How would a reviewer have caught this?
Imagine a household budget that says your savings rise when the rent goes up. You would not need to check the formulas to know something is wrong; you would know from what the numbers mean. The fastest check is the sign: Yashvel's own gap report shows more liabilities than assets repricing within the year, so rising rates must cost it money, and a positive answer is a contradiction. Then three more. Back out the shock: dividing the output by the weighted gaps shows 2%, not the 1% the scenario claims. Reconcile each bucket's gap to the system extract it came from. And audit formulas for typed constants: any number inside a formula or a hard-coded input with no source is a finding. A quarter-on-quarter movement check would also have flagged a sensitivity that flipped sign with no change in the balance sheet.
Step 3What controls do end-user models need?
The same as system models, scaled to their use. A spreadsheet that shapes ALCO decisions is a tier 1 model in everything but name, and the medium does not lower the bar. Put it in the model inventory with an owner and a tier. Keep inputs on one sheet, each linked to its source or labelled with source and date, and lock the calculation cells. Build in automatic checks: the effective shock equals the scenario, gaps reconcile to the source report, and the sign agrees with the gap profile. Use version control so the ALCO can see what changed. And require independent review before first use and after any change, which is exactly what found these errors, a quarter late.
Close with the consequence: the ALCO spent a quarter believing rising rates helped, and may have chosen not to hedge on that basis. The cost of the error is the decision it supported, not the arithmetic.
Where candidates lose it
The common loss is treating the two errors as one and stopping after the first fix. Fixing the rate alone gives plus Rs 3 crore, which looks plausible and is still wrong in sign.
The second is recommending that the spreadsheet be replaced by a system and stopping there. Interviewers want controls that work on whatever tool is in use, starting with a sense check anyone could have run.
What the interviewer asks next
- The analyst who built the sheet has left. What is the first thing you do?
- Which one automated check would have caught both errors?
- How would you tier this spreadsheet against a vendor ALM system that does the same calculation?
Company names and figures are illustrative.
