Lesson 4 of 7
What the model needs to know
A mean-variance model needs expected returns, volatilities and every correlation. Sixty-one years of real index returns show how badly the first one is known.
By Javier Sanz
Founder of ValueScreener. Built Ninety Nine, a securities services provider, and sold it to a tier-one global bank; ran operations and internationalization at Alpaca, the brokerage API.
Who writes thisEditorial processLinkedIn (opens in a new tab)X (opens in a new tab)
In one minute
- A mean-variance model needs an expected return and a volatility for every holding, plus a correlation for every pair.
- Sixty-one years of index returns estimate the average to within about plus or minus four points, which is wider than most of the differences people optimise over.
- An optimiser given inputs this noisy produces confident answers to a question the data cannot resolve.
The frontier itself is uncontroversial arithmetic. The inputs are the problem, and the size of the problem can be measured with a published table of real returns rather than argued about.
What sixty-one years of index returns say about the average
- Lower end of the 95 percent range for the average7.7%
- Arithmetic mean of the 61 annual returns11.95%
- Upper end of the 95 percent range for the average16.2%
Counting the inputs
What a twenty-holding model asks you for
-
Twenty expected returns, one per holding. These are forecasts, and no amount of history produces them.
-
Twenty volatilities. Estimated from a sample, and more stable than the returns.
-
One hundred and ninety pairwise correlations. Estimated from the same sample, and the least stable of the three.
-
That is 230 numbers, every one an estimate, to produce one set of weights that will be quoted to a tenth of a percent.
How badly the first input is known
The published table gives 61 annual returns for the index with dividends, from 1965 to 2025. Their arithmetic mean is 11.95 percent and their standard deviation is 16.93 points. The standard error of the mean is the standard deviation divided by the square root of 61, which is 2.17.
A 95 percent range around the mean is therefore roughly 7.7 percent to 16.2 percent. After sixty-one years of the most-studied series in finance, the expected annual return is known to within about plus or minus four points.
The report's own figures, and mine
The same table states a compounded annual gain of 10.5 percent for the index over 1965 to 2025 and an overall gain of 46,061 percent over 1964 to 2025. Those are the report's printed figures.
The mean, standard deviation and standard error above are computed here from the 61 annual percentages the table prints, which is why the 11.95 percent arithmetic mean sits above the 10.5 percent compounded figure. The two answer different questions, and the difference between them is the subject of its own lesson in the financial mathematics course.
The errors do not cancel
There is a natural reply to all this: the estimates are noisy, but the errors go in both directions and should wash out. They do not, and the reason is what the optimiser does with them.
An optimiser is a machine for finding the extremes of its inputs. The holding whose expected return was overestimated and whose correlation was underestimated is exactly the holding it puts the most money into. Noise in equals concentrated position out, and the process systematically selects for the inputs that are most wrong in the most useful direction.
That is why a portfolio built by optimising noisy estimates often ends up in a handful of holdings that a person looking at the list would reject on sight, and why practitioners who use these models constrain them heavily: caps per holding, caps per sector, or shrinking the estimates towards a common value before the model ever sees them.
What to do with a model you cannot feed
Use it for what it teaches rather than for what it outputs. The formula shows that co-movement matters more than individual volatility, that adding holdings has diminishing returns, and that the benefit depends on an estimate nobody has.
Then size positions by what a wrong thesis costs, which is a judgement about a business and does not need 230 estimated parameters.
Check yourself
How many inputs does a twenty-holding mean-variance model need?
- 40
- 230: twenty expected returns, twenty volatilities and one hundred and ninety correlations
- Three
Show the answer
Answer: B.
The pairwise correlations dominate the count, and they are also the least stable of the estimates.What is the standard error of the mean of the 61 annual returns?
- 16.93 points
- 2.17 points
- 0.5 points
Show the answer
Answer: B.
The standard deviation of 16.93 divided by the square root of 61 is 2.17, which gives a 95 percent range of roughly 7.7 to 16.2 percent around the mean.Why is the arithmetic mean of 11.95 percent higher than the compounded 10.5 percent?
- One of them is a misprint
- They answer different questions: the average of the yearly figures is not the rate that turns the start into the end
- The compounded figure excludes dividends
Show the answer
Answer: B.
Both come from the same table. An arithmetic mean of volatile annual returns always exceeds the compounded rate that actually took the index from start to finish.Sources
- Berkshire Hathaway, 2025 annual report, table "Berkshire's Performance vs. the S&P 500": annual percentage change in the S&P 500 with dividends included, 1965 to 2025, with a compounded annual gain of 10.5 percent and an overall gain of 46,061 percent for 1964 to 2025.
- The mean of 11.95 percent, the standard deviation of 16.93 points and the standard error of 2.17 are computed for this lesson from the 61 annual figures the table prints.
What this leaves out
- The table's own note states that 1965 and 1966 are years ended 30 September and 1967 covers fifteen months, so the 61 observations are not all identical calendar years.
- A standard error assumes the observations are independent draws from one distribution. Annual market returns are close to that and not exactly that.
- The range describes uncertainty about a historical average. It is not a forecast of any future return.
- Nothing here is advice about any security or allocation.