Why Does the Market Rise When Investors Expect It to Fall?
While conventional wisdom suggests that stock prices only reflect the beliefs of active investors, new research finds that fearful investors who step out of the market still influence prices by leaving more risk to those who remain and raising the returns they demand.
When stock market forecasts turn sour, standard intuition suggests prices should tumble. Yet financial economists have long grappled with a persistent puzzle: when broad surveys show investors expect weak market returns, future stock performance is often strong.
A study by William N. Goetzmann, Dasol Kim, and Robert J. Shiller offers a fresh explanation rooted in who is actually in the room when prices are set. Surveys capture the views of both active market participants and sidelined spectators. Market prices, however, do not weigh all voices equally. They reflect only the capital of those actively bearing financial risk.
Comparing more than two decades of Robert Shiller's Investor Confidence Survey data with S&P 500 option benchmarks, the authors tracked the gap between surveyed sentiment and the beliefs embedded in market prices. The survey polls wealthy individual and institutional investors, and asks each whether they would advise being less invested in stocks for the time being.
Splitting respondents on that answer is revealing. On the same days, those who said they were staying in expected the market to return about 3.3 percent over six months, close to the 4.3 percent implied by option prices. Those who advised stepping out expected a loss of 1.2 percent. One group's beliefs nearly matched the market. The other group's were nowhere close.
"If the decision to stay invested depends on how likely investors think a crash is, then the survey population and the price-setting population will differ systematically."
Crucially, the authors find that fear of a market crash is what most sets apart the investors who say they are stepping out. The authors call them "non-marginal," because their views no longer register directly in prices. But they do not simply vanish from the economic equation. Their retreat leaves the remaining pool of investors holding a heavier concentration of aggregate risk. Because those who remain must take on more exposure, they demand higher returns as compensation. This helps explain why high survey pessimism often precedes higher future returns.
The pattern extends to individual stocks. Some stocks tend to do well precisely when this gap is widening, that is, when fear is pushing investors out and concentrating risk. Those stocks work like insurance, and investors accept lower average returns to hold them.
The findings demonstrate that sideline pessimism is not mere background noise. By altering who holds the risk, investors who step back still fundamentally shape the market.