What Happens When You Ask LLMs To Pick Your Stocks?
AI models may beat the market, but Rice Business research finds they do so by taking bigger risks, not making smarter investments.
This story is part of our special anniversary issue of Rice Business Wisdom on artificial intelligence.
Based on research by Bruce Carlin (Rice Business), Ryan D. Israelsen (Michigan State University) and Christopher F. Wazzan (University of California, Berkeley)
Key takeaways:
- In a recent NBER paper, AI models favored companies with heavy media coverage, whose news mentions far exceeded those of the average public company.
- The resulting portfolios were poorly diversified, with heavy concentrations in a few high-profile stocks, particularly semiconductor companies.
- Although the portfolios beat the S&P 500, their advantage largely disappeared when researchers accounted for the additional risk they carried.
Ask five of the most powerful AI models to invest your money and beat the stock market, and they mostly agree on one move: buy Nvidia. A lot of Nvidia.
That’s what Bruce Carlin, the George R. Brown Professor of Finance, found when he set out to study how AI handles an ordinary person’s money. For nearly a year, the Rice Business professor and two colleagues at Michigan State University and the University of California, Berkeley asked the leading large language models (LLMs) the same question almost every morning — what should I buy to beat the market? — and tracked every answer as it played out in real time.
For most of the last century, having a portfolio built for you meant hiring someone to do it — a broker, an adviser, a manager with a license and a fee. But today the same request costs nothing and takes seconds. You ask, and the LLM answers: here’s what to buy, here’s how much, here’s why. Now that nearly everyone has a free financial adviser in their pocket, the real question is whether it’s any good. That’s what Carlin and his co-authors of a new National Bureau of Economic Research working paper, “AI Managed Household Portfolios: A Preliminary Report,” wanted to find out.
Putting the same demand to every system they tested — ChatGPT 5.0 and 5.2, Claude Sonnet 4.5, Gemini 2.5 Flash and Grok 4.1 Fast — Carlin and his co-authors made the LLMs show their work. Each pick had to come with a reason and a source. Why this company? And what were the models reading to get there? The answers to those questions became the real research data.
The risk isn’t that the AI gives obviously bad advice. It’s that the advice arrives instantly, costs nothing and sounds reasonable, which is exactly what makes an ordinary investor likely to act on it.
It turned out the logic for LLM recommendations had less to do with a firm’s actual figures and more with their media mentions. The companies that made the cut drew nearly 10 times the news coverage of the average public company. What the AI recommended, ultimately, was whatever was being talked about most online.
The cost of that news-chasing is that you get a narrow portfolio with a handful of headline names, mostly crowded into the same corner of the market. Semiconductors alone made up around 40% of the AI-managed holdings — enough that a single bad year for chipmakers could drag down the whole account. Banks, meanwhile — the backbone of most retirement accounts — barely appeared. Gemini, at one point, treated four or five stocks as a finished portfolio, a job most advisers would spread across dozens of names. “For the household investor, the protection that matters most — diversification, the spreading of risk — is the very thing LLMs left out,” Carlin says.
On paper, the AI advice looked like a winner. The portfolios beat the S&P 500, the one thing they had been asked to do. But when Carlin applied a harder test, measuring each pick against other stocks of the same size, growth and recent momentum, the edge all but vanished. The LLMs hadn’t picked smarter stocks, only riskier ones. The gains came from taking a concentrated risk that happened to pay off in a rising market but would be considered reckless in a falling one.
Carlin is careful to call the findings preliminary. The data are still coming in. But his early read is sobering. “The risk isn’t that the AI gives obviously bad advice,” he says. “It’s that the advice arrives instantly, costs nothing and sounds reasonable, which is exactly what makes an ordinary investor likely to act on it.”
As more of the money decisions families used to work out together get handed to chatbots — what to buy, what to borrow, how to save for retirement — the same questions will increasingly follow from one budgeting conversation to the next: Does AI actually give good financial advice? Or does it only sound that way?
Written by Scott Pett
“AI Managed Household Portfolios: A Preliminary Report,” NBER Working Paper (2026).
Never Miss A Story