Back to News
investment

Prediction: The AI "Inference Era" Will Crown a New Winner by the End of 2026

newsfeedback@fool.com (Geoffrey Seiler)
Loading...
5 min read
0 likes
⚡ Quantum Brief
Hyperscalers will spend $700 billion on AI infrastructure in 2026, surpassing most countries’ GDP, with inference becoming the dominant cost driver as models deploy at scale. Nvidia leads AI inference with Blackwell GB300 Ultra chips and Vera Rubin’s 5x performance boost, but its software moat is weaker than in training, leaving room for competitors. AMD is gaining inference share via OpenAI’s 6-gigawatt GPU deal, but its gains remain niche compared to Nvidia’s dominance in both training and deployment. Broadcom’s ASICs—custom chips for inference—outperform GPUs in efficiency and cost, mirroring their crypto-mining disruption, with Alphabet’s TPUs and Anthropic’s $21B order proving demand. Broadcom’s $350B potential from OpenAI’s 10-gigawatt ASIC order could crown it the inference leader by late 2026, despite Nvidia retaining overall market share.
AI Audio Summary
0:00 / 0:00
Click to play
Untitled design (38).png
Quantum News · Media Library

By Geoffrey Seiler – Feb 24, 2026 at 3:10PM ESTKey PointsNvidia currently dominates the AI chip market, including for inference. AMD should take some share, helped by its deal with OpenAI.However, Broadcom looks like the biggest inference chip winner. These 10 Stocks Could Mint the Next Wave of Millionaires ›NASDAQ: AVGOBroadcomMarket Cap$1.6TToday's Changeangle-down(-1.48%) $4.89Current Price$325.45Price as of February 24, 2026 at 3:58 PM ETBroadcom looks poised to become a big inference winner in 2026.The artificial intelligence (AI) infrastructure market is booming, with five of the largest hyperscalers (owners of massive data centers) alone set to spend an eye-popping $700 billion in 2026. To put that in perspective, that exceeds the gross domestic product (GDP) of all but 24 countries. Right now, this spending is being done for two main purposes. The first is to train large language models (LLMs), such as OpenAI's ChatGPT, Anthropic's Claude, and Alphabet's Gemini. The other is to support AI inference, which then deploys the models to answer queries. Image source: Getty Images. Nvidia (NVDA +0.79%) is the clear leader in AI model training, and it has established a wide moat in this area through its CUDA software platform, which is where most foundational AI code has been written and optimized for its graphics processing units (GPUs). However, the company is also the leader in inference. Its Blackwell GB300 Ultra chips were designed specifically for inference in mind, while its upcoming Vera Rubin platform is projected to offer five times the inference performance of previous generations. Meanwhile, Nvidia NIM, (Nvidia Inference Microservices) provides prebuilt, optimized inference microservices, giving it a software edge, as well. However, Nvidia's moat for inference isn't nearly as wide as it is for training. Because of this, Advanced Micro Devices (AMD +8.81%) has been able to carve out a nice niche in the inference space with its GPUs. Meanwhile, with an investment from OpenAI and commitments from the ChatGPT maker to buy 6 gigawatts worth of its GPUs specifically for inference in the coming years, AMD should be able to gain some market share in the inference market. However, the biggest winner in the inference market will likely be Broadcom (AVGO 1.48%). ExpandNASDAQ: AVGOBroadcomToday's Change(-1.48%) $-4.89Current Price$325.45Key Data PointsMarket Cap$1.6TDay's Range$314.50 - $328.2752wk Range$138.10 - $414.61Volume857KAvg Vol31MGross Margin64.71%Dividend Yield0.73% The rise of AI ASICs in the age of inference Broadcom is a leader in ASIC (application-specific integrated circuit) technology, by which it provides the building blocks and intellectual property to help customers turn their AI chip designs into reality. It also has access to important components, like high bandwidth memory (HBM), and an established relationship with foundry Taiwan Semiconductor Manufacturing to be able to produce these custom chips at scale. Since ASICs are hardwired to perform specific tasks, they lack the flexibility and adaptability of GPUs. However, given their specialized nature, they can outperform GPUs at the tasks for which they were designed while also being more energy efficient. This becomes an increasingly important factor with AI inference, since it is an ongoing cost every time an AI model must answer a query or perform a task. AI inference also isn't as complex as AI training, so Nvidia's software doesn't have as big an edge. ASICs already disrupted GPUs in the cryptocurrency mining space, as they were able to offer better hash rates while being more energy efficient. Now, cryptocurrency mining isn't as technically demanding as AI workloads, as AI models do evolve, but the precedent is there, and ASICs can offer better economics for inference. That's a big opportunity for Broadcom to take share. Broadcom has already successfully helped Alphabet develop its highly regarded tensor processing units (TPUs), which the company has been using for years to run its internal workloads. With its data center capex spending set to surge this year, Broadcom is well-positioned to profit from this growth. At the same time, Alphabet is also starting to let customers use its TPUs within Google Cloud, and Anthropic has placed a massive $21 billion TPU order with Broadcom to be delivered this year. Meanwhile, other hyperscalers have also turned to Broadcom to help them develop their own custom AI chips. This includes OpenAI, which has committed to deploying 10 gigawatts of custom chips. Based on Nvidia GPU prices, 10 gigawatts would be worth $350 billion. ASIC prices will be lower, but that's still a huge opportunity. With Broadcom generating just under $64 billion in total revenue in fiscal 2025, the company is set to see explosive growth in the coming years. Given its order book, the company looks poised to be the new AI inference king by the end of 2026 (even if Nvidia does technically continue to hold a higher market share). Read NextFeb 24, 2026 •By Justin PopeForget AI Training: AI Inference Is the Real Money Maker in 2026. Here Are 2 Stocks to Own.Feb 24, 2026 •By Rick MunarrizCathie Wood Goes Bargain Hunting: 3 Stocks She Just BoughtFeb 24, 2026 •By Rick OrfordMassive News: Broadcom's AI Momentum Could Drive Explosive Growth Through 2029Feb 24, 2026 •By Patrick Sanders3 Top Tech Stocks That Could Make You a MillionaireFeb 23, 2026 •By Keithen DruryPrediction: Broadcom Stock Will Reach $450 By the End of the YearFeb 23, 2026 •By Leo SunWhere Will Broadcom (AVGO) Be in 5 Years?About the AuthorGeoffrey Seiler is a contributing Motley Fool stock market analyst covering technology, consumer goods, healthcare, energy, and materials stocks. Prior to The Motley Fool, Geoffrey was a senior equity analyst at Raging Capital Management, a $600 million long-short hedge fund. He holds a bachelor’s degree in history from Haverford College.TMFFindProfitStocks MentionedBroadcomNASDAQ: AVGO$325.45 (1.48%) $4.89NvidiaNASDAQ: NVDA$193.06 (+0.79%) $+1.51Advanced Micro DevicesNASDAQ: AMD$213.92 (+8.81%) $+17.32*Average returns of all recommendations since inception. Cost basis and return based on previous market day close.

Read Original

Tags

quantum-investment

Source Information

Source: The Motley Fool

Discussion

0 professional contributions

Sign in to join this professional discussion.

Be the first to add a constructive contribution.