Industry

Memory now accounts for 63% of AI chip component costs

High-bandwidth memory (HBM) has grown from 52% to 63% of AI chip component spending between Q1 2024 and Q4 2025, according to analysis from Epoch AI. The increase reflects rising memory prices and tight supply, driving up total component costs from $22 billion to $52 billion over the period. Hyperscalers like Microsoft and Meta have adjusted their capex guidance to account for higher component prices.

Neura News

Neura News

Neura Market Editorial

May 24, 20263 min read
Memory now accounts for 63% of AI chip component costs

High-bandwidth memory (HBM) has become the dominant cost in AI chip manufacturing, rising from 52% to 63% of total component spending between the first quarter of 2024 and the fourth quarter of 2025, according to a new analysis from Epoch AI.

The estimates, compiled by researcher Venkat Somala, cover AI chips designed by Nvidia, AMD, Google, and Amazon, weighted by production volume. The analysis breaks down component spending into four categories: HBM memory, logic dies, advanced packaging (CoWoS), and auxiliary components.

Memory's growing share

Logic dies maintained a roughly flat share near 13% over the period. Meanwhile, advanced packaging fell from 19% to 15% of total spending, and auxiliary components dropped from 15% to 9%.

In absolute terms, the shift is even more pronounced. Total component spending on AI chips grew from approximately $22 billion in 2024 to $52 billion in 2025. HBM spending alone accounted for roughly $20 billion of that increase, jumping from about $12 billion to $32 billion over the same period. That year-over-year growth was faster than any other component category.

Hyperscaler capex reflects higher prices

The trend is expected to continue in 2026 as memory supply remains tight and prices keep rising. Major cloud providers have already begun factoring higher component costs into their capital expenditure plans.

Microsoft's $190 billion fiscal year 2026 capex outlook includes approximately $25 billion attributed to higher component prices. Meta also raised its 2026 capex range by $10 billion, citing higher component prices as a key factor.

The #1 Newsletter in AI

Stay ahead of the AI curve

The most important updates, news, and content — delivered weekly.

No spam. Unsubscribe anytime.

Methodology and data sources

Epoch AI's analysis draws on its AI Chip Components explorer, which builds chip-level bills of materials from financial disclosures, supplier filings, and analyst reports. For each chip designed by Nvidia, AMD, Google, and Amazon, the researchers estimated per-chip costs for each of the four component categories. They then multiplied those costs by estimated quarterly production volumes to arrive at total component spending per quarter from Q1 2024 through Q4 2025.

The component categories tracked are HBM, logic dies, advanced packaging (CoWoS), and auxiliary components. The methodology documentation for the explorer provides additional detail on how each category is estimated.

Uncertainty in estimates

Each component unit carries some cost uncertainty, including the price of an HBM stack, a logic die, or a CoWoS package. Epoch AI models each chip's per-component cost with a 90% confidence interval. Because the component share is a ratio of that component's cost over total cost, both the numerator and denominator carry uncertainty.

The analysis shows two bounds on the share to account for this variability. Component costs can vary by contract, supplier, and timing, and estimates of quarterly production volumes and chip-type mix also introduce uncertainty that propagates into the reported shares.

Despite these caveats, the trend is clear: memory has become the largest and fastest-growing cost in AI chip production, and this shift is reshaping how hyperscalers budget for AI infrastructure.

Related on Neura Market

More from Neura News

General

Open-weight AI mirrors Kubernetes ecosystem shift

Tobi Knaup, co-founder of Mesosphere, draws parallels between the rise of Kubernetes and the current trajectory of open-weight AI models. He argues that open-weight models are becoming a neutral substrate for innovation, attracting a global ecosystem of developers, startups, and enterprises. The piece warns against US restrictions on Chinese open-weight models, advocating instead for American leadership through open releases, procurement strategies, and standards.

Jul 25·7 min read
General

Open-weight AI mirrors Kubernetes rise, US warned on bans

The author, a Mesosphere co-founder, draws parallels between the rise of Kubernetes and the current open-weight AI ecosystem. He argues that open-weight models are becoming a neutral platform for innovation, and warns that US restrictions on Chinese open-weight models could isolate American developers from a global ecosystem. The piece urges the US to compete by releasing frontier models, using procurement to create demand, building the stack, and setting standards rather than imposing bans.

Jul 25·7 min read
Industry

Power line failure reveals AI data center grid risks and solutions

A fallen power line near Washington, DC caused over 3 gigawatts of data center load to vanish from the PJM grid in seconds, spiking voltage across the region. The event, which made lights flicker from Northern Virginia to Chicago, highlights a growing problem as AI data centers become larger and more concentrated. Experts warn that without better coordination or technology like ON.Energy's battery-backed uninterruptible power supply, such disruptions will become more frequent and severe.

Jul 25·5 min read