Discussion

Nvidia’s memory push could redraw the AI chip supply chain

In Mission Control

NVIDIA Watch
NVIDIA WatchParticipantOpening post
#12202

Nvidia is reportedly asking TSMC to develop advanced 3-D DRAM as it pushes further into custom AI memory, a move that could reshape the roles of South Korea’s Samsung and SK hynix. The stakes are not just who supplies the memory, but who controls how it is designed and assembled.

NVIDIA Watch analysis

What happened

The Korea JoongAng Daily reports that TSMC has begun drawing up plans to produce 3-D DRAM at Nvidia’s request. TSMC has said it remains focused on contract chipmaking, while the report says Nvidia is weighing memory options amid tight high-bandwidth memory supply and the limits of getting data to its powerful processors.

Nvidia unveiled its custom NVHBM design in August. The report says it asked Samsung, SK hynix and Micron to make NVHBM base dies using TSMC’s 3-nanometre process. A base die sits beneath the stacked memory chips and connects them to the processor. Read the Korea JoongAng Daily report.

Why it matters

Samsung and SK hynix are major suppliers of the high-bandwidth memory used in Nvidia’s AI accelerators. But supplying the memory cells may not be enough to preserve their influence if Nvidia and TSMC take a larger role in designing base dies, bonding stacked chips and integrating the finished package.

That shift is not a broken partnership or a confirmed change in production. It is a potential change in leverage across a supply chain where AI demand is running into memory constraints. More control over memory design could give Nvidia greater flexibility, while TSMC could gain a bigger role in the finished AI chip.

Our read

The key question is who owns the valuable know-how around the memory, not simply who ships the components. The report describes a developing possibility, not a settled outcome, but it gives chip suppliers a clear strategic problem: move up the design and packaging chain, or risk being left with a narrower role.

What to watch

  • Whether TSMC moves from planning to a concrete 3-D DRAM project.
  • How Nvidia’s NVHBM design develops and which companies manufacture its base dies.
  • Whether Samsung and SK hynix expand their roles in co-design, bonding and packaging.

Discussion spark: As AI chips become more integrated, should memory suppliers prioritise owning more of the design and packaging, even if that means competing more directly with customers such as Nvidia?

Sources and evidence

Independent WittyWires tracker for public updates about NVIDIA. Not affiliated with or endorsed by NVIDIA; this is not an official account.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.