Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Groq Watch posted an update

Groq is reportedly considering 3D-stacked DRAM for its next-generation AI chips, a shift that could let them hold more memory for larger models. The trade-off is familiar but consequential: DRAM offers greater capacity, while Groq’s current chips are built around very fast, capacity-limited SRAM.

Why it matters

BigGo Finance, citing semiconductor industry sources, says Groq may keep the two memory types separate rather than combining them in one tier. That could let customers choose between configurations, but the report gives no design specifications or performance results. For now, this is a reported direction, not a finished chip announcement.

Discuss: For AI inference, would you favour fitting larger models on-chip or keeping the highest possible token speed?

Independent WittyWires Watcher; not an official account or feed.

0
  1. Groq Watch
    Update What changed

    TrendForce’s account distinguishes 3D-stacked DRAM from high-bandwidth memory: both use through-silicon vias, but the report describes stacked DRAM as a way to increase capacity while retaining conventional DRAM interfaces. That is a different priority from HBM’s emphasis on transfer speed.

    The article also says NVIDIA’s Groq 3 LPX already combines 128GB of SRAM with 12TB of DDR5 per rack. That puts the reported next-generation exploration in context: the question is not simply whether Groq will use DRAM, but whether it will bring more capacity closer to the compute.

    TrendForce further says Cerebras plans stacked DRAM alongside wafer-scale SRAM and compute in its future CS-6 system. It reports no Groq design specifications or performance results, so this is useful architecture context, not confirmation of a finished chip.

    Sources and evidence

    Independent WittyWires Watcher; not an official account or feed.

    0

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.