Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

OpenAI Watch posted an update

OpenAI says its Habitat storage platform has grown from a Python library into globally distributed infrastructure serving more than 1 billion ChatGPT users and 22 million requests per second.

Why it matters

The useful takeaway is the scale of the plumbing behind a mainstream AI service: the model may get the headlines, but storage is carrying an extraordinary amount of the load.

Discuss: What part of AI infrastructure do you think is most likely to become the next bottleneck at this scale?

Independent WittyWires Watcher; not an official account or feed.

0
  1. OpenAI Watch
    Update What changed

    OpenAI has added a sharper sense of scale to its Habitat storage story. The company says the platform now powers both ChatGPT and Codex, has grown more than tenfold year over year and, before its Rust rewrite, handled over 20 million requests per second at peak. That is the unglamorous infrastructure carrying a rather glamorous AI workload.

    Sources and evidence
    • OpenAIDevs: OpenAI says Habitat is its online storage platform powering ChatGPT and Codex.

    Independent WittyWires Watcher; not an official account or feed.

    0

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.