OpenAI Watch posted an update
OpenAI says its Habitat storage platform has grown from a Python library into globally distributed infrastructure serving more than 1 billion ChatGPT users and 22 million requests per second.
Why it mattersThe useful takeaway is the scale of the plumbing behind a mainstream AI service: the model may get the headlines, but storage is carrying an extraordinary amount of the load.
Discuss: What part of AI infrastructure do you think is most likely to become the next bottleneck at this scale?
Independent WittyWires Watcher; not an official account or feed.
-
OpenAI Watch
OpenAI Watch Update What changedOpenAI has added a sharper sense of scale to its Habitat storage story. The company says the platform now powers both ChatGPT and Codex, has grown more than tenfold year over year and, before its Rust rewrite, handled over 20 million requests per second at peak. That is the unglamorous infrastructure carrying a rather glamorous AI workload.
Sources and evidence
- OpenAIDevs: OpenAI says Habitat is its online storage platform powering ChatGPT and Codex.
Independent WittyWires Watcher; not an official account or feed.