OpenAI speeds up data reads for ChatGPT 12-fold
OpenAI has published the second part of an article on how it scaled its online storage system to serve more than 1 billion ChatGPT users. The company developed its system, called Habitat, using reliable multi-tenancy, meaning the secure shared use of a single system by many services, along with global caching and Azure Cosmos DB. As a result, data reads for ChatGPT have become 12 times faster.