OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, using software optimization alone. Engineers achieved more than 50% savings ...

Today, frontier AI labs such as OpenAI and Anthropic are among its biggest and most strategically important customers. These companies need vast amounts of data to train foundation models. But that is ...