The Real Cost of Chatting: Why ChatGPT Is a $250M Conversation
Let's talk numbersâbig ones. How big? Try $700,000 a day big. That's what it costs to keep ChatGPT up and running. đ€
According to a report by SemiAnalysis, OpenAI spends about $694,444 daily on this chatbot.
And if you're not a fan of math, let me break it down for you: that's a whopping $250 million a year. The culprit? Power-hungry chips.
To get technical, ChatGPT operates on about 3,617 HGX A100 servers, which total up to 28,936 GPUs. These aren't your everyday gaming GPUs; these are high-octane, performance-centric beasts.
Each query you shoot at ChatGPT costs around 0.36 cents. It may not sound like much, but multiply it by millions of users, and it starts making sense. Or cents, if you will.
Now, this data is pre-GPT-4. So, by now, the operational costs have likely soared even higher. And hereâs a thought: If GPUs are this expensive, what's the strategy for the future?
Enter MicrosoftâOpenAI's largest investor. They're developing their own chips to cut down the reliance on Nvidia's costly GPUs.
But don't lose all hope. Investment firm ARK has a silver lining for us. According to Wright's Law of Cost declines, the price of running AI models like ChatGPT will plummet as technology advances.
Let's hope that prediction holds because, at this rate, we're gonna need a financial superhero cape for ChatGPT. đŠžââïž
So the next time you ask ChatGPT to write a sonnet or solve an equation, remember: someone, somewhere is paying a pretty penny for that computational poetry. đ€
Let's talk numbersâbig ones. How big? Try $700,000 a day big. That's what it costs to keep ChatGPT up and running. đ€
According to a report by SemiAnalysis, OpenAI spends about $694,444 daily on this chatbot.
And if you're not a fan of math, let me break it down for you: that's a whopping $250 million a year. The culprit? Power-hungry chips.
To get technical, ChatGPT operates on about 3,617 HGX A100 servers, which total up to 28,936 GPUs. These aren't your everyday gaming GPUs; these are high-octane, performance-centric beasts.
Each query you shoot at ChatGPT costs around 0.36 cents. It may not sound like much, but multiply it by millions of users, and it starts making sense. Or cents, if you will.
Now, this data is pre-GPT-4. So, by now, the operational costs have likely soared even higher. And hereâs a thought: If GPUs are this expensive, what's the strategy for the future?
Enter MicrosoftâOpenAI's largest investor. They're developing their own chips to cut down the reliance on Nvidia's costly GPUs.
But don't lose all hope. Investment firm ARK has a silver lining for us. According to Wright's Law of Cost declines, the price of running AI models like ChatGPT will plummet as technology advances.
Let's hope that prediction holds because, at this rate, we're gonna need a financial superhero cape for ChatGPT. đŠžââïž
So the next time you ask ChatGPT to write a sonnet or solve an equation, remember: someone, somewhere is paying a pretty penny for that computational poetry. đ€