AI systems now consume 5 times the number of tokens consumed by humans, and their use has increased by 14 times since February.
More than 85% of token consumption by intelligent systems comes from stored queries, where systems repeatedly try to achieve goals instead of asking individual questions.
This is one of the main reasons behind the sharp rise in demand for memory chips, and Nvidia recently informed customers of a forecast for price increases of 15% or more.
More than 85% of token consumption by intelligent systems comes from stored queries, where systems repeatedly try to achieve goals instead of asking individual questions.
This is one of the main reasons behind the sharp rise in demand for memory chips, and Nvidia recently informed customers of a forecast for price increases of 15% or more.