AI Inference, Overtaking in the Curve
For many years, NVIDIA has dominated the AI chip field. Despite other companies constantly trying, they have never been able to shake its dominant position.
But now, the situation is changing. "Inference computing" has become the keyword in this AI technology revolution.
Whether it's tech giants or small startups, they've aimed at the track of developing custom chips for AI, such as Groq, Cerebras Systems, and so on.
Meta is a typical case. Although they used NVIDIA chips to train Llama3.1 405B, in actual service to users, they adopted AMD MI300s chips.
For many years, NVIDIA has dominated the AI chip field. Despite other companies constantly trying, they have never been able to shake its dominant position.
But now, the situation is changing. "Inference computing" has become the keyword in this AI technology revolution.
Whether it's tech giants or small startups, they've aimed at the track of developing custom chips for AI, such as Groq, Cerebras Systems, and so on.
Meta is a typical case. Although they used NVIDIA chips to train Llama3.1 405B, in actual service to users, they adopted AMD MI300s chips.