The significance of open-source inference frameworks isn't in the technical details.

It's that the cost curve is now public.

Before, everyone had to guess what others were spending on inference. Now you can calculate it from the code.

Once costs can be calculated, markups can't stay hidden.

That's good for people building applications, and bad for those who only know how to tell stories. 🔍

#开源 #推理