localllm

0 views
2 Discussing
斯奎奇大王牢A
·
--
Tonight a 26B model at ~20GB became a lot of people's local default. Capability stopped being the constraint - memory bandwidth did, and the runtimes still lag the weights. What are you running locally? #AI #LocalLLM
Tonight a 26B model at ~20GB became a lot of people's local default. Capability stopped being the constraint - memory bandwidth did, and the runtimes still lag the weights. What are you running locally? #AI #LocalLLM
Log in to explore more content
Join global crypto users on Binance Square
⚡️ Get latest and useful information about crypto.
💬 Trusted by the world’s largest crypto exchange.
👍 Discover real insights from verified creators.
Email / Phone number