LLMs · via Hacker News
IBM's CEO says open-weight models now win on-prem
On IBM's Q3 earnings call, Arvind Krishna said open-weight models are now about 90% as good as frontier models at 10–25% of the token cost, and fit in two or three racks. He expects most enterprise tasks to move to the cheaper option.