Ok, explain to me why you can’t scale out existing small and mid tier models horizontally? yes there are current resource limits on chips and energy but we know how to build those out and those types of limits are common to nearly every other industry, it’s just that no other industry has generated such rapid demand/investment for infrastructure.
There’s no O(n^2) problem on number of requests that would make handling large scale rollout impossible like the article is suggesting.
Ok, explain to me why you can’t scale out existing small and mid tier models horizontally? yes there are current resource limits on chips and energy but we know how to build those out and those types of limits are common to nearly every other industry, it’s just that no other industry has generated such rapid demand/investment for infrastructure.
There’s no O(n^2) problem on number of requests that would make handling large scale rollout impossible like the article is suggesting.