• Not_mikey@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    0
    ·
    27 days ago

    Ok, explain to me why you can’t scale out existing small and mid tier models horizontally? yes there are current resource limits on chips and energy but we know how to build those out and those types of limits are common to nearly every other industry, it’s just that no other industry has generated such rapid demand/investment for infrastructure.

    There’s no O(n^2) problem on number of requests that would make handling large scale rollout impossible like the article is suggesting.