Obviously the AI rollout should be slowed down and AI use regulated, like stopping any replacement of workers by AI.
But China is set to win the AI race with their open weight models on par with the current frontier models. And they are building nuclear power and solar and wind like no tomorrow. And they just started to produce sodium ion batteries to solve the grid storage problem.
Spurned by the embargo they are developing more efficient algorithms and “Extreme UV lithography” to catch up to the embargoed chips. The neoliberal model of the west is now falling behind even the high tech sectors.
In case anyone is curious it takes 8 Nvidia B300 cards to run this Kima K3 frontier model yourself (2.8 trillion parameters), costs about half a million. For a big corporation or institutions even in the global south that is relatively cheap and that is the top tier option for running a frontier model. Including complete data sovereignty. Using AMD will be cheaper, and prices will go down once China catches up in like 2030. And you could run that on solar panels and batteries and regenerative water cooling. 8x 1.4kW x24 so maybe 300 kWh LiFePo4 battery so another 50k. Solar panels are basically free these days.
So basically less than 10% extra costs to make AI data centers sustainable. This is a capitalism problem, both the hype / bubble / psychosis (b2b marketing induced) as well as the sustainability question.
i think the layoffs/hiring kinda past the point of no return, i think they will be even more reluctant to hire back all these people and fresh graduates anytime soon. essential become like research/lab industry, barely hiring because they want already “trained” people upon graduation. people have posting on other sites, being unable to look for said job, and they do admit using Ai to generate/mass apply too.
Question is, how long are they going to keep making their new models open weight? GPT2 was open too, y’know. Hell, the company that made it is called "Open"AI. Money corrupts.
And how many concurrent users do you get with 8 B300s on the Kimi K3? I’m not 100% sure on the math, but apparently about <= 4 with full context size.
They can make these models open weight because basically nobody’s gonna be able to run them and you can’t just build a brand new model out of it like you can with regular open source software. That 8 nvidia B300 card minimum isn’t enough to run it commercially, it’s good for like a small 10-20 person company of fairly heavy users, or slightly more if not using heavily.
You say it as if OpenAI started with good intentions and got corrupted by the money. But the most likely explanation is that it was a scam from the start.
Obviously the AI rollout should be slowed down and AI use regulated, like stopping any replacement of workers by AI.
But China is set to win the AI race with their open weight models on par with the current frontier models. And they are building nuclear power and solar and wind like no tomorrow. And they just started to produce sodium ion batteries to solve the grid storage problem.
Spurned by the embargo they are developing more efficient algorithms and “Extreme UV lithography” to catch up to the embargoed chips. The neoliberal model of the west is now falling behind even the high tech sectors.
In case anyone is curious it takes 8 Nvidia B300 cards to run this Kima K3 frontier model yourself (2.8 trillion parameters), costs about half a million. For a big corporation or institutions even in the global south that is relatively cheap and that is the top tier option for running a frontier model. Including complete data sovereignty. Using AMD will be cheaper, and prices will go down once China catches up in like 2030. And you could run that on solar panels and batteries and regenerative water cooling. 8x 1.4kW x24 so maybe 300 kWh LiFePo4 battery so another 50k. Solar panels are basically free these days.
So basically less than 10% extra costs to make AI data centers sustainable. This is a capitalism problem, both the hype / bubble / psychosis (b2b marketing induced) as well as the sustainability question.
i think the layoffs/hiring kinda past the point of no return, i think they will be even more reluctant to hire back all these people and fresh graduates anytime soon. essential become like research/lab industry, barely hiring because they want already “trained” people upon graduation. people have posting on other sites, being unable to look for said job, and they do admit using Ai to generate/mass apply too.
Question is, how long are they going to keep making their new models open weight? GPT2 was open too, y’know. Hell, the company that made it is called "Open"AI. Money corrupts.
And how many concurrent users do you get with 8 B300s on the Kimi K3? I’m not 100% sure on the math, but apparently about <= 4 with full context size.
They can make these models open weight because basically nobody’s gonna be able to run them and you can’t just build a brand new model out of it like you can with regular open source software. That 8 nvidia B300 card minimum isn’t enough to run it commercially, it’s good for like a small 10-20 person company of fairly heavy users, or slightly more if not using heavily.
You say it as if OpenAI started with good intentions and got corrupted by the money. But the most likely explanation is that it was a scam from the start.