• 0 Posts
  • 9 Comments
Joined 1 year ago
cake
Cake day: April 3rd, 2024

help-circle
  • I work for a publicly traded company.

    We couldn’t switch away from Microsoft if we wanted to because integrating everything with Azure and O365 is the cheapest solution in the short term, ergo has the best quarterly ROI.

    I don’t think the shareholders give a rat’s ass about data sovereignty if it means a lower profit forecast. It’d take legislative action for us to move away from an all-Azure stack.

    And yes, that sucks big time. If Microsoft stops playing nice with the EU we’re going to have to pivot most of our tech stack on a moment’s notice.



  • AI isn’t taking off because it took off in the 60s. Heck, they were even working on neural nets back then. Same as in the 90s when they actually got them to be useful in a production environment.

    We got a deep learning craze in the 2010s and then bolted that onto neural nets to get the current wave of “transformers/diffusion models will solve all problems”. They’re really just today’s LISP machines; expected to take over everything but unlikely to actually succeed.

    Notably, deep learning assumes that better results come from a bigger dataset but we already trained our existing models on the sum total of all of humanity’s writings. In fact, current training is hampered by the fact that a substantial amount of all new content is already AI-generated.

    Despite how much the current approach is hyped by the tech companies, I can’t see it delivering further substantial improvements by just throwing more data (which doesn’t exist) or processing power at the problem.

    We need a systemically different approach and while it seems like there’s all the money in the world to fund the necessary research, the same seemed true in the 50s, the 60s, the 80s, the 90s, the 10s… In the end, a new AI winter will come as people realize that the current approach won’t live up to their unrealistic expectations. Ten to fifteen years later some new approach will come out of underfunded basic research.

    And it’s all just a little bit of history repeating.


  • Nuclear power has some nice properties (and a whole bunch of terrible ones), is technologically interesting, and has been the premier low-CO₂ energy source for a while. That gets it some brownie points although I agree that it shouldn’t be sacrosanct.

    I personally am mainly interested in using breeder reactors to breed high-level waste that needs to be kept safe for 100,000 years into even higher-level waste that only needs to be kept safe for 200 years. That’s expensive and dangerous but it doesn’t require unknown future technology in other to achieve safe storage for an order of magnitude longer than recorded history.

    There’s a whole bunch of very good questions you can ask about that approach (such as how to handle the proliferation risk) but the idea of turning nuclear waste disposal into a feasibly solvable problem just appeals to me.

    Of course I expect an extreme amount of oversight and no tolerance for fucking up. That may be crazy expensive but we’re talking about large-scale breeder deployment. It’s justified.