MarcellusDrum@lemmy.ml to Technology@lemmy.worldEnglish · 4 months agoThis website is for humanslocalghost.devexternal-linkmessage-square35fedilinkarrow-up1351arrow-down15
arrow-up1346arrow-down1external-linkThis website is for humanslocalghost.devMarcellusDrum@lemmy.ml to Technology@lemmy.worldEnglish · 4 months agomessage-square35fedilink
minus-squarewhyNotSquirrel@sh.itjust.workslinkfedilinkEnglisharrow-up11·4 months agoOpen until your server is down because LLM are overloading it
minus-squarekescusay@lemmy.worldlinkfedilinkEnglisharrow-up14·4 months agoAt my company, we had to implement all sorts of WAF rules precisely for that reason. Those things are fucking aggressive.
minus-squarebrvslvrnst@lemmy.mllinkfedilinkEnglisharrow-up8·4 months agoSame. And just because page size is “low” doesn’t mean shit when they’re flooding requests. Try having public research data and watch how much your costs go up just due to load balancer throughput.
minus-squareDr. Moose@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down16·4 months agooverloading from 200kb of html? We’re not in dialup era anymore
Open until your server is down because LLM are overloading it
At my company, we had to implement all sorts of WAF rules precisely for that reason. Those things are fucking aggressive.
Same. And just because page size is “low” doesn’t mean shit when they’re flooding requests. Try having public research data and watch how much your costs go up just due to load balancer throughput.
overloading from 200kb of html? We’re not in dialup era anymore