MarcellusDrum@lemmy.ml to Technology@lemmy.worldEnglish · 4 days agoThis website is for humanslocalghost.devexternal-linkmessage-square41fedilinkarrow-up1417arrow-down17
arrow-up1410arrow-down1external-linkThis website is for humanslocalghost.devMarcellusDrum@lemmy.ml to Technology@lemmy.worldEnglish · 4 days agomessage-square41fedilink
minus-squarewhyNotSquirrel@sh.itjust.workslinkfedilinkEnglisharrow-up12·4 days agoOpen until your server is down because LLM are overloading it
minus-squarekescusay@lemmy.worldlinkfedilinkEnglisharrow-up14·4 days agoAt my company, we had to implement all sorts of WAF rules precisely for that reason. Those things are fucking aggressive.
minus-squarebrvslvrnst@lemmy.mllinkfedilinkEnglisharrow-up8·4 days agoSame. And just because page size is “low” doesn’t mean shit when they’re flooding requests. Try having public research data and watch how much your costs go up just due to load balancer throughput.
minus-squareDr. Moose@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down19·4 days agooverloading from 200kb of html? We’re not in dialup era anymore
Open until your server is down because LLM are overloading it
At my company, we had to implement all sorts of WAF rules precisely for that reason. Those things are fucking aggressive.
Same. And just because page size is “low” doesn’t mean shit when they’re flooding requests. Try having public research data and watch how much your costs go up just due to load balancer throughput.
overloading from 200kb of html? We’re not in dialup era anymore