Hey! Great idea! Let’s make all of the internet rely on one service from one evil company! What could go wrong?
Typical Amazon undersells everyone else to remove competition. Then after everyone has gone under reminds you it is a terrible idea. Hopefully we see businesses get burnt more and determine it is better to self host, or even better yet not need half their services on “the cloud” anyways.
even the websites for local health systems have been going down. At this point if we have an event like Y2K was supposed to be, we are so fucked lol
Amazon sneezes, the whole internet catches a cold.
Im still seeing services up/down the entire day at work. Services that are not even AWS like Azure are slow for some reason (probably businesses failing over to other infa). Its crazy.
None of our in office infa is having issues. Managers are talking about fail-overs all day lol.
When a handful of people own all the companies in the world, the whole world becomes a single point of failure.
Soon: “Welcome to Amazon, I love you.”
There are some downstream / knock on effects going on which can be explained…but I can’t help but wonder if today’s story is bigger than just AWS. AWS saying it was an outage of a “few hours” for DynamoDB and DNS…and that doesn’t line up all that great with what people are reporting in the wild . I’m not trying to start a conspiracy theory, just wondering what the post mortems will tell us, if anything. Obviously the suits want to keep embarrassing fuckups downplayed as much as possible.
As someone with a little insider baseball knowledge, it was just a few hours down of DynamoDB and DNS. However, that caused EC2 to go down for ~1 day, which causes pretty much 1/3 of the internet to go down. Once EC2 sorts themselves out, then teams/companies (almost all amazon services use EC2 in the back end) that use EC2 have to get their ducks back in a row, and that can take any span of time, depending on how well their code was written to handle failures + how many people they are willing to pay oncall/overtime.
Its crazy, we are seeing unrelated services stop sending emails, issues with DNS, all sorts of strange stuff.
Maybe it’s cascade effects? Something depends on something else, which depends on a third thing that depends on AWS for something?
Same with us. Had to reboot/restart a number of things, and resynch clocks.
They want to keep the news of the rally over the weekend as quiet as possible.
and the epstein files. i heard it dint affect international that much, so its rather covenient.
Dave explains the “long tail” of recovery:
games were affected online, plus apps, and then anyone in retail who does inventory, order writing.
Maybe it was a bad idea for society to put 90% of the internet on one company’s infrastructure.
So Roblox is the only of those companies that can handle proper region failover if us-east-1 shits the bed? You young ops have gotten soft! Learn to live by ChaosMonkey or die by the Gorilla.
Yeah, but proper failover and recovery requires additional infrastructure, and that costs money.
Hopefully a bunch of risk management people are writing I-told-you-so emails to C-suites right now.
Yeah but not to worry, C-suites have pretty good filtering rules in place to never read them. Saves time, really.
Yup, and some things which can be moved cannot be done automatically, quickly or easily…even if you are prepared. AWS is a huge suite of products and services, and there’s a lot of old legacy shit running on it. I wouldn’t punch down on the ops for this one. Cybersecurity and disaster recovery are not directly profitable, so they are almost always neglected in your average shop.
AWS is a huge suite of products and services, and there’s a lot of old legacy shit running on it.
Yup, AWS is legacy cloud. It was only recently that they set encryption by default on S3 buckets, before that they were just in the clear by default.
Cybersecurity and disaster recovery are not directly profitable, so they are almost always neglected in your average shop.
It’s never important until suddenly it’s the most important thing in the world.
So Roblox is the only of those companies that can handle proper region failover if us-east-1 shits the bed?
Either that, or the reports stopped coming in since it’s a school day.
Roblox doesn’t really lock down regions unless they are China. The game client can connect to any server they own. It naturally falls back to the server with the least issues without prompts and intervention. If for an even bigger example all US servers were to go offline, the client automatically redirects people to either Europe or Asia based on ping.
I think they’re the only ones doing multi-cloud. If us-east-1 shits the bed, it’s a bad day for AWS in general.
Let’s take a decentralized network and centalize it! Nothing will surely go wrong.
Jesus Amazon is a big enough company they should be doing their own hosting not using AWS.
They’re big enough to be a utility and be nationalized!
And should be
Amazon is using their own hosting. AWS stands for Amazon Web Services. Or did I miss the joke?
Miss
I was confused too, but I’m still glad you didn’t add the /s because that always kills the joke.
I don’t always downvote posts that use /s, but I do always downvote posts that complain about someone not using it.
Sarcasm is ok but deadpan is where it’s at.
This is the take. Let people communicate however they want, sarcasm indicator or not; it’s the insisting that others follow the convention you prefer which I find actually bothersome
I for one don’t think you missed anything
Once upon a time they insisted that Amazon had independent decision making on their providers when they were needing new infrastructure and they “always decided that AWS suited them best.”
Shockingly (/s), they stopped making that claim right about the same time they started admitting that their biggest users are all under Private Pricing Agreements.
I am grateful that my past me (from few months ago) decided to study Slavic philology, instead of getting stupid tech job. I hate modern tech, including anything from big corporations.
I am also glad that I’ve switched to Linux (Debian ftw) to escape software enshittification.
It’s not a full escape, just a path to escape.
I’d argue you cna never fully escape the problem of enshittification, unless you produce and maintain everything you use by yourself. Given how much of what we need today requires specialist labour and how impossible it is to be a specialist in everything, chances are you’d be trading enshittification for plain shit.
But using Debian at least shuts down one source of enshittification. Just because perfection can’t ever fully be attained is no reason not to try and get as close as you can.
…and I did not even notice it, aside from the news here.
It really shows what a great life that we on the Fediverse are living, by making our tech independent to a degree from the largest tech providers.
Figma balls wheeeyyyy
It seems that there is not a single original thought in that head of mine.
doesn’t matter bro, they’re your thoughts and that’s what makes them awesome 😊
Alright…
crushes your balls with ginger root which makes them burn
Are any lemmy instances run on aws? Been getting a lot less articles last couple days
Maybe the bots are run by AWS
I’d be surprised if none are run in AWS.
Bottom left
figma ballz hahaha gotem
Edit: ohh noooo I just saw PhobosAnomaly’s post, I am so slow
The cloud was a scam for people with more money than sense.
Most people hosting things on the cloud, like Fediverse services, would be better off selfhosting and buying the hardware themselves.
Self hosting requires an immense amount of specialized knowledge and time…
It really doesn’t, and certainly not more than running something on AWS.
In fact, hosting on cloud infrastructure adds another layer of complexity.
I stand by my original assertion.
You’re just wrong…
I got started self-hosting last week when I got a hold of a smal Lenovo ThinkCentre. I installed Proxmox on it and if I want to self-host something I just spin up a container or virtual machine on the Proxmox system. It’s so much easier than installing self-hosted projects on bare metal. And if you want to change things around then just disable or delete the container/vm and let Proxmox stay clean. If one container breaks the rest of the system will still function.
I could easily host Lemmy from home with Proxmox and a reverse proxy with my current setup. I am not going to because I am not interested in moderating a platform and all the responsibility that comes with it, but it’s very possible to do.
Edit: the Proxmox community helper scripts makes installing most things a breeze! I use them every opportunity I get.
https://community-scripts.github.io/ProxmoxVE/
This is the first script to start with on a fresh install
https://community-scripts.github.io/ProxmoxVE/scripts?id=post-pve-install
Cool?
The point was that self-hosting is not hard if you do it the right way. You claim it’s very hard and requires specialized knowledge. I don’t think it’s much different than hosting in the cloud.
I didn’t say it was “hard”. I said it requires specialized knowledge. Which it does. And which you’ve not disproven in any way.
Once could say it requires special knowledge to host a service in the cloud too. The extra step I had to take was to open port 80 and 433 on my server and install nginx to forward the traffic to the right container on my local network since I only have one public IP. It took me minimal research to figure it out.
You realize hosting on a VPS is still selfhosting? And my comment was about selfhosting?
Diversity is a strength when things go bad.
Time for open source Amazon app alternatives to be made. Made a post on OpenSource with suggestions on how to do it and how it can help open source communities: KDE, GNU/Linux, etc can each make their own and use their profits for their own and other open source projects. A passive income if you will from making, and managing the app that displays products from various partnered stores and websites
For some context, the issue was affecting AWS or Amazon Web Services, which is hosting for those other services (or parts of them), not an amazon app issue cascading to other services.
And I don’t think an open source amazon app would work. Amazon is a lot more than just a webstore. They’ve got a massive logistics network plus warehouses and packing plants. I feel like an open source version of amazon’s store would end up avoiding the corporate shit but would have all the negatives of amazon store without many of the positives.
