cancel
Showing results for 
Search instead for 
Did you mean: 

How is everyone being impacted by the AWS outage today?

Product Manager

How is everyone being impacted by the AWS outage today?  I know here at SolarWinds, Thwack is having a couple of backed issues, and other SAAS apps are being impacted as well. Being the geek that I am, I wanting to see how bad it was. I tried to spin up a new instance in their US-EAST-1 region and could not do it (surprise surprise)  So, I did the next best thing I could think of was and setup Netpath services into a website I knew was being impacted  www.isitdownrightnow.com (ironic huh)

pastedImage_0.png

WOW.  I am not a networking guy, but dang that's a lot of ways in, to bad that NetPath shows that the route into AWS is good. Next up is Pingdom.

pastedImage_3.png

pastedImage_1.png

Sure enough it shows it as down.

So how did/is the AWS outrage impacting you?

27 Comments
Level 15

I expected AWS health events to come from cloudwatch events through SQS and into Splunk but they never came - likely due to underlying S3 outage itself.

Sooooo guess what I get to build?

An AWS health API to Solarwinds integration followed by an integration into ServiceNow since I don't trust the cloudwatch path now.

Anyone want to help code this up?

I work for one of the largest wine & spirits distributors in the US. We contracted with a SAP vendor to develop a Mobility app for our sales reps. We just moved from on-prem to the Cloud in January. Over 3,000 sales reps frozen on the 2nd last day of the month. Brutal!

Horror stories about The Cloud being down.

Who'd have figured . . .

This is me right now.

download.jpg

MVP
MVP

That is kind of why I call it the fog...

Level 12

Fallback? FALLBACK? We don't need no stinkin' fallback!

Level 13

Its snowing again. I think that AWS is directly related to the weather. Or is that a different cloud?

Level 10

Clouds? Can't trust 'em, constantly shifting with the winds.

Level 10

We're a pretty 'untrusting of the cloud' sort of company, so things are quite stable here, and i wouldn't have even noticed it, if other folks hadn't been talking about it. +1 for paranoia, I guess.

Well, you get what you pay for, especially when you're paying another vendor to do it for you!

Level 12

One of our customers had a web server go a little crazy. We determined that it was a Java process that ran amok, but the customer insists the problem was caused by Amazon.

Level 13

No impact to us - we're 100% up...

oh, wait, I don't use a public cloud system, too unstable!

🙂

Level 9

First our virtual cloud when down taking with it all our email connectors and automated alerts.

Then the actual weather kept all the tech awake during the long evening with a tremendous thunderstorm.

All we needed was a flashlight to tell the horror stories with.

Level 10

Found this, and now I can't stop laughing. hahahah!

cloud1.png

MVP
MVP

I didn't know AWS had any issues until today. Guess I'm not consuming as many cloud services as I thought.

MVP
MVP

We don't use it at work, but it does affect my Amazon Music so working without headphones leaves one vulnerable to "Ya gotta minute" so sometimes I have to listen to the sounds of silence.

MVP
MVP

The customer is always right - see adatole​ blog post.

Product Manager
Product Manager

Yea, I have a custom Alexa skill that uses google.  So every time I said "Alexa ask Google...." she would timeout and says something like "I can access that skill".  Didn't even think of trying to access music to see if that was affected.

You can still wear headphones without music, I leave the mic down so they think I am on a conference call. Not fashionable, but effective. I am doing it right now.

Level 12

We were in a meeting while it was going on, discussing if we should upgrade to exchange 2016, office 365, or hybrid. We all laughed when we got back to our desks. On Prem +1, Cloud -1.

MVP
MVP

Previous employer moved to Office 365 - In the Cloud. No problems, worked just like on prem, easy peasy.

Current employer decided to move to hybrid (now I don't know if the blame lies with the configuration, the person on our side the configured thing or something else) but in a hybrid world for us everything is way more complicated. No longer do you build an account and give them email, but you have to build them, assign them the right license, stand on your head, say magic words, build a deployment script, execute the script (while still standing on your head, or it won't work) wait 20 minutes, debug your script if it didn't work, rinse repeat.

Level 12

Are there any sacrifices involved with it? I don't have many chickens to spare right now.

I have herd the same thing from a few other people who went with Hybrid Exchange on prem and O365 in the cloud. They said that setup for new users can be a nightmare, but once its done its all gravy after that.

Level 12

I loved this episode, mainly because of the Warp Core breach smiley cloud!

MVP
MVP

I don't deal with it much myself, but from what I've heard if the connection to the cloud is down you lose a lot of functionality (couldn't say what) so I don't really understand the reason to go hybrid.

Level 12
Level 12

For us, and a lot of people in healthcare it makes some sense though. Over half of our users are people who are in direct patient care, and using a computer is mainly for that purpose. Email is really a secondary thought for them, and most of the devices they use don't even have outlook loaded on them. For those people O365 would be fine, since most of them currently access their email through OWA off site anyway. For the rest of our users that are desk jockies, they get the full outlook client, and would probably stay in the on prem exchange server. At least that is how we envision a hybrid setup in our situation if we chose to do so.

MVP
MVP

I don't know if it's our set up or just how it's done, but all of our clients, web and outlook point to the cloud.

About the Author
New Jersey born and raised. Go YANKEES and JETS :-) Moved to Texas when I was 16 years old making me an official Texan too (I think). Went to college to be an EE and determined there was to much math (like way to much math) and switched to MIS and never looked back. Was always into tech/computers/home AV so this was a nature fit. Just an internship within the IT department of Coca Cola and was hooked. Eventually moved over to and MSP to eventually running my own MSP for SMBs all over Texas. Made my way down in Austin 4 years ago and it's been the one of the best decisions I have ever made.