Rolling outages today (10/2/09)

[Clarity]

Noticed a couple non-loads this afternoon, contacted Puregig and got this in response:

We are currently investigating potential service-impacting issues. We are sending this proactive announcement to keep you informed. We will provide an update as soon as we have more information.

If you have any questions about this announcement, please do not hesitate to reply to this email or call us on the number listed below.

So it you're seeing pockets (a minute or two) here and there where you can't load the site, they're aware (as am I) and they're working on it. Seems to be hitting all their PHX customers.

As far back as I can remember, this is the first time in like 7 years they've been hit with this sort of an unscheduled/unplanned issue.

 

[Clarity]

An update:

This is an update regarding the current network issues. We are having flapping issues with our core routers. We are currently working with our vendors to resolve this as quickly as possible. We will follow up with an ETA and more information as it becomes available.

 

[Steve19]

An update:

Take care, Clarity. One of my best friends tried to deal with a flapping issue concerning his core router in his marriage by working with vendors. The divorce was very expensive.

No sense getting involved in that mess unless you need to.

 

[Clarity]

I'm just trying to sort it out. "Flapping" suggests some sort of bird in the router -- but we have a hamster in the server. Can you mix and match beasts of interwebs burden that way?

 

[Deety]

They're trubble... trubble I tells ya!

 

[OSUsushichic]

Noooo!!! Not during Indiana week!

 

[BUCKYLE]

Someone shaved.

 

[Clarity]

Someone shaved.

Just my cheeks, I'm still good from under the nose down.

 

[OCBucksFan]

First Eric Mangini, now this? Why does god hate Cleveland so much?

 

[Fungo Squiggly]

I want my $77 back.

 

[Clarity]

We called recently and spoke to someone, and there are no updates. It's a facility-wide issue, and they've got a team on it. I asked if they think it could go into tomorrow, and was told by a guy at the NOC that he didn't think so. So we'll see. Expect the site to be going up and down as it has been since 11am until further notice. Annoying, but at least it's not our machine.

 

[Clarity]

Update (arrived just now; delayed because my email is on the server):

Dear Valued Customer,

This announcement refers to the Phoenix PureGig 3443 Facility.

Date/Time:
UTC: 2009-10-02 20:31
PDT: 2009-10-02 13:31
MST: 2009-10-02 13:31
CDT: 2009-10-02 15:31
EDT: 2009-10-02 16:31

This is an update regarding our ongoing network issue this morning. Our network team is diligently working on this. At the moment we do not have an exact ETR on when this issue will be resolved. It is our top priority to continue to work towards a resolution.

If you have any questions about this announcement, please do not hesitate to reply to this email or call us on the number listed below.

 

[Clarity]

Update:

Dear Valued Customer,

This announcement refers to the Phoenix PureGig 3443 Facility.

Date/Time:
UTC: 2009-10-03 00:30
PDT: 2009-10-02 17:30
MST: 2009-10-02 17:30
CDT: 2009-10-02 19:30
EDT: 2009-10-02 20:30

This is an update regarding today's (2009-10-02) service affecting issues. Our networking team has confirmed that service has been restored.

Detailed information regarding today's service issues will be forthcoming.

We'll see. Long day.

 

[NFBuck]

Still really up and down for me.

 

[Clarity]

We'll see. Long day.

Didn't take long to see. They've fixed something, it's just not us. Will continue to update, we just called the NOC.