[94593] in North American Network Operators' Group
RE: Westin Seattle Outage?
daemon@ATHENA.MIT.EDU (John van Oppen)
Sat Jan 27 11:56:38 2007
Date: Sat, 27 Jan 2007 08:55:34 -0800
From: "John van Oppen" <john@vanoppen.com>
To: "Rick Kunkel" <kunkel@w-link.net>,
"chuck goolsbee" <chucklist@forest.net>
Cc: <nanog@merit.edu>
Errors-To: owner-nanog@merit.edu
This was not a building wide problem; apparently it did serve to find
the failed UPSes in a few places. The building management does these
tests several times a year, and at least to the one colo where we had
visibility to the building electrical service, we saw the same outages
we always see during such a test.
It is also worth noting, that I only saw one of about 60 BGP sessions
across the Seattle-IX (which is in the building) reset at the time of
the work. =20
John
-----Original Message-----
From: owner-nanog@merit.edu [mailto:owner-nanog@merit.edu] On Behalf Of
Rick Kunkel
Sent: Friday, January 26, 2007 11:26 PM
To: chuck goolsbee
Cc: nanog@merit.edu
Subject: Re: Westin Seattle Outage?
We too had probs. I saw only two outages, one around 8PM PDT and one
around 9:45PM PDT. I called during the first one, and the people I
talked
to were obviously in a state, and I had trouble hearing anyone, as they
were in an extremely loud part of the data center or something. From
what
I could understand through the noise of some really loud fans or a
generator, there was a power test of some kind, and a generator flaked
or
something. I've requested more detailed info, but have yet to receive
it. =20
From what I understand, it affected more than just one provider.
--Rick Kunkel
On Fri, 26 Jan 2007, chuck goolsbee wrote:
>=20
> >We just saw one of our gig-e circuits to the Westin bounce three=20
> >times and another just go flatline in the past hour.
>=20
> Answering my own question I know, but the OnFiber/Qwest guys I spoke=20
> to informed me that they heard the Westin had some sort of backup=20
> power scheduled maintenance go wrong. That was the 3 bouncer. I still=20
> wouldn't mind independent verification of that.
>=20
>=20
> The flatliner was XO, and it seems that it may not even touch the=20
> Westin (instead goes to 1000 Denny.) I still don't know what happened=20
> there. It did come back after 86 minutes of eerie silence. Anyone=20
> else with XO circuits see anything odd tonight?
>=20
>=20
>=20
> --chuck
>=20
> Note to XO NOC: Your hold music is *awful* and on a way too short=20
> loop. It is bad enough when it is bad music, but to hear it over and=20
> over and over... for well over an hour, is customer torture.
>=20
