[160442] in North American Network Operators' Group

home help back first fref pref prev next nref lref last post

RE: Level3 worldwide emergency upgrade?

daemon@ATHENA.MIT.EDU (Alex Rubenstein)
Wed Feb 6 08:46:44 2013

From: Alex Rubenstein <alex@corp.nac.net>
To: Jared Mauch <jared@puck.nether.net>
Date: Wed, 6 Feb 2013 08:50:03 -0500
In-Reply-To: <BFED3870-13AA-49DD-B0DA-4EFD5F34F3C3@puck.nether.net>
Cc: "nanog@nanog.org" <nanog@nanog.org>
Errors-To: nanog-bounces+nanog.discuss=bloom-picayune.mit.edu@nanog.org

> Yeah, perhaps not as elegantly worded as I would have hoped, but there ar=
e
> many reasons things "go down".  Just one of those elements is the interne=
t
> part, there's also transport, power, and other elements that combine to
> make this complex system called the internet.  If you N+N or N+1 your
> power, perhaps something similar for your connectivity is important.  Or =
you
> just plan to be down/broken periodically for 30 minutes and have a plan t=
o
> cover that.

Agreed.

> The building where our NOC is located sometimes gets evacuated.  Having a
> plan for that is important.  During one visit, there was a small fire in =
the
> building (or so we were told).  Certainly an unexpected event that disrup=
ted
> us for ~30 minutes.

And, if it is important to you, you will have N+N NOC's - ie, more than one=
, and different buildings, cities, or countries, depending on your requirem=
ent.


> The handling and response of these events certainly is important.  I do w=
ant
> to understand why and how it's so bad so if there are things as a SP in t=
he
> community we can improve upon we can do that.

I suspect, as I touched previously, the most noise will come from the peopl=
e who are the least realistic, and least prepared. Personally, I live with =
the expectation that whatever it is (power, fiber, transport, ISP, highways=
, fuel delivery, etc.) will at some point be broken, degraded, or otherwise=
 unavailable, and you have to plan accordingly.=20

Personally (and I speak for NAC) I/we don't care, really, if any upstream I=
P provider breaks; we have made appropriate plans to work around that in an=
 automated fashion. Hope that answers your more general question.








home help back first fref pref prev next nref lref last post