[175269] in North American Network Operators' Group
Re: Major Level3 Issues
daemon@ATHENA.MIT.EDU (Jason Canady)
Thu Oct 16 21:32:09 2014
X-Original-To: nanog@nanog.org
In-Reply-To: <CAEwH5Xy2KW=imTfh4hMCVU2TfFHyUdwQg6+Cqxi2mNSgWP_CFA@mail.gmail.com>
From: Jason Canady <jason@unlimitednet.us>
Date: Thu, 16 Oct 2014 21:32:01 -0400
To: Dean Perrine <deanperrine@gmail.com>
Cc: "nanog@nanog.org" <nanog@nanog.org>
Errors-To: nanog-bounces@nanog.org
Dean,
Best I have is from their portal:
The IP NOC reports that a module failed on a device in Chicago, IL causing a=
dditional impact to IP services across Multiple Markets. The IP NOC has conf=
irmed that the module initially failed and recovered prior to manual interve=
ntion. A short time later, the module failed again, restored of its own acco=
rd and continued to bounce thereafter. Services have since been restored and=
stable as of approximately 23:54 GMT. The equipment vendor is being engaged=
to assist in isolation efforts to determine a root cause and the IP NOC is c=
ontinuing to monitor at this time.
We rerouted away majority traffic from Level 3 and will leave it till late t=
onight or early morning. We experienced two major blips tonight.=20
Jason
On Oct 16, 2014, at 21:25, Dean Perrine <deanperrine@gmail.com> wrote:
> Just had major outages on our Level3 connections across the country. (LA,
> TX, ORD)
>=20
> Anyone have any news / updates which can be shared?
>=20
> Looks like AT&T and XO had loss of connectivity to Level3?
>=20
> Thank you!
> Dean