[174223] in North American Network Operators' Group
RE: Time Warner outage?
daemon@ATHENA.MIT.EDU (Ray)
Fri Aug 29 22:17:12 2014
X-Original-To: nanog@nanog.org
From: Ray <sixsigma44@hotmail.com>
To: "nanog@nanog.org" <nanog@nanog.org>
Date: Fri, 29 Aug 2014 22:17:03 -0400
In-Reply-To: <53FF8051.5060300@neovera.com>
Errors-To: nanog-bounces@nanog.org
What we noticed on home RoadRunner and on business TWC fiber about 6:15 AM =
EDT on the 27th:
We could access systems from one to another by IP address but not DNS.=20
We could ping other systems by IP.
Home DHCP was up but TWC DNS was down at home and at work on the business f=
iber. Couldn't even reach TWC DNS servers by IP address.
I'm not sure why two different classes of systems=2C business and residenti=
al=2C thirty miles apart would both be down on DNS but up on routing since =
the DNS servers are on different subnets. (We use TWC business DNS as Forwa=
rders.)
It was acting like a DNS failure more than a routing failure for us. I vagu=
ely remembered something about Cox DNS having an outage a few days earlier =
that someone in the Middle East took credit for but I can't find the articl=
e now. I was wondering if TWC was putting in a mitigation and got it wrong=
=2C or TWC did not put in a mitigation and the Middle Easters knocked on th=
eir door. My impression is that it was acting like all DNS traffic in and o=
ut of TWC was getting blocked but it cleared up too soon to perform further=
testing.
Ray
> Date: Thu=2C 28 Aug 2014 15:17:37 -0400
> From: eric.stoltz@neovera.com
> To: nanog@nanog.org
> Subject: Re: Time Warner outage?
>=20
> Looks like TW is having further issues this afternoon.
>=20
> Eric Stoltz
> Neovera
>=20
>=20
> On 08/28/2014 01:37 PM=2C Chris Garrett wrote:
> > Based on the link that Wes shared=2C sounds like someone made a BGP boo=
boo.
> >
> > Not that I routed damn near the whole internet down a customers DS3 or =
anything once=2C but I can see how it could happen and then propagate out o=
f control before it was caught.
> >
> > On Aug 28=2C 2014=2C at 11:57 AM=2C Jay Ashworth <jra@baylink.com> wrot=
e:
> >
> >> ----- Original Message -----
> >>> From: "Steve Naslund" <SNaslund@medline.com>
> >>> I don=92t buy that excuse either. If Level 3 is doing fiber maintenan=
ce
> >>> on any route and takes down your entire network=2C then you have a
> >>> pretty poor backbone design. It is not Level 3s fault if you design
> >>> your network such that a single route loss causes a huge outage.
> >> Does the T-Bone run over L3? I thought it was either owned or dark-le=
ased
> >> fiber and their own routers...
> >>
> >> Cheers=2C
> >> -- jra
> >> --=20
> >> Jay R. Ashworth Baylink jra@bay=
link.com
> >> Designer The Things I Think =
RFC 2100
> >> Ashworth & Associates http://www.bcp38.info 2000 Land R=
over DII
> >> St Petersburg FL USA BCP38: Ask For It By Name! +1 727 =
647 1274
>=20
=
