[174177] in North American Network Operators' Group
Re: Time Warner outage?
daemon@ATHENA.MIT.EDU (Chris Garrett)
Thu Aug 28 09:37:23 2014
X-Original-To: nanog@nanog.org
From: Chris Garrett <chris@aperturefiber.com>
In-Reply-To: <9578293AE169674F9A048B2BC9A081B40124F7B3B5@MUNPRDMBXA1.medline.com>
Date: Thu, 28 Aug 2014 08:35:11 -0500
To: "Naslund, Steve" <SNaslund@medline.com>
Cc: "nanog@nanog.org" <nanog@nanog.org>
Errors-To: nanog-bounces@nanog.org
I have never seen BGP drop peers because of a DHCP failure.=20
I would love to see the breakdown on that.=20
TW NOC had said it was a Level 3 fiber maintenance gone bad that took =
down their peering connections when we called in at the time of the =
event.=20
Can anyone confirm one way or the other?
On Aug 28, 2014, at 8:29 AM, Naslund, Steve <SNaslund@medline.com> =
wrote:
> Something sounds really unlikely about that. Lack of DHCP would not =
cause reachability problems except for the clients. The trace below =
looks like a transit connection that should be unaffected by DHCP. =
Looks more like a routing issue. Also sounds unlikely that one DHCP =
server would be covering this large a scope.
>=20
> Steven Naslund
> Chicago IL
>=20
> -----Original Message-----
> From: NANOG [mailto:nanog-bounces@nanog.org] On Behalf Of Chris Lane
> Sent: Thursday, August 28, 2014 8:23 AM
> To: Stephen Satchell
> Cc: nanog@nanog.org
> Subject: Re: Time Warner outage?
>=20
> I heard the following,
>=20
> It was actually an engineer doing maintenance on the dhpc server that =
stopped customers from getting an IP address when the connected to the =
network between 5:30 and 7:00. The funny part is upper Managment heard =
about it on the today show
>=20
>=20
> On Thu, Aug 28, 2014 at 8:46 AM, Stephen Satchell <list@satchell.net> =
wrote:
>=20
>> This just keeps getting better and better:
>>=20
>> "Yahoo Logo
>> Will be right back...
>>=20
>> Thank you for your patience.
>>=20
>> Our engineers are working quickly to resolve the issue."
>>=20
>> My upstream is Charter Business...
>>=20
>> On 08/28/2014 04:05 AM, Chris Garrett wrote:
>>> I believe this is what is commonly referred to in our industry as a
>> =93resume generating event=94.
>>>=20
>>>=20
>>> On Aug 27, 2014, at 8:24 AM, Alexandru Suciu=20
>>> <alex.suciu.sum@gmail.com>
>> wrote:
>>>=20
>>>> Can't wait to see the postmortem report on this one.
>>>>=20
>>>> On 8/27/2014 3:05 PM, Adam Greene wrote:
>>>>> Came back for us, too, at about 7am.
>>>>>=20
>>>>> Outage was a biggie this time:
>>>>>=20
>>>>>=20
>> =
https://news.yahoo.com/time-warner-cable-suffering-massive-nationwide-
>> outage
>>>>> -110549606.html
>>>>>=20
>>>>>=20
>>>>> -----Original Message-----
>>>>> From: NANOG [mailto:nanog-bounces@nanog.org] On Behalf Of David
>> Coulson
>>>>> Sent: Wednesday, August 27, 2014 6:59 AM
>>>>> To: Rick Coloccia
>>>>> Cc: <nanog@nanog.org>
>>>>> Subject: Re: Time Warner outage?
>>>>>=20
>>>>> Just came back up for me.
>>>>>=20
>>>>> Sent from my iPad
>>>>>=20
>>>>>> On Aug 27, 2014, at 6:48 AM, Rick Coloccia <coloccia@geneseo.edu>
>> wrote:
>>>>>>=20
>>>>>> BGPMON shows my routes falling off the net at around 5:49am.
>>>>>>=20
>>>>>> We now sit at their mercy....
>>>>>>=20
>>>>>>=20
>>>>>> --
>>>>>> Sent from my iPhone
>>>>>>=20
>>>>>>> On Aug 27, 2014, at 6:46 AM, "Adam Greene"=20
>>>>>>> <maillist@webjogger.net>
>>>>> wrote:
>>>>>>> Same here. Seems like no traffic is exiting TWC:
>>>>>>>=20
>>>>>>> Tracing route to ns03.savvis.net [204.70.25.234] over a maximum=20=
>>>>>>> of
>> 30
>>>>>>> hops:
>>>>>>>=20
>>>>>>> 1 1 ms 1 ms 1 ms 10049.webjogger.net [204.8.80.49]
>>>>>>> 2 27 ms 6 ms 5 ms cpe-24-29-112-25.nyc.res.rr.com
>>>>>>> [24.29.112.25]
>>>>>>> 3 12 ms 8 ms 7 ms =
rdc-69-193-225-74.nyc.bc.twcable.com
>>>>>>> [69.193.225.74]
>>>>>>> 4 9 ms 9 ms 12 ms =
rdc-69-193-225-137.nyc.bc.twcable.com
>>>>>>> [69.193.225.137]
>>>>>>> 5 9 ms 10 ms 8 ms =
rdc-69-193-225-222.nyc.bc.twcable.com
>>>>>>> [69.193.225.222]
>>>>>>> 6 * * * Request timed out.
>>>>>>> 7 * * * Request timed out.
>>>>>>> 8 * * * Request timed out.
>>>>>>> 9 * * * Request timed out.
>>>>>>>=20
>>>>>>> -----Original Message-----
>>>>>>> From: NANOG [mailto:nanog-bounces@nanog.org] On Behalf Of Rick=20=
>>>>>>> Coloccia
>>>>>>> Sent: Wednesday, August 27, 2014 6:43 AM
>>>>>>> To: nanog@nanog.org
>>>>>>> Subject: Re: Time Warner outage?
>>>>>>>=20
>>>>>>> My whole campus (~10000 users) is down... Since roughly 6am. =20
>>>>>>> TWC is our upstream.
>>>>>>>=20
>>>>>>> --
>>>>>>> Sent from my iPhone
>>>>>>>=20
>>>>>>>> On Aug 27, 2014, at 6:28 AM, Rob Barbeau=20
>>>>>>>> <rob.barbeau@gmail.com>
>> wrote:
>>>>>>>>=20
>>>>>>>> David,
>>>>>>>>=20
>>>>>>>> I have a branch office in Syracuse,NY that appears to be down=20=
>>>>>>>> at the moment that uses a time warner business connection for=20=
>>>>>>>> internet
>> access.
>>>>>>>>=20
>>>>>>>> -rob
>>>>>>>> On Aug 27, 2014 5:20 AM, "David Hubbard"
>>>>>>>> <dhubbard@dino.hostasaurus.com>
>>>>>>>> wrote:
>>>>>>>>=20
>>>>>>>>> Hey all, anyone else having issues with Time Warner=20
>>>>>>>>> residential or business connections? One of our offices is=20
>>>>>>>>> down and the route is not currently in bgp.
>>>>>>>>> http://downdetector.com/status/time-warner-cable
>>>>>>>>> shows thousands of reports of outages on the consumer side=20
>>>>>>>>> starting an hour or so ago so I figure it's a larger issue=20
>>>>>>>>> than just my one office; couldn't reach anyone by phone.
>>>>>>>>>=20
>>>>>>>>> Thanks,
>>>>>>>>>=20
>>>>>>>>> David
>>>>=20
>>>=20
>>=20
>>=20
>=20
>=20
> --
> //CL
