[166792] in North American Network Operators' Group
RE: Cogent packet loss to Verizon in San Jose
daemon@ATHENA.MIT.EDU (Shaw, Matthew)
Fri Nov 8 14:06:46 2013
From: "Shaw, Matthew" <mshaw@fairpoint.com>
To: Matthew Huff <mhuff@ox.com>, Robert Glover <robertg@garlic.com>, "NANOG
Mailing List" <nanog@nanog.org>
Date: Fri, 8 Nov 2013 19:06:13 +0000
In-Reply-To: <483E6B0272B0284BA86D7596C40D29F9021179170F25@PUR-EXCH07.ox.com>
Errors-To: nanog-bounces+nanog.discuss=bloom-picayune.mit.edu@nanog.org
--_002_457F9455036417428963A59E3B388741202B6B270NH1C2P10fairpo_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Issues in NYC today too. We confirmed traffic coming in from VZW as well a=
s Comcast through Cogent to us both seeing drops at that same point.
Matthew Shaw - Sr. Network Administrator=20
FairPoint Communications | mshaw@fairpoint.com=20
-----Original Message-----
From: Matthew Huff [mailto:mhuff@ox.com]=20
Sent: Friday, November 08, 2013 12:49 PM
To: Robert Glover; NANOG Mailing List
Subject: RE: Cogent packet loss to Verizon in San Jose
This has been going on nationwide between Cogent and other peering partner=
s since early 2013 (and in some cases before), but especially between Coge=
nt and Verizon. It's not a technical problem, but a political one.=20
We resolved our issue by working with our upsteam providers to reconfigure=
our routing and advertisements to avoid cogent, otherwise, I don't think =
there is any solution coming within a reasonable timeframe
----
Matthew Huff=A0 | 1 Manhattanville Rd
Director of Operations=A0=A0=A0| Purchase, NY 10577
OTA Management LLC | Phone: 914-460-4039
> -----Original Message-----
> From: Robert Glover [mailto:robertg@garlic.com]
> Sent: Friday, November 08, 2013 12:30 PM
> To: NANOG Mailing List
> Subject: Cogent packet loss to Verizon in San Jose
>=20
> Anyone from Cogent around? Normal support channels aren't getting me=20=
> anywhere.
>=20
> We have been seeing consistent packet loss to Verizon over Cogent in=20
> San Jose for several days:
>=20
> HOST: noc-auth1.garlic.com Loss% Snt
> Last Avg Best Wrst StDev
> 1. router.garlic.com 0.0% 10 0.4
> 0.3 0.2 0.4 0.0
> 2. vl203.mag03.sfo01.atlas.cogentco.com 0.0% 10 2.2
> 2.3 2.1 2.4 0.1
> 3. te0-2-0-1.mpd21.sfo01.atlas.cogentco.com 0.0% 10 2.6
> 2.6 2.4 2.8 0.1
> 4. be2166.ccr21.sjc01.atlas.cogentco.com 0.0% 10 3.9
> 3.9 3.7 4.2 0.1
> 5. be2000.ccr21.sjc03.atlas.cogentco.com 0.0% 10 4.7
> 4.4 4.3 4.7 0.1
> 6. verizon.sjc03.atlas.cogentco.com 40.0% 10 80.0
> 80.8 79.9 81.8 0.7
> 7. so-1-0-0-0.SJC01-CORE-RTR1.verizon-gni.net 30.0% 10 82.2
> 87.9 81.1 114.6 11.3
> 8. A8-0-1710.SNFCCA-DSL-01.verizon-gni.net 30.0% 10 83.2
> 83.8 82.1 85.9 1.3
> 9. static-71-116-125-210.snfcca.dsl-w.verizon.net 20.0% 10 108.1
> 107.2 105.7 108.7 1.1
>=20
>=20
> We have had to route some customer's traffic out through our alternate=20=
> provider (AS20115), as their VPN's were borked by the packet loss.
>=20
> Thanks,
> -Bobby
_______________________________________________________________________
This e-mail message and its attachments are for the sole use of the intend=
ed recipients. They may contain confidential information, legally privile=
ged information or other information subject to legal restrictions. If yo=
u are not the intended recipient of this message, please do not read, copy=
, use or disclose this message or its attachments, notify the sender by re=
plying to this message and delete or destroy all copies of this message an=
d attachments in all media.
--_002_457F9455036417428963A59E3B388741202B6B270NH1C2P10fairpo_
Content-Type: message/rfc822
Content-Disposition: attachment;
creation-date="Fri, 08 Nov 2013 19:06:13 GMT";
modification-date="Fri, 08 Nov 2013 19:06:13 GMT"
Received: from 0NH1C2P10.fairpoint.com (172.24.44.16) by
0NH1C2P11.fairpoint.com (172.24.44.17) with Microsoft SMTP Server (TLS) id
14.3.123.3; Fri, 8 Nov 2013 11:54:00 -0500
Received: from 0NH1EVSP01.fairpoint.com (172.24.37.4) by
0NH1C2P10.fairpoint.com (172.24.44.16) with Microsoft SMTP Server id
14.3.123.3; Fri, 8 Nov 2013 11:53:59 -0500
Received: from 0nh1c2p04.fairpoint.com ([172.24.15.10]) by
0NH1EVSP01.fairpoint.com with Microsoft SMTPSVC(6.0.3790.3959); Fri, 8 Nov
2013 11:53:59 -0500
Received: from mail6.bemta12.messagelabs.com ([216.82.250.247]) by
0nh1c2p04.fairpoint.com over TLS secured channel with Microsoft
SMTPSVC(6.0.3790.3959); Fri, 8 Nov 2013 11:53:58 -0500
Received: from [216.82.249.211:9095] by server-9.bemta-12.messagelabs.com id
BA/8F-09044-6271D725; Fri, 08 Nov 2013 16:53:58 +0000
Received: (qmail 28540 invoked from network); 8 Nov 2013 16:53:57 -0000
Received: from puck.nether.net (HELO puck.nether.net) (204.42.254.5) by
server-10.tower-53.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 8
Nov 2013 16:53:57 -0000
Received: from puck.nether.net (localhost [127.0.0.1]) by puck.nether.net
(8.14.7/8.14.5) with ESMTP id rA8GoMxh018146; Fri, 8 Nov 2013 11:53:51 -0500
Received: from mail1.bemta12.messagelabs.com (mail1.bemta12.messagelabs.com
[216.82.251.2]) by puck.nether.net (8.14.7/8.14.5) with ESMTP id
rA8GoGFi018024 for <outages@outages.org>; Fri, 8 Nov 2013 11:50:16 -0500
Received: from [216.82.249.211:14204] by server-2.bemta-12.messagelabs.com id
89/2A-23225-A501D725; Fri, 08 Nov 2013 16:24:58 +0000
Received: (qmail 27262 invoked from network); 8 Nov 2013 16:24:58 -0000
Received: from owa.fairpoint.com (HELO 0nh1c2p04.fairpoint.com)
(209.105.163.3) by server-2.tower-53.messagelabs.com with SMTP; 8 Nov 2013
16:24:58 -0000
Received: from 0NH1EVSP01.fairpoint.com ([172.24.37.4]) by
0nh1c2p04.fairpoint.com with Microsoft SMTPSVC(6.0.3790.3959); Fri, 8 Nov
2013 11:24:57 -0500
Received: from 0NH1C2P11.fairpoint.com ([172.24.32.61]) by
0NH1EVSP01.fairpoint.com with Microsoft SMTPSVC(6.0.3790.3959); Fri, 8 Nov
2013 11:24:57 -0500
Received: from 0NH1C2P10.fairpoint.com ([fe80::a56a:24fb:2799:f3f0]) by
0NH1C2P11.fairpoint.com ([fe80::b12a:f433:8f43:370%15]) with mapi id
14.03.0123.003; Fri, 8 Nov 2013 11:24:56 -0500
From: "Shaw, Matthew" <mshaw@fairpoint.com>
To: "outages@outages.org" <outages@outages.org>
Subject: [outages] Packetloss in Cogent at JFK
Thread-Topic: [outages] Packetloss in Cogent at JFK
Thread-Index: Ac7cnhDXi7SDRBLZTli3yJf9bg2log==
Sender: Outages <outages-bounces@outages.org>
Date: Fri, 8 Nov 2013 16:24:56 +0000
Message-ID: <457F9455036417428963A59E3B388741202B6379@0NH1C2P10.fairpoint.com>
List-Help: <mailto:outages-request@outages.org?subject=help>
List-Subscribe: <https://puck.nether.net/mailman/listinfo/outages>,
<mailto:outages-request@outages.org?subject=subscribe>
List-Unsubscribe: <https://puck.nether.net/mailman/options/outages>,
<mailto:outages-request@outages.org?subject=unsubscribe>
Accept-Language: en-US
Content-Language: en-US
X-MS-Exchange-Organization-AuthSource: 0NH1C2P10.fairpoint.com
X-MS-Has-Attach: yes
X-Auto-Response-Suppress: All
X-MS-TNEF-Correlator:
x-starscan-version: 6.9.13; banners=fairpoint.com,-,-
x-msg-ref: server-2.tower-53.messagelabs.com!1383927897!208075!1
x-originalarrivaltime: 08 Nov 2013 16:24:57.0599 (UTC)
FILETIME=[108E38F0:01CEDC9F]
x-env-sender: mshaw@fairpoint.com
x-viruschecked: Checked
x-spamreason: No, hits=0.0 required=7.0 tests=sa_preprocessor:
VHJ1c3RlZCBJUDogMjA0LjQyLjI1NC41ID0+IDM3MDQwMA==\n
x-originating-ip: [172.24.44.254]
x-starscan-received:
errors-to: outages-bounces@outages.org
Content-Type: multipart/mixed;
boundary="_002_457F9455036417428963A59E3B388741202B63790NH1C2P10fairpo_"
MIME-Version: 1.0
--_002_457F9455036417428963A59E3B388741202B63790NH1C2P10fairpo_
Content-Type: text/plain; charset="Windows-1252"
Content-ID: <5ECA40ECD91EBC40870A3BC9776E488E@fairpoint.com>
Content-Transfer-Encoding: quoted-printable
Multiple source / destination pairs through cogent show 40% or more packet=
loss at be2063.mpd22.jfk02.atlas.cogentco.com starting at 12:30am EST. We=
=92ve shutdown our peering to them until they=92ve had a chance to address =
the issue.
_______________________________________________________________________
This e-mail message and its attachments are for the sole use of the intende=
d recipients. They may contain confidential information, legally privileged=
information or other information subject to legal restrictions. If you are=
not the intended recipient of this message, please do not read, copy, use =
or disclose this message or its attachments, notify the sender by replying =
to this message and delete or destroy all copies of this message and attach=
ments in all media.
--_002_457F9455036417428963A59E3B388741202B63790NH1C2P10fairpo_
Content-Type: text/plain; name="ATT00001.txt"
Content-Description: ATT00001.txt
Content-Disposition: attachment; filename="ATT00001.txt"; size=142;
creation-date="Fri, 08 Nov 2013 16:54:00 GMT";
modification-date="Fri, 08 Nov 2013 16:54:00 GMT"
Content-ID: <27AB60764EE42C4CA1D74D22841BF10E@fairpoint.com>
Content-Transfer-Encoding: base64
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18NCk91dGFnZXMg
bWFpbGluZyBsaXN0DQpPdXRhZ2VzQG91dGFnZXMub3JnDQpodHRwczovL3B1Y2submV0aGVyLm5l
dC9tYWlsbWFuL2xpc3RpbmZvL291dGFnZXMNCg==
--_002_457F9455036417428963A59E3B388741202B63790NH1C2P10fairpo_--
--_002_457F9455036417428963A59E3B388741202B6B270NH1C2P10fairpo_--
