[193446] in North American Network Operators' Group
Level3 Internet service, out of order packets causing issues
daemon@ATHENA.MIT.EDU (Mark Wicker)
Tue Jan 17 19:39:53 2017
X-Original-To: nanog@nanog.org
From: Mark Wicker <MWicker@esri.com>
To: "nanog@nanog.org" <nanog@nanog.org>
Date: Tue, 17 Jan 2017 19:12:26 +0000
Errors-To: nanog-bounces@nanog.org
Hi,
I have 1G Level3 ethernet dedicated internet service as one of my ISP's at =
my company based in the Los Angeles (Inland Empire) area. After seeing stra=
nge application behavior while using this circuit, I failed it out of servi=
ce and have been troubleshooting it with a directly connected machine (publ=
ically addressed, no firewall, nothing between this machine and our Level3 =
router). I have taken several packet captures while accessing various sites=
and have noticed large numbers of out of order packets which are wreaking =
havoc with TCP connections and other traffic. In my experience, per-packet =
load balancing across various different links can cause this issue. I do no=
t see this behavior with my other ISP's. I have had several tickets opened =
with Level3 but have had no success. Any help here? Anyone out there seen t=
his and have any contacts that may be able to help?
FYI - we own our own public IP space and advertise via BGP to Level3. Curre=
ntly I am using a dedicated /24 of our space advertised to Level3 only to e=
nsure that the return path is through Level3 and not another ISP. Also, eve=
rything is single linked from a layer 2 and 3 perspective from the router t=
o the test machine to ensure that the cause of any out of order packets is =
not on our end.
Thanks,
--
Mark Wicker | Senior Network Engineer
Esri | 380 New York St | Redlands, CA 92354 | USA
T 909 793 2853 x2741 | mwicker@esri.com<mailto:mwicker@esri.com> | esri.com=
<http://www.esri.com/>
