[105117] in North American Network Operators' Group
Best utilizing fat long pipes and large file transfer
daemon@ATHENA.MIT.EDU (Sean Knox)
Thu Jun 12 18:38:04 2008
Date: Thu, 12 Jun 2008 15:37:47 -0700
From: Sean Knox <sean@craigslist.org>
To: nanog@merit.edu
Errors-To: nanog-bounces@nanog.org
Hi,
I'm looking for input on the best practices for sending large files over
a long fat pipe between facilities (gigabit private circuit, ~20ms RTT).
I'd like to avoid modifying TCP windows and options on end hosts where
possible (I have a lot of them). I've seen products that work as
"transfer stations" using "reliable UDP" to get around the windowing
problem.
I'm thinking of setting up servers with optimized TCP settings to push
big files around data centers but I'm curious to know how others deal
with LFN+large transfers.
thanks,
Sean