[163085] in North American Network Operators' Group
Re: High throughput bgp links using gentoo + stipped kernel
daemon@ATHENA.MIT.EDU (Jon Lewis)
Sun May 19 09:36:28 2013
Date: Sun, 19 May 2013 09:36:12 -0400 (EDT)
From: Jon Lewis <jlewis@lewis.org>
To: William Herrin <bill@herrin.us>
In-Reply-To: <CAP-guGVQWbBie2rdAGOr9wc15oE=jTqxLw36oWJ9Z2R16=4ZQA@mail.gmail.com>
Cc: nanog@nanog.org
Errors-To: nanog-bounces+nanog.discuss=bloom-picayune.mit.edu@nanog.org
On Sun, 19 May 2013, William Herrin wrote:
> On Sat, May 18, 2013 at 11:39 AM, Nick Khamis <symack@gmail.com> wrote:
>> We are transmitting an average of 700Mbps with packet sizes upwards of
>> 900-1000 bytes when the traffic graph begins to flatten. We also start
>> experiencing some crashes at that point, and not have been able to
>> pinpoint that either.
>
> Hi Nick,
>
> You're done. You can buy more recent server hardware and get another
> small bump. You may be able to tweak interrupt rates from the NICs as
> well, trading latency for throughput. But basically you're done:
> you've hit the upper bound of what slow-path (not hardware assisted)
> networking can currently do.
>
> Options:
>
> 1. Buy equipment with a hardware fast path, such as the higher end
> Juniper and Cisco routers.
I think you've misinterpreted his numbers. He's using 1gb ethernet
interfaces, so that's 700 mbit/s. He didn't mention if he'd done any IP
stack tuning, or what sort of crashes he's having...but people have been
doing higher bandwith than this on Linux for years.
----------------------------------------------------------------------
Jon Lewis, MCP :) | I route
| therefore you are
_________ http://www.lewis.org/~jlewis/pgp for PGP public key_________