[163083] in North American Network Operators' Group
Re: High throughput bgp links using gentoo + stipped kernel
daemon@ATHENA.MIT.EDU (Nikola Kolev)
Sun May 19 03:21:33 2013
In-Reply-To: <CAGWRaZb_dHnFHzOZ45M-OkxhbHLjAp=f57fkSkD3fW3FyZP_5g@mail.gmail.com>
From: Nikola Kolev <nikky@mnet.bg>
Date: Sun, 19 May 2013 10:21:16 +0300
To: Nick Khamis <symack@gmail.com>
Cc: "nanog@nanog.org" <nanog@nanog.org>
Errors-To: nanog-bounces+nanog.discuss=bloom-picayune.mit.edu@nanog.org
Hello Nick,
On 18.05.2013, at 18:39, Nick Khamis <symack@gmail.com> wrote:
> Hello Everyone,
>=20
> We are running:
>=20
> Gentoo Server on Dual Core Intel Xeon 3060, 2 Gb Ram
> Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet
> Controller (rev 06)
> Ethernet controller: Intel Corporation 82573E Gigabit Ethernet
> Controller (rev 03)
>=20
> 2 bgp links from different providers using quagga, iptables etc....
>=20
> We are transmitting an average of 700Mbps with packet sizes upwards of
> 900-1000 bytes when the traffic graph begins to flatten. We also start
> experiencing some crashes at that point, and not have been able to
> pinpoint that either.
>=20
> I was hoping to get some feedback on what else we can strip from the
> kernel. If you have a similar setup for a stable platform the .config
> would be great!
>=20
> Also, what are your thoughts on migrating to OpenBSD and bgpd, not
> sure if there would be a performance increase, but the security would
> be even more stronger?
>=20
> Kind Regards,
>=20
> Nick
You might be maxing out your server's PCI bus throughput, so it might be a b=
etter idea if you can get Ethernet NICs that are sitting at least on PCIe x8=
slots.
Leaving that aside, I take it you've configured some sort of CPU/PCI affinit=
y?
As for migration to another OS, I find FreeBSD better as a matter of network=
performance. The last time I checked OpenBSD was either lacking or was in t=
he early stages of multiple cores support.=