[180019] in North American Network Operators' Group
RE: Low Cost 10G Router
daemon@ATHENA.MIT.EDU (Warsaw LATAM Operations Group)
Tue May 19 19:25:58 2015
X-Original-To: nanog@nanog.org
From: Warsaw LATAM Operations Group <gaswarsaw-latam@outlook.com>
To: Colton Conor <colton.conor@gmail.com>
Date: Tue, 19 May 2015 19:25:56 -0400
In-Reply-To: <5D499B18-1134-43CD-8B09-9118E3CACAEA@akcin.net>
Cc: NANOG <nanog@nanog.org>
Errors-To: nanog-bounces@nanog.org
> > On May 19=2C 2015=2C at 10:22=2C Colton Conor <colton.conor@gmail.com> =
wrote:
> >=20
> > What options are available for a small=2C low cost router that has at l=
east
> > four 10G ports=2C and can handle full BGP routes? All that I know of ar=
e the
> > Juniper MX80=2C and the Brocade CER line. What does Cisco and others ha=
ve
> > that compete with these two? Any other vendors besides Juniper=2C Broca=
de=2C
> > and Cisco to look at?
I have two ServerU L-800 boxes routing BGP and OSPF=2C one of those has 4x1=
0G SFP+ port and the other box=2C the more interesting experience I had=2C =
has a 2x40G Chelsio expansion board. Both run FreeBSD=2C one of the boxes r=
un a thing called ProApps which is a FreeBSD based system ServerU people of=
fer to their customers=2C with a nice and easy GUI=2C but essentially FreeB=
SD. My experience with ServerU boxes started from security needs=2C for hig=
h performance firewall and IDP=2C and recently I started to try it as route=
r. So far=2C so good.
The later box I started with BSDRP and later went for a default FreeBSD sys=
tem. In this system I mostly run OSPF + BFD and stateles firewall=2C for a =
very critical customer site we have at Diebold. What we do in this ServerU =
L-800 + Chelsio card box is:
- We have BIRD doing the dirty work for OSPF + BFD- We have a trigger in BI=
RD wich updates Chelsio T5's Forwarding Table- We have stateless firewallin=
g handled with cxgbetool on Chelsio directly
In this particular setup=2C with FreeBSD+BIRD+ServerUL800+Chelsio we handle=
every day=2C 4.2Mpps on 2x40G ports mostly on Chelsio ASICS=2C leaving mos=
t of ServerU CPU for BIRD and other FreeBSD features such as vlan=2C lagg=
=2C etc. Interrupt CPU usage is very low=2C since it's mostly handled on Ch=
elsio board.=20
So far I haven't tried adding a full BGP routing table to Chelsio=2C but th=
e couple dozen routes we have demand this pps rate=2C gracefully handled by=
the box.
It's a 1=2C200 USD starting cost for a very decent router which promisses t=
o delivery a good pps and bps rate specially when compared to Mikrotik's CC=
R and other Cisco/Brocade routers on this same grade. Add to it a couple hu=
ndred extra bucks to have a very decent Chelsio T5 ASICS expansion to L800 =
chassis and you pretty much have a system that=2C according to Chelsion dat=
a sheet=2C promisses to delivery 27 milion packets per second filtered and =
forwarded. Pretty much Line Rate for 10G ports.
I don't know about the expected 27Mpps per port=2C but I can confirm 4.8Mpp=
s peaking / 4.2Mpps avging on my rack everyday=2C and for the price I pay o=
n this ServerU + FreeBSD setup I can't avoid to suggest it worths pretty mu=
ch a try!
http://www.serveru.us/en/netmapl800
If you buy a Chelsio card or already have it=2C or have it at a better pric=
e (sometimes we find very good 300.00 USD deals on chelsio T5=2C while thei=
r list price is ~900.00 USD) talk to 'em first=2C they have Chelsio front e=
xpansions by default but if you buy a Chelsio x8 PCIe card your own they ne=
ed to arrange ServerU L-800 to have it perfectly fitted in their L-800 chas=
sis=2C and usually it requires rear raiser replacement in their router=2C s=
o talk to them first... I learned it the bad way =3B] bought the chelsio ca=
rd myself and found out I could not use it=2C since this L-800 router comes=
with raisers for front expansions. They were gentle enough to upgrade the =
raiser for free but I had to ship the box back to Florida. So talk to them.=
..
=0A=
=0A=
=0A=
=0A=
=0A=
=0A=
=0A=
=0A=
=
