[1079] in linux-scsi channel archive

home help back first fref pref prev next nref lref last post

Re: news on dual buslogics with MD

daemon@ATHENA.MIT.EDU (Alan Brown)
Sat Dec 7 03:16:54 1996

To: submit-linux-dev-scsi@ratatosk.yggdrasil.com
From: alan@papaioea.manawatu.gen.nz (Alan Brown)
Date: 	7 Dec 1996 20:50:07 +1300


In article <199612030624.WAA00624@dandelion.com>,
Leonard N. Zubkoff <lnz@dandelion.com> wrote:

>First, why a dual processor machine?  As far as I'm aware, news is generally
>I/O bound rather than CPU bound, so I don't see what the extra processor is
>buying you.  Also, Linux' SMP support is best at compute bound tasks since only
>one processor can be in the kernel at a time.  Given the high I/O load on a
>news server, I'd suggest you get a single P6-200 rather than a dual P5-200.
>Make sure you have enough memory that the machine never pages.

I'd encourage putting in as much ram as possible, but here's my 
experience from running a news server for the last 5 years....

99% of the time the machine is i/o bound, however when you have a lot of 
outgoing channel feeds or 10,000+ newsgroups, whenever a newsfeed is 
altered or a newsgroup added/removed, you go into a situation where the 
machine does a LOT of numbercrunching for a short space of time as the 
entire active file + newsfeeds file is held in memory in a database 
format and must be updated.

Additionally, whenever a change is made, all the channel feeds are 
terminated and respawned. This eats a lot of cpu - my current 486dx2/66
is well behind the curve in this dept and it causes a 2-4 minute pause 
each time there's a change. As I allow all my feeds to alter their 
newsfeeds automatically via gup, there're always changes going on, plus 
there's the constant trickle of group control messages.

Currently I have 200 uucp feeds done through a funnel and 28 channel 
feeds feeding into nntplink. I'll be changing this to innfeed as it'll 
allow me to turn the channel feeds all into funnel feeds and get round 
the high drop/spawn overheads associated with each one while still being 
able to do "instant feeding" plus using innxmit to stream anything which 
has been dropped (such as when the remote has throttled thru lack of space).


Given a choice between running 256Mb of ram and a dual processor machine 
I'd take the ram every time however. :-)


For expandability, I'd recommend the following:

1: Use a motherboard capable of taking at least 512Mb ram. It sounds 
   ridiculous today, but so did needing 128Mb 2 years ago. If you can 
   find a 1024Mb capable machine, so much the better.

2: Consider fibre channel and a scsi frame capable of hot swapping.
   The big question is whether any fibre channel controllers are readily
   available yet and what the availability of Linux drivers is like.

3: Make your building block either 4Gb or 9Gb drives, but ensure you start
   with at least 4 on the news spoool and that they're 7200rpm ones with 
   lots of cache. The more spindles the better.

4: System binaries, swap, news binaries, news library files, news logs, 
   news spool and overview should all be preferably on separate spindles
   or MD blocks if they're big enough to warrant being on multiple drives
   apiece. It's expensive, but it all helps reduce the waiting on i/o. :-)
   Using multiple scsi busses goes without saying. Even with Fibre channel
   it's quite easy to max a bus of you have too many drives on it.
   
5: Be prepared to see whatever you use become worth next to nothing in 
   less than 2 years. We spent $22,000 on our news server and it needs
   replacement already.

6: Related to 5, make sure that whatever you get is expandable. We got 
   caught out on the hardware we bought, as I'd specified things to allow
   for upgrading, but the actual specs of the platform we bought were a bit
   different from what the NZ agents claimed they were (Acer Altos 700i 
   server), so it's actually going to be cheaper for us to scrap it and 
   start over. NZ depreciation laws allow us to completely write the machine
   off at 36 months, so there's a tax break to consider too. :-)

7: Resist all temptation to use surplus capacity on the news server for
   other functions, even on a temporary basis. "Temporary" installations
   of stuff like web servers have an alarming tendency to become permanent.

8: The old news server isn't a total loss. You can usually find a use for 
   it as a ftp server or other type of server. 

AB
-- 
  Junk email returned, in bulk, back to sender; w/copies to all postmasters.

home help back first fref pref prev next nref lref last post