[19264] in s-news-athena
[S] merging results from two different data files?
daemon@ATHENA.MIT.EDU (Don Turnbull)
Sat Sep 18 21:57:12 1999
Message-Id: <37E44008.A351D97B@fis.utoronto.ca>
Date: Sat, 18 Sep 1999 20:44:40 -0500
From: Don Turnbull <donturn@fis.utoronto.ca>
Reply-To: donturn@fis.utoronto.ca
Mime-Version: 1.0
To: s-news@wubios.wustl.edu
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Hi, I'm working with some files that seem to be too large for SPLUS2000 (WinNT) to
process, so I'm faced with splitting the files and running my scripts and then
recombining the results of the runs. However, I'm quite lost on how to do this.
I understand that I can save results as the objects they are and then run the same
scripts naming the results something different and then combine them.
However, I'm saving data as.category and when the second (or third, or fourth...)
part of the file is run the values (I'm doing frequency counts of one column of
numerical IP addresses and another column of sites visited (yet another IP
address). SPLUS assigns a number to the user's IP address that wouldn't be the same
when I run the extra files.
So once I figure out a way to keep the same user associated between files, I'll
need to combine the results. I'd appreciate any help in either of these problems.
BTW, the files are 100MB+ and I've tried running SPLUS in command line batch mode
(to possibly enable more Windows resources in working with the large single file),
but to no avail. I'd be curious to hear how others deal with very large files.
Thanks,
Don Turnbull
-----------------------------------------------------------------------
This message was distributed by s-news@wubios.wustl.edu. To unsubscribe
send e-mail to s-news-request@wubios.wustl.edu with the BODY of the
message: unsubscribe s-news
