[19204] in s-news-athena

home help back first fref pref prev next nref lref last post

[S] Merging Large Data sets

daemon@ATHENA.MIT.EDU (geoffrey knapper)
Mon Sep 13 12:43:53 1999

Message-Id: <37DD28C4.F8A7DCDC@sympatico.ca>
Date: Mon, 13 Sep 1999 12:39:32 -0400
From: geoffrey knapper <geoff.knapper@sympatico.ca>
Mime-Version: 1.0
To: S-news@wubios.wustl.edu
Content-Type: multipart/mixed;
 boundary="------------E2BE0A4770C618E9FF4CFE31"


This is a multi-part message in MIME format.
--------------E2BE0A4770C618E9FF4CFE31
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit

Computer Pentium 550, 256 meg ram, 9 gig hard drive, S-Plus Version 4.0

I am trying to merge a couple of large data sets and am having real
problems.  Keep coming up with dynamic memory errors, i.e. unable to
allocate 9 gig of space.

The merge is by one common variable.
The one data set has about 600 lines by 8 columns (1 text the rest
numerical)
the other data sets are 2.8 million lines by 6 columns, all numerical  (
I have broken it down to less that 500,000 obs) but still getting the
errors.  I really don't want to have to put this together by hand
but......


If anyone can give me any suggestions I would appreciate it.  Otherwise
SAS here I come.


Geoffrey

--------------E2BE0A4770C618E9FF4CFE31
Content-Type: text/x-vcard; charset=us-ascii;
 name="geoff.knapper.vcf"
Content-Transfer-Encoding: 7bit
Content-Description: Card for geoffrey knapper
Content-Disposition: attachment;
 filename="geoff.knapper.vcf"

begin:vcard 
n:Knapper;Geoffrey
tel;cell:(416) 770 3498
tel;fax:(416) 535-2424
tel;home:(416) 535-2424
x-mozilla-html:FALSE
org:GPK and Associates
adr:;;63 Marion Street;Toronto;Ontario;M6R 1E6;Canada
version:2.1
email;internet:geoff.knapper@sympatico.ca
title:Principal
x-mozilla-cpt:;-1
fn:Geoffrey Knapper
end:vcard

--------------E2BE0A4770C618E9FF4CFE31--

-----------------------------------------------------------------------
This message was distributed by s-news@wubios.wustl.edu.  To unsubscribe
send e-mail to s-news-request@wubios.wustl.edu with the BODY of the
message:  unsubscribe s-news

home help back first fref pref prev next nref lref last post