[876] in I/T Delivery
August - Data Warehouse status report
daemon@ATHENA.MIT.EDU (Mary Weisse)
Tue Sep 10 15:36:59 2002
Message-Id: <4.3.2.7.2.20020910152619.03964ee0@hesiod>
Date: Tue, 10 Sep 2002 15:38:40 -0400
To: Robert Ferrara <rferrara@mit.edu>, delivery@mit.edu
From: Mary Weisse <mca@MIT.EDU>
In-Reply-To: <5.0.2.1.2.20020521143703.00b1a6c0@po9.mit.edu>
Mime-Version: 1.0
Content-Type: multipart/alternative;
boundary="=====================_109724856==_.ALT"
--=====================_109724856==_.ALT
Content-Type: text/plain; charset="iso-8859-1"; format=flowed
Content-Transfer-Encoding: quoted-printable
Team Name: Data Warehouse
Team Leader: Scott Thorne
Report Date: September 10, 2002
URL: http://web.mit.edu/warehouse/
This month's accomplishments (August 2002)
=B7 AAUDE Data Warehouse
o Reloaded all eight years of AAUDE Faculty Salary data
o Worked with NSF tech person to receive data
o Delivered AAUDE training at CalTech
=B7 Continued working Jim Goode to get a new Production DW machine=20
(Freewilly) up and running.
o Compiled information about table size, table type, load type, load=
=20
frequency for all WAREUSER tables.
o Discussed other issues: tablespace layout, migration,=
=20
Oracle 8, etc.
=B7 Set up database link, secure copy from Orca to Freewilly.
=B7 Continued hiring process (Replace Steve Turner who is=
transitioning=20
out of DW as of June 30).
=B7 Continued to work on the analysis of the SAP/HR implementation in=
=20
the warehouse.
=B7 Refined TERMENROLL load (which loads the student term enrollment=
and
student course enrollment tables) to make it run faster and more=20
efficiently.
=B7 Continued design and implementation of new HR Org hierarchy.
=B7 Continued working on a library detail data.
=B7 Begin data work with the Project Intersection team.
=B7 Prepare for AAUDE class to be held at MIT in September.
=B7 Delivered additional data warehouse training to the Telephone=20
Coordinators for the
rollout of the SAP/HR/CYBORG MIT Telephone Directory Data.
=B7 Began work to improve the transfer of clearing information from=
SAP=20
to the Warehouse (ongoing)
=B7 Continued design of the Library Subscription data.
o Finished testing of extraction, pre-processing and full load of=20
whlibrary_item_detail table on Freewilly
o Finished Development and testing of incremental load of=
=20
library item
detail table on Freewilly. Released the table to=20
the limited audience
for reviewing/testing on ORCA, as soon as the user=
=20
defines the subset
of the table to look at (since ORCA can't=20
accommodate full table (extract file)
of this size).
=B7 Continued Query tool/web tool investigation.
Next Month's Plans (Septmeber, 2002)
=B7 AAUDE Data Warehouse -- continue development work on Phase II and=
=20
Phase III.
o Load new data for AAUP Faculty Salary
o Load new data for NSF Graduate Student Support and R&D=20
Expenditures
=B7 Prepare & Deliver AAUDE training at CalTech in August.
=B7 Continue working with ASST and DS to get a new Production DW=20
machine (Freewilly) up and running.
=B7 Continued to work with ASST and DS to get a new make the current=
=20
Orca the new
test warehouse machine.
=B7 Migrate all Warehouse Web/CGI applications from SNOWDROP and ELSA=
=20
to BLUE-GOOSE.
=B7 Continue hiring process (Replace Steve Turner who is transitioning=
=20
out of DW as of June 30).
=B7 Complete Financial Aid Federal Work Study
=B7 Continue to work on the analysis of the SAP/HR implementation in=
=20
the warehouse.
=B7 Continue design and implementation of new HR Org hierarchy.
=B7 Begin data modeling sessions with MIT Medical.
=B7 Begin data modeling sessions with TLO.
=B7 Begin data modeling sessions with the MIT Card Office
=B7 Continue data work with the Project Intersection team.
=B7 Begin design of the Library Subscription data.
=B7 Continued Query tool/web tool investigation.
Next Community Milestones:
=B7 Rollout of the SAP/HR/CYBORG - Early 2003
=B7 Load summary (by service) MIT Medical data into the DW.
=B7 Load TLO case data into the DW.
=B7 Load MIT Card Office data (including pictures) into the DW.
--=====================_109724856==_.ALT
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html>
<b>Team Name</b>: Data Warehouse<br>
<b>Team Leader:</b> Scott Thorne<br>
<b>Report Date:</b> September 10, 2002<br>
<b>URL:</b>
<a href=3D"http://web.mit.edu/warehouse/" eudora=3D"autourl"><font=
color=3D"#0000FF"><u>http://web.mit.edu/warehouse/</a><br>
<br>
<br>
</u></font><b>This month's accomplishments (August 2002)<br>
</b><font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>AAUDE Data Warehouse=20
<dl>
<dl><font face=3D"Courier New, Courier">
<dd>o<x-tab> </x-tab></font>Reloade=
d all eight years of AAUDE Faculty Salary data
</dl>
</dl><font face=3D"Courier New,=
Courier"><x-tab> </x-tab><x-=
tab> </x-tab>o =
</font>Worked with NSF tech person to receive data<br>
<font face=3D"Courier New,=
Courier"><x-tab> </x-tab><x-=
tab> </x-tab>o =
</font>Delivered AAUDE training at CalTech<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued working Jim Goode to get a new Production DW machine=
(Freewilly) up and running.=20
<dl>
<dl><font face=3D"Courier New, Courier">
<dd>o<x-tab> </x-tab></font>Compile=
d information about table size, table type, load type, load frequency for=
all WAREUSER tables.=20
</dl>
</dl><font face=3D"Courier New,=
Courier"><x-tab> </x-tab><x-=
tab> </x-tab>o =
</font>Discussed other issues: tablespace layout, migration, Oracle=
8, etc.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Set up database link, secure copy from Orca to Freewilly.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued hiring process (Replace Steve Turner who is transitioning=
out of DW as of June 30). <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued to work on the analysis of the SAP/HR implementation in=
the warehouse.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Refined TERMENROLL load (which loads the student term enrollment and=
<br>
<x-tab> </x-tab>student=
course enrollment tables) to make it run faster and more efficiently.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued design and implementation of new HR Org hierarchy.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued working on a library detail data.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Begin data work with the Project Intersection team.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Prepare for AAUDE class to be held at MIT in September.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Delivered additional data warehouse training to the Telephone=
Coordinators for the <br>
<x-tab> </x-tab>rollout of=
the SAP/HR/CYBORG MIT Telephone Directory Data.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Began work to improve the transfer of clearing information from SAP=
to the Warehouse (ongoing)<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued design of the Library Subscription data.
<dl>
<dl><font face=3D"Courier New, Courier">
<dd>o<x-tab> </x-tab></font>Finishe=
d testing of extraction, pre-processing and full load of=
whlibrary_item_detail table on Freewilly
</dl>
</dl><font face=3D"Courier New,=
Courier"><x-tab> </x-tab><x-=
tab> </x-tab>o =
</font>Finished Development and testing of incremental load of library item=
<br>
<x-tab> </x-tab><x-tab> =
</x-tab> &n=
bsp; detail table on Freewilly. Released the table to the=
limited audience <br>
<x-tab> </x-tab><x-tab> =
</x-tab> &n=
bsp; for reviewing/testing on ORCA, as soon as the user defines the=
subset <br>
<x-tab> </x-tab><x-tab> =
</x-tab> &n=
bsp; of the table to look at (since ORCA can't accommodate full table=
(extract file)<br>
<x-tab> </x-tab><x-tab> =
</x-tab> &n=
bsp; of this size). <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued Query tool/web tool investigation.<br>
<br>
<br>
<br>
<b>Next Month's Plans (Septmeber, 2002)<br>
</b><font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>AAUDE Data Warehouse -- continue development work on Phase II and=
Phase III.
<dl>
<dl><font face=3D"Courier New, Courier">
<dd>o<x-tab> </x-tab></font>Load=
new data for AAUP Faculty Salary
</dl>
</dl><font face=3D"Courier New,=
Courier"><x-tab> </x-tab><x-=
tab> </x-tab>o </font>Load=
new data for NSF Graduate Student Support and R&D Expenditures<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Prepare & Deliver AAUDE training at CalTech in August.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continue working with ASST and DS to get a new Production DW machine=
(Freewilly) up and running.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued to work with ASST and DS to get a new make the current=
Orca the new <br>
<x-tab> </x-tab>test=
warehouse machine.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Migrate all Warehouse Web/CGI applications from SNOWDROP and ELSA to=
BLUE-GOOSE.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continue hiring process (Replace Steve Turner who is transitioning=
out of DW as of June 30).<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Complete Financial Aid Federal Work Study<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continue to work on the analysis of the SAP/HR implementation in the=
warehouse.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continue design and implementation of new HR Org hierarchy.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Begin data modeling sessions with MIT Medical.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Begin data modeling sessions with TLO.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Begin data modeling sessions with the MIT Card Office<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continue data work with the Project Intersection team.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Begin design of the Library Subscription data.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued Query tool/web tool investigation.<br>
<br>
<br>
<b>Next Community Milestones:<br>
</b><font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Rollout of the SAP/HR/CYBORG - Early 2003<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Load summary (by service) MIT Medical data into the DW.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Load TLO case data into the DW.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Load MIT Card Office data (including pictures) into the DW.<br>
<br>
<br>
</html>
--=====================_109724856==_.ALT--
