[923] in I/T Delivery

home help back first fref pref prev next nref lref last post

Re: Data Warehouse October Delivery Report

daemon@ATHENA.MIT.EDU (Mary C. Weisse)
Tue Nov 5 23:29:24 2002

Message-Id: <5.1.0.14.2.20021105232741.00b458f0@hesiod>
Date: Tue, 05 Nov 2002 23:29:09 -0500
To: delivery@mit.edu
From: "Mary C. Weisse" <mca@MIT.EDU>
In-Reply-To: <p05010402b9ede377b43c@[18.152.0.226]>
Mime-Version: 1.0
Content-Type: multipart/alternative;
	boundary="=====================_1125248==_.ALT"

--=====================_1125248==_.ALT
Content-Type: text/plain; charset="iso-8859-1"; format=flowed
Content-Transfer-Encoding: quoted-printable

Team Name: Data Warehouse
Team Leader: Scott Thorne
Report Date: Novmber 5, 2002
URL: http://web.mit.edu/warehouse/


This month's accomplishments (October 2002)
=B7       Continued work on Freewilly setup and work on Oracle 8.1.7=20
migration.
o       Compiled table size, table type, load type, load frequency,=20
objects, tablepsaces, etc. for all WAREUSER tables in the database.
o       Moving/copying/checking tables, files, programs between systems to=
=20
accomplish the goal of running two systems in parallel during the migration=
=20
period.
o       Working on Pro*C program to generate index scripts with new=20
tablespace names and correct new 'initial,'next' parameters. Need to=20
develop part of the process that will generate these scripts for ALL tables=
=20
for a particular user.
o       Generalized 'gen_create' and 'gen_index' scripts to be able to run=
=20
them from ANY directory for ANY user generating the complete set of the
o       tables/indexes
o       Modified and tested table and index creation scripts to accommodate=
=20
new storage parameters.
o       Completed copy of the  UNIX directories from ORCA to Freewilly,=20
worked on bringing back, re-creating (and restoring) all library pieces to=
=20
be able to run and monitor the LIBRARY stuff daily in production mode. This=
=20
will give the user an early access to their data on a new machine.
=B7       Attended the AAUDE board meeting in Washington DC.
=B7       Completed analysis and programming for bringing annual forecast=20
budget into the warehouse. Waiting for SAP      implementation. The
=B7       Migrated all CGI applications for Data Warehouse web page from=20
SNOWDROP to BLUE-GOOSE. Have "warehouse- www.mit.edu" point to BLUE-GOOSE.
=B7       Created a table for student tuition assessment data and loaded=
 data=20
from MITSIS, now in production.
=B7       Updated all the student fifth week tables (enrollment, financial=
=20
aid) with the latest term data.
=B7       Created user metadata for all graduate admissions data.
=B7        Participated in the data Modeling for Medical cost and revenue=20
reporting.
=B7       Implemented clearing data enhancements in the warehouse. Supported=
=20
CAO and FSS testing.
=B7       Creates utility tools (UNIX shell scripts) that allows to search=
=20
for a particular pattern(s) through the files of the whole     directory=20
tree, within a particular time range.
=B7       Created reports for the Libraries.
=B7       Created new HR reports for the Deans Office.
=B7       Began moving some of HR Roles data into the warehouse.
=B7       Worked with Purchasing to create new annual reports.
=B7       Continue convert existing web reports to Brio 6.
=B7       Identified final candidate to replace Steve Turner=85..
=B7       Continue to work on the analysis of the SAP/HR implementation in=
=20
the warehouse.
=B7       Continue design and implementation of new HR Org hierarchy.
=B7       Continue data work with the Project Intersection team.
=B7       Continued Query tool/web tool investigation.
=B7       Loaded the student tuition assessment data.


Next Month's Plans (November, 2002)
=B7       Continued work on Freewilly setup and work on Oracle 8.1.7=
 migration.
=B7       Do the analysis to create proper specifications for an inexpensive=
=20
web server to house and run all the Data Warehouse   web programs (which=20
are currently on BLUE-GOOSE - which is old and being phased out, and ELSA -=
=20
which is a personal     and old Athena workstation).
=B7       Modify a couple of wrapper functions in whconv to include a new=
 web=20
browser (Mozilla) and a couple of new browser       versions for Netscape=20
in Web Hits reporting.
=B7       Continue AAUDE work on IPEDS Fall Enrollment
=B7       Complete the AAUDE analysis work on IPEDS Finance
=B7       Document MITID update process.
=B7       Create and teach Brio 6.x class for the Budget Office.
=B7       Continue convert existing web reports to Brio 6.
=B7       Do the analysis surrounding creating and running the monthly=
 Budget=20
Authorization documents from the warehouse.
=B7       Continue data modeling sessions with TLO.
=B7       Begin data modeling sessions with the MIT Card Office
=B7       Begin design of the Library Subscription data.


Next Community Milestones:
=B7       Migration to new server and upgrade database from Orcal 7.3.4 to=
=20
8.1.7  -- December 2002
=B7       Rollout of the SAP/HR/CYBORG - Early 2003
=B7       Load summary (by service) MIT Medical data into the DW  On hold=20
Medical revisiting what it is they are trying to        accomplish.
=B7       Load TLO case data into the DW.
=B7       Load MIT Card Office data (including pictures) into the DW.

--=====================_1125248==_.ALT
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<b>Team Name</b>: Data Warehouse<br>
<b>Team Leader:</b> Scott Thorne<br>
<b>Report Date:</b> Novmber 5, 2002<br>
<b>URL:</b>
<a href=3D"http://web.mit.edu/warehouse/" eudora=3D"autourl"><font=
 color=3D"#0000FF"><u>http://web.mit.edu/warehouse/</a><br><br>
<br>
</u></font><b>This month's accomplishments (October 2002)<br>
</b><font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continued work on Freewilly setup and work on Oracle 8.1.7=
 migration.=20
<dl>
<dl><font face=3D"Courier New, Courier">
<dd>o<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab></font>Compile=
d table size, table type, load type, load frequency, objects, tablepsaces,=
 etc. for all WAREUSER tables in the database. <font face=3D"Courier New,=
 Courier">
<dd>o<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab></font>Moving/=
copying/checking tables, files, programs between systems to accomplish the=
 goal of running two systems in parallel during the migration period.<font=
 face=3D"Courier New, Courier">
<dd>o<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab></font>Working=
 on Pro*C program to generate index scripts with new tablespace names and=
 correct new 'initial,'next' parameters. Need to develop part of the process=
 that will generate these scripts for ALL tables for a particular user.=
 <font face=3D"Courier New, Courier">
<dd>o<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab></font>General=
ized 'gen_create' and 'gen_index' scripts to be able to run them from ANY=
 directory for ANY user generating the complete set of the<font=
 face=3D"Courier New, Courier">
<dd>o<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab></font>tables/=
indexes <font face=3D"Courier New, Courier">
<dd>o<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab></font>Modifie=
d and tested table and index creation scripts to accommodate new storage=
 parameters.<font face=3D"Courier New, Courier">
<dd>o<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab></font>Complet=
ed copy of the&nbsp; UNIX directories from ORCA to Freewilly, worked on=
 bringing back, re-creating (and restoring) all library pieces to be able to=
 run and monitor the LIBRARY stuff daily in production mode. This will give=
 the user an early access to their data on a new machine.
</dl>
</dl><font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Attended the<font size=3D3> </font>AAUDE board meeting in Washington=
 DC.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Completed analysis and programming for bringing annual forecast=
 budget into the warehouse. Waiting for SAP=
 <x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>implementation. The <br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Migrated all CGI applications for Data Warehouse web page from=
 SNOWDROP to BLUE-GOOSE. Have &quot;warehouse-<x-tab>&nbsp;</x-tab><a=
 href=3D"http://www.mit.edu/" eudora=3D"autourl">www</a>.mit.<a=
 href=3D"http://www.mit.edu/" eudora=3D"autourl">edu</a>&quot; point to=
 BLUE-GOOSE. <br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Created a table for student tuition assessment data and loaded data=
 from MITSIS, now in production.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Updated all the student fifth week tables (enrollment, financial=
 aid) with the latest term data. <br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Created user metadata for all graduate admissions data.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font> Participated in the data Modeling for Medical cost and revenue=
 reporting.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Implemented clearing data enhancements in the warehouse. Supported=
 CAO and FSS testing.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Creates utility tools (UNIX shell scripts) that allows to search for=
 a particular pattern(s) through the files of the whole=
 <x-tab>&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>directory tree, within a particular=
 time range.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Created reports for the Libraries.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Created new HR reports for the Deans Office.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Began moving some of HR Roles data into the warehouse.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Worked with Purchasing to create new annual reports.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continue convert existing web reports to Brio 6.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Identified final candidate to replace Steve Turner=85..<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continue to work on the analysis of the SAP/HR implementation in the=
 warehouse.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continue design and implementation of new HR Org hierarchy.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continue data work with the Project Intersection team.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continued Query tool/web tool investigation. <br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Loaded the student tuition assessment data.<br><br>
<br>
<b>Next Month's Plans (November, 2002)<br>
</b><font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continued work on Freewilly setup and work on Oracle 8.1.7=
 migration. <br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Do the analysis to create proper specifications for an inexpensive=
 web server to house and run all the Data Warehouse=
 <x-tab>&nbsp;&nbsp;</x-tab>web programs (which are currently on BLUE-GOOSE=
 - which is old and being phased out, and ELSA - which is a personal=
 <x-tab>&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>and old Athena workstation).<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Modify a couple of wrapper functions in whconv to include a new web=
 browser (Mozilla) and a couple of new browser=
 <x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>versions for Netscape in=
 Web Hits reporting<font size=3D3>.<br>
</font><font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continue AAUDE work on IPEDS Fall Enrollment<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Complete the AAUDE analysis work on IPEDS Finance<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Document MITID update process.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Create and teach Brio 6.x class for the Budget Office.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continue convert existing web reports to Brio 6.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Do the analysis surrounding creating and running the monthly Budget=
 Authorization documents from the warehouse.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Continue data modeling sessions with TLO.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Begin data modeling sessions with the MIT Card Office<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Begin design of the Library Subscription data.<br><br>
<br>
<b>Next Community Milestones:<br>
</b><font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Migration to new server and upgrade database from Orcal 7.3.4 to=
 8.1.7&nbsp; -- December 2002<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Rollout of the SAP/HR/CYBORG - Early 2003<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Load summary (by service) MIT Medical data into the DW&nbsp; On hold=
 Medical revisiting what it is they are trying to=
 <x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>accomplish.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Load TLO case data into the DW.<br>
<font=
 face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab=
></font>Load MIT Card Office data (including pictures) into the DW.<br>
</html>

--=====================_1125248==_.ALT--


home help back first fref pref prev next nref lref last post