[964] in I/T Delivery

home help back first fref pref prev next nref lref last post

DW Status Report

daemon@ATHENA.MIT.EDU (Mary C. Weisse)
Fri Dec 6 23:34:25 2002

Message-Id: <5.1.0.14.2.20021206233359.00b3a520@hesiod>
Date: Fri, 06 Dec 2002 23:34:09 -0500
To: delivery@mit.edu
From: "Mary C. Weisse" <mca@MIT.EDU>
Mime-Version: 1.0
Content-Type: multipart/alternative;
	boundary="=====================_55464333==_.ALT"

--=====================_55464333==_.ALT
Content-Type: text/plain; charset="iso-8859-1"; format=flowed
Content-Transfer-Encoding: quoted-printable


Team Name: Data Warehouse
Team Leader: Scott Thorne
Report Date: December 6, 2002
URL: http://web.mit.edu/warehouse/


This month's accomplishments (November 2002)

=B7       Continued work on Freewilly setup and work on Oracle 8.1.7=
 migration.
o Ran all jobs in parallel on both machines. (Last week of November)
o Add scripts to generate statistics for all tables and indexes.
o Export/import of groups of tables from ORCA to FREEWILLY.
o Worked on re-assigning correct storage parameters for tables with high
                 number of extents, re-creating tables, rebuilding indexes,=
=20
modifying scripts, etc.
o Fixed inconsistencies between ORCA and FREEWILLY database objects=
 identified
                 through Database Object Compare
o Created another version of gen_create Pro*C program that allows us to use=
=20
'create
                 table' script for individual tables as well as in batch=
 mode.
o Identified location of various pieces of C source code, as well as all=20
'include' and
                 'header' files on TAJ, which must be preserved on ORCA=20
when it becomes a test
                 machine.  During this inventory we identified outdated and=
=20
'out of use' programs,
                 as well as discrepancies between RCS and SRCAfiles.
=B7       Demo graduate admissions and student data in a Filemaker User=
 Group=20
meeting.
=B7       Created BrioQuery scripts for Admissions Office to report the "US=
=20
News & World
         Report" and other surveys, on mean GRE scores of admitted &=20
enrolled graduates
         by entry terms and admissions programs for the School of=
 Engineering.
=B7       Demo graduate admissions and student data in a Filemaker User=
 Group=20
meeting.
=B7       Worked on the enhancements to LIBRARY_ITEM_DETAIL table, which=20
included
         addition of new fields, renaming of some existing fields,and=20
addition of a brand new
         dimension table called LIBRARY_CALL_NUMBER_SEARCH for limiting the=
=20
selection
         by call number ranges.
=B7       Taught Brio 6 class on querying and combining data from multiple=
=20
data sources to
         the Budget Office.
=B7       Began HR Conceptual Historical Data Modeling.
=B7       Began working with Student Financial Services to combine SAP and=
=20
MITSIS data.
=B7       Began initial work with Marine Brown (AMPS) on a set of three=20
reports they want for
         consolidated and detailed monthly and YTD reporting.
=B7       Continued converting existing Brio 5 reports to Brio 6 in=20
anticipation of Brio 6 roll-out.
=B7       Completed the design and loaded HR Roles data into the warehouse.
=B7       Continue to work on the analysis of the SAP/HR implementation in=
=20
the warehouse.
=B7       Continue design and implementation of new HR Org hierarchy.
=B7       Continue data work with the Project Intersection team.
=B7       Attended Brio Technology Symposium in San Diego.
=B7       Began data modeling of Keys data.


Next Month's Plans (December, 2002)
=B7       Prepare for migration to Freewilly and Oracle 8.1.7 (December 9,=
 2002).
=B7       Begin upgrade of Orca.
=B7       Begin to plan for enhancements (oracle 8 functionality) on Orca=
 and=20
Freewilly.
=B7       Continue work on SAP/HR.
=B7       Work with Joe Flynn to set a timeline for rollout of SAP/HR and=
 DW.
=B7       Begin HR Conceptual Corporate data modeling.
=B7       Begin HR Conceptual Reporting data modeling.
=B7       Provide a 2nd training session for the budget office.
=B7       Begin work with Lody Petriv and others on additional queries to=20
help the budget office with
         reporting and paper reduction (e.g., monthly budget authorization=
=20
statements).
=B7       Continue converting web queries to Brio 6.
=B7       Do the analysis to create proper specifications for an inexpensive=
=20
web server to house and
         run all the Data Warehouse web programs (which are currently on=20
BLUE-GOOSE - which
         is old and being phased out, and ELSA - which is a personal and=20
old Athena workstation).
=B7       Continue data modeling sessions with TLO.
=B7       Begin data modeling sessions with the MIT Card Office.
=B7       Begin design of the Library Subscription data.
=B7       Modify a couple of wrapper functions in whconv to include a new=
 web=20
browser (Mozilla) and
         a couple of new browser versions for Netscape in Web Hits=
 reporting.
=B7       AAUDE - Continue work on IPEDS Fall Enrollment.
=B7       AAUDE - Analysis work on IPEDS Finance.
=B7       Prepare for and train new hire.


Next Community Milestones:
=B7       Migration to new server and upgrade database from Oracle 7.3.4 to=
=20
8.1.7  -- December 9,2002
=B7       Rollout of the SAP/HR/CYBORG - Early 2003
=B7       Load summary (by service) MIT Medical data into the DW  On hold=20
Medical revisiting what it
         is they are trying to accomplish.
=B7       Load TLO case data into the DW.
=B7       Load MIT Card Office data (including pictures) into the DW.

--=====================_55464333==_.ALT
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<br>
Team Name: Data Warehouse<br>
Team Leader: Scott Thorne<br>
Report Date: December 6, 2002<br>
URL:
<a href=3D"http://web.mit.edu/warehouse/"=
 eudora=3D"autourl">http://web.mit.edu/warehouse/</a><br><br>
<br>
This month's accomplishments (November 2002)<br><br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Continued
work on Freewilly setup and work on Oracle 8.1.7 migration.=20
<dl><font face=3D"Courier New, Courier">
<dd>o </font>Ran all jobs in parallel on both machines. (Last week of
November)<font face=3D"Courier New, Courier">=20
<dd>o </font>Add scripts to generate statistics for all tables and
indexes. <font face=3D"Courier New, Courier">
<dd>o </font>Export/import of groups of tables from ORCA to
FREEWILLY.<font face=3D"Courier New, Courier">=20
<dd>o </font>Worked on re-assigning correct storage parameters for tables
with high=20
<dd><x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab><x-tab>&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>number
of extents, re-creating tables, rebuilding indexes, modifying scripts,
etc.<font face=3D"Courier New, Courier">=20
<dd>o </font>Fixed inconsistencies between ORCA and FREEWILLY database
objects identified=20
<dd><x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab><x-tab>&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>through
Database Object Compare<font face=3D"Courier New, Courier">=20
<dd>o </font>Created another version of gen_create Pro*C program that
allows us to use 'create=20
<dd><x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab><x-tab>&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>table'
script for individual tables as well as in batch
mode.<font face=3D"Courier New, Courier">=20
<dd>o </font>Identified location of various pieces of C source code, as
well as all 'include' and=20
<dd><x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab><x-tab>&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>'header'
files on TAJ, which must be preserved on ORCA when it becomes a test=20
<dd><x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab><x-tab>&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>machine.&nbsp;
During this inventory we identified outdated and 'out of use' programs,=20
<dd><x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab><x-tab>&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>as
well as discrepancies between RCS and SRCAfiles.=20
</dl><font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;</x-tab></font>Demo
graduate admissions and student data in a Filemaker User Group meeting.
<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Created
BrioQuery scripts for Admissions Office to report the &quot;US News &amp;
World <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>Report&quot;
and other surveys, on mean GRE scores of admitted &amp; enrolled
graduates <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>by entry
terms and admissions programs for the School of Engineering.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Demo
graduate admissions and student data in a Filemaker User Group
meeting.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Worked
on the enhancements to LIBRARY_ITEM_DETAIL table, which included <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>addition
of new fields, renaming of some existing fields,and addition of a brand
new <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>dimension
table called LIBRARY_CALL_NUMBER_SEARCH for limiting the selection <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>by call
number ranges.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Taught
Brio 6 class on querying and combining data from multiple data sources to
<br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>the Budget
Office.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Began
HR Conceptual Historical Data Modeling.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Began
working with Student Financial Services to combine SAP and MITSIS
data.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Began
initial work with Marine Brown (AMPS) on a set of three reports they want
for <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>consolidated
and detailed monthly and YTD reporting.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Continued
converting existing Brio 5 reports to Brio 6 in anticipation of Brio 6
roll-out.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Completed
the design and loaded HR Roles data into the warehouse.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Continue
to work on the analysis of the SAP/HR implementation in the
warehouse.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Continue
design and implementation of new HR Org hierarchy.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Continue
data work with the Project Intersection team.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Attended
Brio Technology Symposium in San Diego.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Began
data modeling of Keys data.<br><br>
<br>
Next Month's Plans (December, 2002)<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Prepare
for migration to Freewilly and Oracle 8.1.7 (December 9, 2002).<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Begin
upgrade of Orca.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Begin
to plan for enhancements (oracle 8 functionality) on Orca and Freewilly.
<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Continue
work on SAP/HR.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Work
with Joe Flynn to set a timeline for rollout of SAP/HR and DW.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Begin
HR Conceptual Corporate data modeling.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Begin
HR Conceptual Reporting data modeling.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Provide
a 2nd training session for the budget office.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Begin
work with Lody Petriv and others on additional queries to help the budget
office with <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>reporting
and paper reduction (e.g., monthly budget authorization=20
statements).<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Continue
converting web queries to Brio 6.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Do
the analysis to create proper specifications for an inexpensive web
server to house and <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>run all
the Data Warehouse web programs (which are currently on BLUE-GOOSE -
which <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>is old and
being phased out, and ELSA - which is a personal and old Athena
workstation).<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Continue
data modeling sessions with TLO.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Begin
data modeling sessions with the MIT Card Office.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Begin
design of the Library Subscription data.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Modify
a couple of wrapper functions in whconv to include a new web browser
(Mozilla) and <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>a couple
of new browser versions for Netscape in Web Hits reporting.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>AAUDE
- Continue work on IPEDS Fall Enrollment.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>AAUDE
- Analysis work on IPEDS Finance.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Prepare
for and train new hire. <br><br>
<br>
Next Community Milestones:<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Migration
to new server and upgrade database from Oracle 7.3.4 to 8.1.7&nbsp; --
December 9,2002<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Rollout
of the SAP/HR/CYBORG - Early 2003<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Load
summary (by service) MIT Medical data into the DW&nbsp; On hold Medical
revisiting what it <br>
<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</x-tab>is they
are trying to accomplish.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Load
TLO case data into the DW.<br>
<font face=3D"Symbol">=B7<x-tab>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
x-tab></font>Load
MIT Card Office data (including pictures) into the DW.<br>
</html>

--=====================_55464333==_.ALT--


home help back first fref pref prev next nref lref last post