[1044] in I/T Delivery
DW February Status Report
daemon@ATHENA.MIT.EDU (Mary Weisse)
Mon Feb 10 11:38:17 2003
Message-Id: <4.3.2.7.2.20030210113609.017b0810@hesiod>
Date: Mon, 10 Feb 2003 11:42:29 -0500
To: delivery@mit.edu
From: Mary Weisse <mca@MIT.EDU>
Mime-Version: 1.0
Content-Type: multipart/alternative;
boundary="=====================_14783357==_.ALT"
--=====================_14783357==_.ALT
Content-Type: text/plain; charset="iso-8859-1"; format=flowed
Content-Transfer-Encoding: quoted-printable
Team Name: Data Warehouse
Team Leader: Scott Thorne
Report Date: February 10, 2002
URL: http://web.mit.edu/warehouse/
This month's accomplishments (January, 2003)
=B7 Finished designing tables and loaded data for AAUDE IPEDS Finance.
=B7 Worked with programmer in the Alumni Office to set up access of=20
Alumni biographic,
address, and degree data by Course/Major.
=B7 Set up the new RCS (Revision Control System) on the new test=
system=20
(Freewilly).
Created scripts to check in SQL scripts, table load scripts, shell=
=20
scripts, perl scripts,
C programs, etc. from different directories to the new RCS.
=B7 Worked with SSIT to load all subject enrollment data to the Data=
=20
Warehouse.
(i.e. in addition to "registered" subjects, we also load all other=
=20
subject enrollment
records, including: dropped, advanced placement, transfer.)
=B7 Added academic term and financial aid year fields to the TIME=
MONTH=20
table.
=B7 Worked with Maria Fernandez (Graduate Award Simplification Task=20
Force) on
analysis of variances between graduate award and payroll (student=
=20
monthly payroll).
=B7 Tested the new test system (Freewilly).
=B7 Started analysis work on improvements to querying Web hits data.
=B7 Began analyzing and implementing Oracle 8.1.7 functionality.
=B7 Began analyzing database performance issues.
=B7 Began analyzing and trying to resolve Listener problems.
o Analyze and try to resolve hung job problem on orca.
o Analyzed and resolved snapshot too old error on rollback=
segments.
o Analyze problem with database link to the Libraries=20
machine Grammy.
=B7 Worked on creating and populating the Master project History=
Detail.
Loaded the amounts for the respective account flags.
=B7 Gave two IAP demos on Brio 6
=B7 Working with IS training team to create several classes for Brio=
6:=20
there will be at
least four different classes:
o Migrating to Brio 6 for Brio 5 users -- pilot class will=
=20
be February 14
o Basics 1 & 2 for new users
o Advanced class for the more sophisticated new features --=20
combining queries etc.
=B7 Continued converting the web queries to Brio 6
=B7 Created an "historic chairs" query for Assistant Deans to help=
DLCs=20
clean up historic
HR data if not to be in SAP.
=B7 Began modeling, analyzing, loading EHS person data.
=B7 Continue working on the HR Conceptual data model(s)
=B7 Continued work with the Project Intersections Committee.
=B7 Gave a Data Warehouse demo to the Plasma Science Fusion Center.
=B7 Prepare 2-day training class for AAUDE at AIR Conference in=
Orlando.
=B7 Designed developed and tested generic problem checking program to=
=20
automate
detection and send email notification of data=20
problems/inconsistencies as a
result of data loads.
Next Month's Plans (February, 2003)
=B7 Working on updating the is_terminated_master_project=
column=20
in the
Master project History Detail.
=B7 Begin testing and loading samples of employee pictures (as=
=20
BLOB, Binary
Large Object, data type) from MIT Card Office to the test=
=20
database.
=B7 Continued work with SSIT to load pre-registration data to Data=20
Warehouse.
=B7 Continued work with Maria Fernandez on Graduate Award and student=
=20
monthly payroll.
=B7 Continued work with Alumni Office to load employment information=
of=20
Alumni to Data Warehouse.
=B7 Web Hits: change processing procedure to include a new web browser=
=20
(Mozilla)
and a couple of new browser versions for Netscape in Web Hits=20
reporting. Will
also look at why we need to keep two tables which contains the web=
=20
hit detail
data: webhits_detail and webhits_full_detail.
=B7 Finish converting queries and create a new set of rotating tips=
for=20
Brio 6.
=B7 After reviewing feedback from Migration class pilot, plan a user=
=20
group demo to
have ready in addition to W89 classes.
=B7 Begin preparation for three Library classes - one for "button=20
pushers," two longer
classes for financial and non-financial people (acquisitions and=20
catalog people).
First class may happen by end of February, if so may also add=20
Library queries to
web page -- the basic set of queries is almost final, Joan was to=
=20
show them to
everyone last week and then fine-tune, and discuss with me if she=
=20
needed help
with anything. She is supposed to give me specs for the classes=20
this week-- what
queries people want for each class, and how different people might=
=20
want to tweak
the generic versions that will be on the web, so that I build the=
=20
class exercises around
what they want.
=B7 Continue developing AAUDE release II analysis and implementation=
=20
plans.
=B7 Continue work on EHS
=B7 Continued work with the Project Intersections Team.
=B7 Work on a specification for an inexpensive web server to house and=
=20
run all the
Data Warehouse web programs (which are currently on BLUE-GOOSE -=20
which
is old and being phased out, and ELSA - which is a personal and=20
old Athena workstation).
o Web/CGI applications from SNOWDROP to BLUE-GOOSE.
=B7 Prepare a demo for Aero and Astro.
=B7 Deliver 2-day training class for AAUDE at AIR Conference in=
Orlando.
=B7 Continue work on SAP/HR.
=B7 Complete the HR Conceptual data model(s).
Next Community Milestones:
=B7 Rollout of the SAP/HR/CYBORG - September 2003
=B7 Load TLO case data into the DW Waiting on TLO.
=B7 Load MIT Card Office data (including pictures) into the DW.
--=====================_14783357==_.ALT
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html>
<b>Team Name</b>: Data Warehouse<br>
<b>Team Leader:</b> Scott Thorne<br>
<b>Report Date:</b> February 10, 2002<br>
<b>URL:</b>
<a href=3D"http://web.mit.edu/warehouse/" eudora=3D"autourl"><font=
color=3D"#0000FF"><u>http://web.mit.edu/warehouse/</a><br>
<br>
</u></font><b>This month's accomplishments (January, 2003)<br>
</b><font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Finished designing tables and loaded data for AAUDE IPEDS Finance.=
<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Worked with programmer in the Alumni Office to set up access of=
Alumni biographic, <br>
<x-tab> </x-tab>address, and=
degree data by Course/Major.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Set up the new RCS (Revision Control System) on the new test system=
(Freewilly). <br>
<x-tab> </x-tab>Created=
scripts to check in SQL scripts, table load scripts, shell scripts, perl=
scripts, <br>
<x-tab> </x-tab>C programs,=
etc. from different directories to the new RCS. <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Worked with SSIT to load all subject enrollment data to the Data=
Warehouse. <br>
<x-tab> </x-tab>(i.e. in=
addition to "registered" subjects, we also load all other subject=
enrollment <br>
<x-tab> </x-tab>records,=
including: dropped, advanced placement, transfer.)<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Added academic term and financial aid year fields to the TIME MONTH=
table. <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Worked with Maria Fernandez (Graduate Award Simplification Task=
Force) on <br>
<x-tab> </x-tab>analysis of=
variances between graduate award and payroll (student monthly payroll).=
<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Tested the new test system (Freewilly).<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Started analysis work on improvements to querying Web hits data.=
<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Began analyzing and implementing Oracle 8.1.7 functionality.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Began analyzing database performance issues.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Began analyzing and trying to resolve Listener problems.
<dl><font face=3D"Courier New, Courier">
<dd><x-tab> </x-tab>o<x-tab>&=
nbsp; </x-tab> </font>Analyze and try to=
resolve hung job problem on orca.=20
</dl><font face=3D"Courier New,=
Courier"><x-tab> </x-tab>o=
</font>Analyzed and resolved snapshot too old error on rollback segments.=
<br>
<font face=3D"Courier New,=
Courier"><x-tab> </x-tab>o=
</font>Analyze problem with database link to the Libraries machine =
Grammy. <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Worked on creating and populating the Master project History Detail.=
<br>
<x-tab> </x-tab>Loaded the=
amounts for the respective account flags. <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Gave two IAP demos on Brio 6<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Working with IS training team to create several classes for Brio 6:=
there will be at <br>
<x-tab> </x-tab>least four=
different classes:
<dl><font face=3D"Courier New, Courier">
<dd><x-tab> </x-tab>o<x-tab>&=
nbsp; </x-tab></font> Migrating to Brio 6=
for Brio 5 users -- pilot class will be February 14
</dl><font face=3D"Courier New,=
Courier"><x-tab> </x-tab>o=
</font>Basics 1 & 2 for new users<br>
<font face=3D"Courier New,=
Courier"><x-tab> </x-tab>o=
</font>Advanced class for the more sophisticated new features -- combining=
queries etc. <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued converting the web queries to Brio 6<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Created an "historic chairs" query for Assistant Deans to=
help DLCs clean up historic <br>
<x-tab> </x-tab>HR data if=
not to be in SAP.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Began modeling, analyzing, loading EHS person data.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continue working on the HR Conceptual data model(s)<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued work with the Project Intersections Committee.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Gave a Data Warehouse demo to the Plasma Science Fusion Center.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Prepare 2-day training class for AAUDE at AIR Conference in=
Orlando.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Designed developed and tested generic problem checking program to=
automate <br>
<x-tab> </x-tab>detection and=
send email notification of data problems/inconsistencies as a <br>
<x-tab> </x-tab>result of=
data loads.<br>
<br>
<b>Next Month's Plans (February, 2003)<br>
</b><font=
face=3D"Symbol">=B7<x-tab> </x-tab=
><x-tab> </x-tab></font>Worki=
ng on updating the is_terminated_master_project column in the <br>
<x-tab> </x-tab><x-tab> =
</x-tab>Master project History=
Detail. <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
><x-tab> </x-tab></font>Begin=
testing and loading samples of employee pictures (as BLOB, Binary <br>
<x-tab> </x-tab><x-tab> =
</x-tab>Large Object, data type)=
from MIT Card Office to the test database.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued work with SSIT to load pre-registration data to Data=
Warehouse. <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued work with Maria Fernandez on Graduate Award and student=
monthly payroll.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued work with Alumni Office to load employment information of=
Alumni to Data Warehouse.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Web Hits: change processing procedure to include a new web browser=
(Mozilla) <br>
<x-tab> </x-tab>and a couple=
of new browser versions for Netscape in Web Hits reporting. Will <br>
<x-tab> </x-tab>also look at=
why we need to keep two tables which contains the web hit detail <br>
<x-tab> </x-tab>data:=
webhits_detail and webhits_full_detail.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Finish converting queries and create a new set of rotating tips for=
Brio 6.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>After reviewing feedback from Migration class pilot, plan a user=
group demo to <br>
<x-tab> </x-tab>have ready in=
addition to W89 classes.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Begin preparation for three Library classes - one for "button=
pushers," two longer <br>
<x-tab> </x-tab>classes for=
financial and non-financial people (acquisitions and catalog people). <br>
<x-tab> </x-tab>First class=
may happen by end of February, if so may also add Library queries to <br>
<x-tab> </x-tab>web page --=
the basic set of queries is almost final, Joan was to show them to <br>
<x-tab> </x-tab>everyone last=
week and then fine-tune, and discuss with me if she needed help <br>
<x-tab> </x-tab>with=
anything. She is supposed to give me specs for the classes this week-- what=
<br>
<x-tab> </x-tab>queries=
people want for each class, and how different people might want to tweak=
<br>
<x-tab> </x-tab>the generic=
versions that will be on the web, so that I build the class exercises=
around <br>
<x-tab> </x-tab>what they=
want.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continue developing AAUDE release II analysis and implementation=
plans. <br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continue work on EHS<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continued work with the Project Intersections Team.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Work on a specification for an inexpensive web server to house and=
run all the <br>
<x-tab> </x-tab>Data=
Warehouse web programs (which are currently on BLUE-GOOSE - which <br>
<x-tab> </x-tab>is old and=
being phased out, and ELSA - which is a personal and old Athena=
workstation).=20
<dl><font face=3D"Courier New, Courier">
<dd><x-tab> </x-tab>o<x-tab>&=
nbsp; </x-tab></font>Web/CGI applications=
from SNOWDROP to BLUE-GOOSE.
</dl><font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Prepare a demo for Aero and Astro.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Deliver 2-day training class for AAUDE at AIR Conference in=
Orlando.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Continue work on SAP/HR.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Complete the HR Conceptual data model(s).<br>
<br>
<b>Next Community Milestones:<br>
</b><font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Rollout of the SAP/HR/CYBORG - September 2003<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Load TLO case data into the DW Waiting on TLO.<br>
<font=
face=3D"Symbol">=B7<x-tab> </x-tab=
></font>Load MIT Card Office data (including pictures) into the DW.<br>
<br>
</html>
--=====================_14783357==_.ALT--
