[101] in DCNS Development

home help back first fref pref prev next nref lref last post

A/UX testing checklist

daemon@ATHENA.MIT.EDU (Mark Rosenstein)
Wed Aug 21 17:29:22 1991

Date: Wed, 21 Aug 91 17:27:36 -0400
From: Mark Rosenstein <mar@MIT.EDU>
To: developers@MIT.EDU
Cc: mar@MIT.EDU

We delayed releasing the Mac as an Athena platform for this fall
partly for performance reasons, and partly out of concern for making
sure it gets adequate testing.  As we make this platform available to
more people this fall for testing, we are providing a checklist of
things to try.

I would like to get comments back from developers about these lists,
if there is anything that is missing that you think should be there.
Note that there are actually two lists, depending on the background of
the tester: one for people who are primarily Mac users, another for
those who are basically Unix workstation users.  We will print up
copies of these lists for testers once the A/UX release is ready for
real testing.
					-Mark

----------------------------------------------------------------
	       Macintosh Users' A/UX Testing Checklist

GENERAL:

Note: Rather than restarting and shutting down the machine, you should
just login and logout.

*Operation:
- How would you rate the login time of the machine? (fast, acceptable,
  unbearably slow, etc)  
- Did you encounter any problems during login?
- Were you able to have your usual number of applications open, and
  easily switch between them? 
- Were you able to use your normal backup software for backing up any
  MacOS volumes on your local disk? 

*Printing:
Note: If you are sharing a printer with people running System 7, those 
people will need to reset the printer after you have used it.

- Did your print job cause any problems for other users trying to
  print? 
- Were you able to print to an Athena printer (using 'lpr') without
any problems?  

END-USER APPLICATIONS:
*Microsoft Word: (or other Word Processing Software)
- How would you rate the initial startup speed?
- Were you able to access and modify documents on the local disk? How
  would you rate the access speed?
- Were you able to access and modify documents stored on an AppleShare
  server or System 7 published volumes? How would you rate the access
  speed? 
- Were you able to access and modify documents stored in an NFS
  filesystem? How would you rate the access speed?
- Were you able to access and modify documents stored in an AFS
  filesystem? How would you rate the access speed?
- Were there any noticable differences between running the application
  on a A/UX machine and on an MacOS machine? (error messages, changes
  in functionality, speed, etc)

*PageMaker: 
Note: PageMaker must reside on a separate MacOS volume
- How would you rate the initial startup speed?
- Were you able to access and modify documents on the local disk? How
  would you rate the access speed?
- Were you able to access and modify documents stored on an AppleShare
  server or System 7 published volumes? How would you rate the access
  speed? 
- Were you able to access and modify documents stored in an NFS
  filesystem? How would you rate the access speed?
- Were you able to access and modify documents stored in an AFS
  filesystem? How would you rate the access speed?
- Were there any noticable differences between running the application
  on a A/UX machine and on an MacOS machine? (error messages, changes
  in functionality, speed, etc)


*Excel: (or other Spreadsheet software)
- How would you rate the initial startup speed?
- Were you able to access and modify spreadsheets on the local disk? How
  would you rate the access speed?
- Were you able to access and modify spreadsheets stored on an AppleShare
  server or System 7 published volumes? How would you rate the access
  speed? 
- Were you able to access and modify spreadsheets stored in an NFS
  filesystem? How would you rate the access speed?
- Were you able to access and modify spreadsheets stored in an AFS
  filesystem? How would you rate the access speed?
- Were there any noticable differences between running the application
  on a A/UX machine and on an MacOS machine? (error messages, changes
  in functionality, speed, etc)


*FileMaker: (or other Database software)
- How would you rate the initial startup speed?
- Were you able to access and modify databases on the local disk? How
  would you rate the access speed?
- Were you able to access and modify databases stored on an AppleShare
  server or System 7 published volumes? How would you rate the access
  speed? 
- Were you able to access and modify databases stored in an NFS
  filesystem? How would you rate the access speed?
- Were you able to access and modify databases stored in an AFS
  filesystem? How would you rate the access speed?
- Were there any noticable differences between running the application
  on a A/UX machine and on an MacOS machine? (error messages, changes
  in functionality, speed, etc)

COMMUNICATIONS:
*FTP/TELNET
- Were you able to use the A/UX versions of FTP and TELNET similar to
  how you use the MacIP versions on other Macs?
- Were there any noticable differences in speed?

*Mail Programs:
Note: TechMail does not run on this machine.
- Were you able to use a mail program?
- Were there any noticeable differences in speed compared to your
  usual mail handling package?

*Other Programs:
Note: MacZephyr will not run, but the athena version of zephyr will run.
- Were you able to use other communications packages you normally use
  (Applelink,Zterm, Microphone II, White Knight, NCSA Telnet, etc)?  
- Were there any noticable differences in speed?

DEVELOPMENT TOOLS:
Note: Think C, Think Pascal, and MPW will not run on this platform.


*Res Edit: (use only the latest version)
- Were you able to use the product in the way you normally do?
- Were there any noticeable differences between running the product on
  the A/UX machine and on a MacOS machine?


UTILITIES:
Note: The use of virus detection/eradication software is not
recommended on this platform; it can trash your disk. MacOS dick
recovery tools (911, Norton Utilities, etc) will not work.

*Other:
- Were you able to run other programs you normally use, such as
  StuffIt, screensavers, DiskCopy, Compact Pro, etc?
- Were there noticeable differences in speed?

SUMMARY:
- Overall, how would you rate your satisfaction with the A/UX Mac? 
- What changes would you like to see made?
- Any other comments:


----------------------------------------------------------------
	    Unix Workstation Users' A/UX Testing Checklist

*SESSION:
- Do all of the login options work?
- Could you login?
- How long did it take to login?
- Did your dotfiles work?
- Is the screen layout reasonable?
- Can you run enough applications at the same time?
- Can you change your password?
- Can you logout the way you usually do?

*WORD PROCESSING:
- Does emacs work the way you expect it to?
- Can you paste text from apple applications (word, page maker) into emacs?
- Can you paste text from emacs to apple applications?
- Can you print documents?  Do they go to the proper printer?

*COMMUNICATIONS:
- Can you read your mail with mh?
- Can you read your mail with emacs rmail?
- Can you send email?
- Do zephyrgrams appear where you expect them?
- Can you send zephyrgrams?
- Can you rlogin to other workstations?
- (If your mac is privitized) Can you remotely login to the mac?

*HELP:
- Can you use olc?
- Does olh work?
- Is the text in olh useful on the Macintosh?
- Are the man pages accessible?

*DEVELOPMENT:
- Can you compile a simple C program?
- Can you compile a simple fortran program?
- Can you compile a X program?
- Can you compile a motif program?
- Can you debug your program?

*OTHER:
- Can you get files from the mac floppy drive into your locker?
- Can you write files to the mac floppy drive from your locker?

*SUMMARY: 
- Are there any applications missing that you need?
- What difference between other workstations and the mac caused you the
	most trouble?
- What major differences did you see between the mac and other Athena
	workstations? 
- Is it fast enough to use?
- Can you get useful work done using a mac?
- Are there any changes you would like to see?
- Any other comments:



home help back first fref pref prev next nref lref last post