IAT 432 Design Evaluation -- Assignment 3 Assignment courtesty of Saul Greenberg Adapted by Alissa Antle

IAT 432 Team Assignment #3

Quantitative Evaluation -- A Controlled Experiment


  • Assignment details
  • Appendix 1: Instructions to subjects
  • Appendix 2: Text for copy typing
  • Appendix 3: Consent form and questionnaires
  • Appendix 4: Work Sheet
  • Grading Sheet
  • How to Structure Reports on Experiments in Human-Computer Interaction
  • Example of how to do stats with Excel
  • Software download

  • Tcl/TK environment - the programming language necessary to run the software, self installing script.
  • kb.tcl - The program - just double click the kb.tcl file after its downloaded. Note that the program will produce a file called test1.text containing the data after you run it.
  • Description

    This assignment is a hands-on exercise on quantitative evalution. Its immediate purpose is to give you experience conducting a controlled experiment, performing a simple statistical analysis, interpretting the results, and considering its implications to design decisions. Its other purpose is to provide you with enough knowledge of the experimental process to help you understand and appreciate the interaction design evaluation and HCI literature that uses this methodology. The assignment compares people's mouse-typing abilities on different keyboard layouts. Mouse typing is simply the speed at which someone types, using a mouse, on a soft keyboard presented on the computer screen. This year, the keyboard layouts considered are:

  • Phonepad versus an alphabetic keyboard
  • You will work with your team (groups of three or four) and each group uses its members as subjects. Your group will submit the data collected to your teaching assistant, who will compile the data from all group and hand it back to the class. Your group will then use an unpaired T-Test to check for differences between the typing speeds.


    Your group will deliver a substantial technical report that presents the experiment, collects the results, and discusses its implications. Your report must follow the format defined in the document How to Structure Reports on Experiments in HCI.

    Updated October 15 2009 by Alissa Antle