About This Course

This course teaches methods of evaluation and testing that allow for a thorough analysis of a design in an attempt to positively refine that design. Students learn methods of evaluation and forms for documenting design changes; additionally, students learn to propose design suggestions that are technically feasible and appropriate for a given target audience.


Core Concepts and Ideas

This class emphasizes the following main ideas, themes, and concepts:

  • User testing and various forms of evaluative design research, including quantitative methods and qualitative methods – and the distinction between these various methods
  • Testing facilitation, in order to gain familiarity with moderating in an objective manner
  • Deliverable creation and presentation, describing usability findings in a clear and concise manner, and making recommendations for design changes

Outcomes and Competencies

The following outcome statements articulate the competencies, abilities, and skills a student will have as a result of completing this class. Students will...

  • Be able to plan an appropriate testing session to understand if a particular interaction design is usable, useful and desirable
  • Be able to conduct evaluation testing using think-aloud protocol and heuristic evaluations.
  • Understand the existing ecosystem of traditional testing methodologies, and be aware of current methods available for investigating service design.
  • Understand how to document and describe evaluation findings related to overall service offering.

Course Schedule

Class Date In Class Out of Class
1 1/10

Presentation: Writing scenarios, cognitive walkthroughs, think-aloud protocol

Discussion: beyond usability testing – testing service design

Assignment 1a: Prepare for in class testing of analogous software/service: scenario definition, identification of test questions, screen shots to support scenario. Due 1/12

Assignment 2a: Research service design test methods. Make plans for IXDA talks/people to meet with. Due 1/31
2 1/12

Practice: Think-aloud testing in class

Presentation: Coaching on think-aloud testing.

Presentation: End-user profiles and screeners.

Assignment 1b: First round of prototype testing of project design (scenarios, test questions, screens, data collection, writing report) including recruiting representative end-users. Prepare for in class dry-run of tests.

Notes:

Submit user profile and screener by 1/13 for instructor review before initiating recruiting.

Submit test design by 6pm Monday for instructor review, update test plan based on instructor feedback.
3 1/17 MLK – No Class  
4 1/19

In-class dry-run/mentoring: of (paper) prototype tests.

Presentation: Stakeholder identification and interviews/focus groups.

Assignment 3a: Identify stakeholders, create screener and initiate recruitment.
5 1/24

In-class testing: of (paper) prototypes with representative end users.

Assignment 1c: Write-up key findings from first round of project design tests. Due 1/27.
6 1/26

Student presentation of study findings.

Brainstorming: Recommendations from findings.

Assignment 3b: Stakeholder Interview/Focus group design.

Scheduling for 2/8-2-13.
7 1/31

No Class – IxDA Dublin

Assignment 2b: Research service design testing examples and procedures. Prepare presentation.
8 2/2

No Class – IxDA Dublin

Assignment 2b: Research service design testing examples and procedures. Prepare presentation.
9 2/7

Presentation: students present ideas for testing service design.

Practice: Dry-run of stakeholder interviews/focus groups

Assignment 2c: Write-up service design testing, initiate recruiting.

Assignment 3c: Perform stakeholder interviews/focus groups
10 2/9

Presentation: Measuring subjective opinions

Assignment 2d: Execute service design test.
11 2/14

Presentation – Heuristics evaluation of project designs

Assignment 4: Perform heuristic evaluation of other team designs.
12 2/16

Presentation: Kano Model Testing and bit-wise feature prioritization

Assignment 5: Incorporate testing findings into final presentations.
13 2/21

Presentation: Journey Maps used to communicate test findings

  
14 2/23

Mentoring scheduled for individual teams/projects

  
15 2/28

Mentoring scheduled for individual teams/projects

  
16 3/1

Final presentation of design solution