About This Course

This course teaches methods of evaluation and testing that allow for a thorough analysis of a design in an attempt to positively refine that design. Students learn methods of evaluation and forms for documenting design changes; additionally, students learn to propose design suggestions that are technically feasible and appropriate for a given target audience.


Core Concepts and Ideas

This class emphasizes the following main ideas, themes, and concepts:

  • User testing and various forms of evaluative design research, including quantitative methods and qualitative methods – and the distinction between these various methods
  • Testing facilitation, in order to gain familiarity with moderating in an objective manner
  • Deliverable creation and presentation, describing usability findings in a clear and concise manner, and making recommendations for design changes

Reading List

Outcomes and Competencies

The following outcome statements articulate the competencies, abilities, and skills a student will have as a result of completing this class. Students will...

  • Be able to plan an appropriate testing session to understand if a particular interaction design is usable, useful and desirable
  • Be able to conduct evaluation testing using think-aloud protocol and heuristic evaluations.
  • Understand the existing ecosystem of traditional testing methodologies, and be aware of current methods available for investigating service design.
  • Understand how to document and describe evaluation findings related to overall service offering.

Course Schedule

    In Class Prior to Class

1

Mon, 1/7

Lecture: Assignment 1 – key components: Group Coordination; Heuristic Evaluation, Usability Test Plan/Protocol; Recruiting/Screeners

Templates for Assignment 1 will be available to use after presentation of these materials.

Preparation for 1/7 class: research analogous services/products, be prepared to give 5 minute individual presentations – no group coordination necessary. What are the analagous service/products, and their relationship to your group’s focus? Include visual image that can be displayed.

2

Wed, 1/9

Discussion: Q/A on Assignment 1

In class: Heuristic evaluations of analogous service/product, definition of think-aloud usability test plan/protocol.

Focus on recruiting.

Work as needed to meet targeted milestones for Assignment 1.

3

Mon, 1/14

Class at Projekt202 (1300 Guadalupe)

Kijana Knight Torres substitute teacher

Practice usability think-aloud test

Work as needed to meet targeted milestones for Assignment 1.

4

Wed, 1/16

Class at Projekt202 (1300 Guadalupe)

Kijana Knight Torres substitute teacher

Perform usability think-aloud test

Work as needed to meet targeted milestones for Assignment 1.

5

Mon, 1/21

In class work on Assignment 1 – usability testing

Analyze results, create presentations

All testing to be completed prior to start of class 1/21

6

Wed, 1/23

Group Presentations of Assignment 1

Lecture: Assignment 2 – Competitive Assessment

Templates for Assignment 2 will be available to use after presentation of these materials.

In preparation for 1/23 class: finalize/practice presentations on usability tests.

7

Mon, 1/28

Class at Projekt202 (1300 Guadalupe)

Kijana Knight Torres substitute teacher

Groups present at the beginning of class their plans for competitive assessment.

Perform competitive assessment during class

Be prepared to present at beginning of 1/28 competitive services/products to be included in assessment, create group assignments/plan for performing competitive assessment

8

Wed, 1/30

Class at Projekt202 (1300 Guadalupe)

Kijana Knight Torres substitute teacher

In class completion of competitive assessment. At the end of class, present rough draft of findings, for comment and guidance on final deliverable.

As needed to ensure ability to finalize competitive analysis and produce rough draft of report by end of 1/30 class.

9

Mon, 2/4

Presentation: Assignment 3 – Cognitive Walkthrough (CW) enhanced Focus Groups.

Finish Written Competitive Assessment Report, Due at start of class 2/4

10

Wed, 2/6

In class work to create materials for Focus Groups

Work as needed to meet targeted milestones for Assignment 3.

11

Mon, 2/11

Perform CW enhanced Focus Group 1 – Stakeholders

Work as needed to meet targeted milestones for Assignment 3.

12

Wed, 2/13

Perform CW enhanced Focus Group 2 – Targeted End Users

Work as needed to meet targeted milestones for Assignment 3.

13

Mon, 2/18

Presentation of Assignment 3

Lecture: Assignment 4 – Survey Design

Practice presentation of Assignment 3

14

Wed, 2/20

In class design surveys

Focus on distribution lists for survey

Work as needed to meet targeted milestones for Assignment 4.

15

Mon, 2/25

In class analysis of survey results, create report

Work as needed to meet targeted milestones for Assignment 4.

16

Wed, 2/27

Lecture/Discussion: Leveraging ISDE 301 techniques in Q4

Survey Report Due at beginning of class 2/27