William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Usability EvaluationUsability Evaluation

Torres 14Torres 14

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

TopicsTopics

Evaluation GoalsEvaluation Goals Types of EvaluationsTypes of Evaluations Evaluation FactorsEvaluation Factors Preparing for an EvaluationPreparing for an Evaluation

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

TopicsTopics

Conducting an EvaluationConducting an Evaluation Data EvaluationData Evaluation Developer ParticipationDeveloper Participation Desk CheckingDesk Checking

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Evaluation GoalsEvaluation Goals

Predicting user satisfactionPredicting user satisfaction Understanding appearance and Understanding appearance and

behaviorbehavior Problem determination and Problem determination and

resolutionresolution Criteria validationCriteria validation

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Types of EvaluationsTypes of Evaluations

Ad hoc reviewAd hoc review Heuristic reviewHeuristic review Walk-throughWalk-through Conventional usability testConventional usability test Comparative usability evaluationComparative usability evaluation Field testsField tests

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Evaluation FactorsEvaluation Factors

Predetermined, objective criteriaPredetermined, objective criteria Structured and objective methodsStructured and objective methods User involvementUser involvement Techniques to determine right Techniques to determine right

and wrongand wrong

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Preparing for an Preparing for an EvaluationEvaluation PlanPlan DesignDesign Pre-evaluation briefingPre-evaluation briefing Pre-evaluation questionnairePre-evaluation questionnaire Scenarios and tasksScenarios and tasks Post-scenario questionnairesPost-scenario questionnaires

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Preparing for an Preparing for an EvaluationEvaluation Data to collectData to collect Source of subjectsSource of subjects Test platformTest platform Test conductorsTest conductors

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Conducting an EvaluationConducting an Evaluation

Set-upSet-up Pilot testPilot test Pretest questionnairePretest questionnaire Executing scenariosExecuting scenarios

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Conducting an EvaluationConducting an Evaluation

Evaluation notesEvaluation notes ComparisonsComparisons Post-scenario questionnairePost-scenario questionnaire Follow-upFollow-up

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Data EvaluationData Evaluation

Graphs and trend linesGraphs and trend lines Descriptive statisticsDescriptive statistics Causal analysisCausal analysis Reporting resultsReporting results

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Developer ParticipationDeveloper Participation

Lets the programmer see the end Lets the programmer see the end useruser

Determine next stepsDetermine next steps

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Desk CheckingDesk Checking

Is there sufficient capability?Is there sufficient capability? Are the UI features sufficient to Are the UI features sufficient to

accomplish the tasks?accomplish the tasks? Is response time fast enough?Is response time fast enough? Is installation easy?Is installation easy? Is it reliable?Is it reliable?

William H. Bowers – whb108@psu.eduWilliam H. Bowers – whb108@psu.edu

Questions & DiscussionQuestions & Discussion