Usability and Accessibility Testing in Support of Internet Reporting

Fifty-third Plenary Session

of the Conference of European Statisticians

Geneva, 13-15 June, 2005

Elizabeth D. Murphy, Ph.D.

U.S. Census Bureau

Overview

• Purposes of testing

• Testing prototypes of the Census Internet form: 2000 – 2005

• Steps in completing the Internet form– Examples from log-in requirement

• Major lessons learned

Purposes of Testing

• Usability • Accessibility

Testing Prototypes of the Census Internet Form: 2000 - 2005

• Census 2000

• 2003 National Census Test

• 2004 Overseas Enumeration Test

• 2005 National Census Test

Steps in Accessing and Completing the Internet Form

• Receive and open mailing package

• Learn about Internet option

• Arrive at housing unit log-in screen

• Start form >>> Submit data

• Receive “Thank You” screen and exit

Log-in Requirement in Census 2000

“What…where is my Census ID Number?”

Census 2000: Graphic in Help

2005 National Census Test: Prototype Log-in Screen

Before usability testing with 22 test users

“Do I have a Census ID number? What ID?”

2005 National Census Test:Revised Log-in Screen

After changes based on usability findings

Major Lessons Learned

• Completing the online form itself is not a problem.

• Cumbersome, confusing log-in process >> loss of respondents

• Usability and accessibility testing reveal problems not revealed by other kinds of software testing.

• A smooth experience for the respondent requires end-to-end design.