Smart Tester™

A Platform for Online Tests Based on “Test-by-Doing”

BITS C461/IS 341 Software EngineeringFirst Semester 2003-2004

The Reality…

Absence of robust, reliable and flexible online testing mechanisms

Even online learning environments resort to old-fashioned tests

Depending on industry certifications not reliable

Volume recruitment, testing and evaluation requirements crying out for help

The Present…

Technology-based online testing still primitive

Heavy reliance on questions that are based on multiple choice of answers

Few pose questions that require simple, single phrases as answer

Still fewer venture to using any other sophisticated testing instrument

Online tests based on “tasks” and “ testing by doing” are rare

The Consequences…Multiple choice type of questions have

serious limitations– Testing performance capabilities in GUI environments

not effective– Not easy to test problem solving capabilities – Not conducive to test programming (coding) skills– Not appropriate device to gauge abilities of a person in

using applications and toolsIndustry certifications tend to become

unreliableLimits growth of online learnersNo significant help to harried HR

Managers

Smart Tester™

A software platform for creating and deploying online tests

Capability to go beyond traditional testing instruments

Tests based on tasksUser performance tracking and

evaluationFlexible, customizable feedback and

reporting mechanism

Various Stakeholders of Smart Tester™

How the Test Designers Use Smart Tester™

How the Candidates Use Smart Tester™

The Splash Screen

Login Screen on Smart Tester™

Test Selection Screen on Smart Tester™

General Instructions on Smart Tester™

Sample Question 1 on Smart Tester™

Sample Question 2 on Smart Tester™

Sample Question 3 on Smart Tester™

Sample Question 4 on Smart Tester™

Sample Question 5 on Smart Tester™

VB Code Window to Perform Task

Sample Question 6 on Smart Tester™

VB User Controls Window to Perform Task

Indicating Unanswered Questions

Displaying Results

Displaying Statistics

User Skills & Strengths-Weaknesses

Smart Tester™ Wish List

Building a catalog of tests Streaming of questions in an adaptive

manner – presenting alternate questions for questions answered incorrectly

Need-based packaging of Smart Tester™– Recruitment needs

– Certification needs

– Training needs

Support for “Show-me How” for task-based questions

Hope You Enjoy Working Towards Developing this Challenging

Product!