Measured Success On Linked In

Copyright © McCann Associates. All Rights Reserved.

A Comprehensive Online Testing, Assessment, Certification & Data Management Platform

for Applicants, Employees, Business Partners & Customers


Agenda

1. Presentation & Discussion– Who are we?– Why automate testing?– Measured Success Capabilities?

2. Live Measured Success Demonstration

3. Q & A

Note: We are committed to honoring the meeting time of 1 hour. Interested parties may stay after for follow up.


Vantage ClientsBusiness & Technology Leaders

Microsoft

PTC


• Professional Assessment, Training & Certification Services since 1959

• Delivering custom software solutions for “high stakes” testing & assessments

• Experts in test development & delivery

• Harnessing proprietary software technology for world class solutions

• Delivering speed, accuracy, control, efficiency, flexibility & scale

• A Division of Vantage Technologies

• Leveraging world class, patented (37) semantic and linguistic solutions

• Intellimetric™: Gold standard for measuring of knowledge, skills & abilities

• Millions of essays automatically scored annually (ACT, GMAT and MCAT)

• iSeek™: Precision discovery for relevant results

• Supercruncher:™ Enterprise info/intelligence consolidation from multiple sources

• 193 million tests scored last year alone!

• We know words, word meanings and word relationships

• Better than anyone on this planet.

About McCann Associates


Testing Experience• Industry Solutions:

• Government: 1,000,000+ public safety employees

• Education: 1,000+ school districts

• Corporate & Professional Certification Programs

• Leading Business and Professional Organizations

• General Electric, Microwave Data Systems

• Association of Energy Engineers

• Net –Security Training for Compliance (SOX and Basel II)


Why Measured SuccessMeasured Success?

Paperless electronic testing is exponentially less expensive &

provides much faster results than traditional paper & pencil testing

Why Test & Certify?» Insure Knowledge Acquisition» Support Individual Productivity» Provide Candidate Loyalty» Improve User Satisfaction» Substantiate Quality» Re-enforce Market Positioning for:

- Product, Service, Company


• Test & Assessment Creation & Delivery

• Test Development by Client and/or

McCann Psychometric Services

• Targeted Research & Discovery: Candidates can selectively search trusted info within the company or web

• Candidate Training Libraries– Selectively deliver pre & post-test materials– Any format, managed by Administrator & Candidate

• TAC Dashboard for Administration– Students/Candidates, Groups/ Members, Tests/Assessments, Scoring

Comprehensive Solutions


High & Low Stakes Testing• Supports the following

assessment types:

• Certification exams in a secured environment *

• Practice tests for high stakes exams

• Training

• Evaluations for hiring and/or advancement

• Surveys

• Essays

* Secured tests are delivered with Vanguard Secure Testing Browser.


Measured Success

• Item Authoring supports the following question types:– Multiple Choice– Multiple Choice/Multiple Response– Survey Multiple Choice– Survey Short Answer– Scored Short Answer

• Fill-in-the-Blank• True/False• Yes/No

– Essay– Drag & Drop

• Image, Audio and Video files are supported


Sequence and Weight Items

• Rearrange the order in which questions are asked (i.e. sort by objective and ask all questions within a certain objective sequentially)

• Assign unique point values to each question

• Preview how questions will appear


Assigning a Test: Delivery Options• Set number of

submissions

• Set whether to allow candidates to Save and Finish Later

• Set whether candidate must answer all questions in the test

• Set navigation options

• Set question delivery

• Set start and end dates

• Set timer options


Create & Maintain a Secure Assessment Environment • Randomly vary the sequence of test questions by student

Vanguard Secure Testing Browser• Prohibits users from exiting the testing environment unless they complete or

suspend the test• Prevents users from accessing websites or using hotkeys, instant messenger,

menus or right-click mouse functions• Blocks pop-up windows from external applications or an application launched from

USB attached devices.• Traps input from USB keyboards and blocks CTRL-ALT-DEL and other commands


Assigning Test Scoring & Reporting

• Set minimum passing score

• Set passing/failing messages

• Set certificate options

• Set amount of results shown in candidate report


Immediate Score Report

• As soon as a candidate submits their test for scoring, they can immediately access their score report

• If the administrator for the test chooses to only enable minimal reporting, the candidate will only be provided with overall scoring for each category contained in their test


Detailed Post-Assessment

Item Review • Administrators may choose to enable detailed score reporting for remediation purposes

• Incorrectly answered questions are highlighted

• The included iSEEK tool enables candidates to access additional resources to improve skills in specific categories


Relevant Training Resources Available When Needed

• Candidates who use the iSEEK tool from within their score report are taken to search results related to the category any specific question is associated with


iSeek™iSeek™• By Leveraging iSeek, Certification Candidates can research trusted

sources based on words and conceptual relationships (versus popularity) and retrieve the specific training & learning resources to understand a subject thoroughly and re-enforce knowledge acquisition.

• Empowers Certification Candidates by harnessing the collective wisdom of Subject Matter Experts buried in disparate information sources and distributed locations and instantly provides the knowledge to decide

• iVIEWS organize results into dynamic categories that guide users to related results, information and ideas. Grouping results in categories such as Topics, Publications, People, Dates and Sources can lead users to ideas and information which may have been overlooked…..providing a dynamic learning experience!

• Searchblades are custom searchable repositories from any desired private and public sources that are available and deemed relevant.


Testing Services

Subject Matter Experts = Client Content Experts– What is important?

– How important is it?

– How is one subject related to another?

Testing Professionals = McCann Associates

(Psychometricians)– Accepted practices for Educational & Psychological Testing

• Validity

• Fairness

• Test Construction & Design

• Evaluation

• Documentation


Steps in Test Development1. Test Blueprint

– Knowledge/Recall, Comprehension, Application

2. Item Writing– Workshop for Subject Matter Experts

3. Item Review– Review for punctuation, Spelling, psychometric item formatting, fairness and

readability levels.

4. Pilot the items– Test function with representative test populations

5. Item Analysis– Statistically test item difficulty & fairness (gender, ethnic, etc.)

6. Assemble Operational Tests

7. Determine Cut Score– Establish passing grade through the Modified Angoff Method


Intellimetric™ Intellimetric™ Automated Essay Scoring

– Provides immediate feedback for extended or short answers

– Used as an instructional tool or for high stakes assessment

– Based on more than a decade of research and development

– First commercially used in 1998 for use in college course placement assessments

– IntelliMetric® infers rubric and learns the characteristics of the score scale from training set

– IntelliMetric® is inductive rather than rule based

– Performance data is reviewed (comparing human score and IM score for validation set)


View Reports – Testing Dashboard

• Administrators may create reports based on test, status and/or date range

• Flexible reporting by users, tests and items utilized

• Reports may be viewed online or exported as Excel, CSV or XML


iSEEK SuperCruncheriSEEK SuperCruncher• Unifies disparate data

• Single sign on integration

• Data receipt

• Interact with data / infinite data views

• Take action based on informed data driven decisions

• Scalable


Measured Success™ Measured Success™ Enterprise Application for

Testing, Assessment & Certification• Rich Functionality• Solid Framework & Design

– Students/Candidates, Groups/Members, – Questions/Items Banks, Tests/Assessments/Certifications, Scoring

• Feedback– 360° iSeek knowledge feedback from trusted/relevant resources

• Flexible Reporting– Interactive Displays, Comparative Reporting & Analysis– Industry Standard Exports to preferred applications

• Rapid Deployment Options– Independent SAAS web address/link,– Script from your web page, API for Scoring integration


With With Measured SuccessMeasured Success™™,, help Certification Candidates and Administrators help Certification Candidates and Administrators Complete a Successful Certification Program. Complete a Successful Certification Program.

It’s easy. It’s easy. It’s affordable.It’s affordable.

You can do it now. You can do it now.

For additional information, contact: For additional information, contact: Don MarshallDon Marshall267.756.1193267.756.1193

[email protected]@mccanntesting.com

Measured Success On Linked In

Documents

Transcript of Measured Success On Linked In