ICCP’s Proposal

Institute for Certification of Computing Professionals was founded 40 years ago by ACM, IEEE-CS, AITP (then DPMA), CIPS, and several smaller professional associations. It is governed by a board of the representatives from its member associations.

ACM’s reps are Don Gotterbarn and Joyce Little.www.iccp.org

CS2013 Assessment ExamsAvailable to Colleges

ICCP Professional Certifications

•Certified Computing Professional•Certified Data Management Professional•Certified Business Intelligence Professional•Certified IT Consultant•Certified IT Compliance Professional•Certified IT Governance Professional

ICCP Professional Certifications

•IS2010 Model Curriculum Assessment Exam

ABET Options for Assessment

18 KAs

159 KUs

18 KAs

159 KUs

18 KAs

159 KUs

18 KAs

159 KUs

3 Tiers

3 Depth Levels

1008 Learning Objectives

1008 Total Learning Objectives

236 Tier-1 Required

266 Tier-2 80% is sufficient

506 Electives Program’s option

1008 Total Learning Objectives How Measured

236 Tier-1 Required Standard core exam

266 Tier-2 80% is sufficient

Testlets incorporated

506 Electives Program’s option

No standard test planned

College Relates Courses to CS2013

How ICCP Delivers IS2010 Exams

How ICCP Plans to Deliver CS2013 Exams

Next Steps

1 Form cadre of volunteers for committee

2 As a committee, develop standards for tests and items

3 Recruit initial 17 item writers, begin building out pool

4 Recruit more item writers, as specific KU needs known

5 Find 3 alpha test groups, with known but distinct knowledge levels

Meeting Places

• Seattle

• Chicago

• Cleveland

• Syllabus for CIS 490 capstone course: http://www.calstatela.edu/faculty/areed2/F08.490caps.html

• Final exam is the standardized IS2010 assessment exam

• ISECON paper statistically validating the standardized IS2010 assessment exam– http://proc.isecon.org/2010/pdf/1373.pdf

Familiarity Depth

Usage Depth

Assessment Depth

Glossary

correlation statistical correlation between correctly answering an item and overall exam score

difficulty the item’s pass rate as a fractiondistractor one of an item’s incorrect responsesdistractor correlation

correlation between overall exam pass rate and answering that the given distractor is the correct response

exam testitem test questionKA Knowledge Area from CS2013KU Knowledge Unit from CS2013, associated with a single KALO Learning Objective from CS2013, associated with a single KUpass rate the fraction of examinees who correctly answered an itemperformance statistics

difficulty, correlation, and distractor correlations of an item

Glossary (continued)

quality An item is a quality item if it has performance statistics that show its correct response has a sufficiently high correlation with success on the exam, its incorrect responses have sufficiently negative correlation with success on the exam, and its level of difficulty is in the appropriate range.

score the number of items answered correctly on an examsparse A KU is sparse if not enough quality items exist to test all of its

Learning Objectives of the appropriate tier in the desired number of distinct forms. (If we want three forms, then the KU is sparse if there is any LO that is not tested by three distinct quality items.)

stem the part of an item that precedes the responsesstudent’s exam

a tier-1 form and collection of testlets such that all the tier-1 and tier-2 LOs in the KUs studied by the given student are tested

Glossary (continued)

tier-1 test tier-1 formtested A LO is tested by an item if knowing that the correct response is

true and that the distractors are false implies that the learning objective is met at the proper level of depth.

testlet a collection of quality items which together test all of the tier-2 LOs in one given KU

tier-1 form a collection of quality items which together test all of the tier-1 LOs in all KUs

tweak change the wording of an item’s stem, correct response, or distractor, with the objective of improving the item’s performance

Questions and Answers

• What is the college’s cost of assessment by examination? – $50 per student to a max of $2,500

• How many colleges are assessing so far with the IS exam?– 23 colleges and growing

• What must a student who passes the exam do to become ISA certified?– Present evidence of degree graduation within one year of

taking the exam– Sign code of ethics– Pay $250 certification fee– Enter recertification program and begin collecting PD hours

Item Performance Evaluation