Certification Perspectives
April, 2015
CEdMA Special Interest Group
• Sue Martin
– Global Senior Director of Certification at SAP
– Düsseldorf, Germany
• Joanne Coleman
– Director, Certification at NetSuite
– San Mateo, USA
2
Today’s Panel
CEdMA Special Interest Group
• Maintaining Credentials
• Remote Proctoring
• CEdMA Europe Feedback
Today’s Topics
3
CEdMA Special Interest Group
Maintaining Credentials | SAP
4
CEdMA Special Interest Group
Maintaining Credentials | SAP
5
CEdMA Special Interest Group
Maintaining Credentials | SAP
6
CEdMA Special Interest Group
Maintaining Credentials | NetSuite…
7
www.netsuite.com/certification
CEdMA Special Interest Group
• Challenges
– New program
– 2 releases a year
– Cloud model
– Small staff
Maintaining Credentials | NetSuite…
8
CEdMA Special Interest Group
• Strategies
– Annual Quiz
• Open Book, online only
– Refresh exam every 3 years
• Lessons Learned
– More lead time to write questions
– 2014 Quiz after 2015.1 release seemed off
– Will have Quiz ready with .2 release
– Published what 2014 Quiz would have looked like
Maintaining Credentials | NetSuite
9
CEdMA Special Interest Group
Remote Proctoring | SAP
10
CEdMA Special Interest Group
Remote Proctoring | SAP
11
CEdMA Special Interest Group
Remote Proctoring | SAP
12
CEdMA Special Interest Group
Remote Proctoring | SAP
13
CEdMA Special Interest Group
Remote Proctoring | SAP
14
CEdMA Special Interest Group
Challenges, Strategies and Lessons Learned– Security – initial scepticism but dependent on proctoring rules
– Technology - challenging with multitude of environments, geographies
etc.
– Flexibility – very positive customer feedback on ROI of testing any time,
anywhere
– Alignment – improved alignment with virtual learning environment
– Change resistance – internal reservations as the last post of physical
connection with the customer is eroded
Remote Proctoring | SAP
15
CEdMA Special Interest Group
Onsite vs Online
Remote Proctoring | NetSuite…
CEdMA Special Interest Group
- Limited evening/weekend hours
- Must travel to a location
- Less control over the setting
- Possible external noise—be prepared to use
earplugs
- Photo ID and confirmation code required
In-Person Examinations
CEdMA Special Interest Group
+ More scheduling options, evenings, weekends
+ Easy to get to
+ You control your own environment (less stress?)
- Technical setup and software installation required ahead of
time
- Separate webcam required
- What is the physical environment like?
- No breaks during the exam
Online Examinations…
CEdMA Special Interest Group
• When done online, the examination is proctored Webcam.
• The proctor must see keyboard, mouse and hands at all
times
– Built-in cameras –will discuss later
– Working microphone also required– the proctor must be
able to hear – no speaking permitted
– Desk must be visibly clear of clutter
– No break
– No leaning back out of view, no other people
Online Examinations
CEdMA Special Interest Group
• Advanced Prep required of computer hardware/software
• Vendor provided guide:
o Photo submission and typing biometrics required for registration
and exam launch
o During the examination, the software takes control of computer,
disabling candidate from swapping to another application during
the examination
o This software enables the Proctor to see what is on test-taker
screen, a bit like Webex
Online Examinations continued
CEdMA Special Interest Group
• Challenges
– Small program, WW availability
– Hardware
– Software
– Setting limits for behavior
– UI issues with registration onsite vs. online
– Adoption lower than desired
Remote Proctoring | NetSuite…
21
CEdMA Special Interest Group
• Strategies
– Automatic Out-of-Office message directing
test-takers to vendor for tech issues
– Email templates to internals instructing them
on IT Support cases to install software prior to
exam
– Reviewing feedback of remote test-takers for
their experiences for clearer instructions
– Publish link to vendor manual on remote
proctoring
Remote Proctoring | NetSuite…
22
CEdMA Special Interest Group
• Lessons Learned
– Consider using embedded laptop webcam
– More lenient with reschedules or vouchers
when candidates use remote proctored
Remote Proctoring | NetSuite
23
CEdMA Special Interest Group
• Which role will certification play in the future ?• Transition from ILT to Virtual – Driving learning behaviors
• Renewals business dependent on up to date knowledge and skills in the ecosystem
• Transition from event-driven to continuous learning
• What else should we doing ?• Visibility, closer linkage to social media, digital credentialing etc.
• Crowd sourcing, virtual, collaborative creation approaches
• Testing skills vs. Knowledge
• How will it change?• Modular certification?
• Link to support/maintenance?
• Translations?
• Mobile devices?
• More integration between learning/testing?
• More skills than knowledge?
Feedback from CEdMA Europe Spring Conference
24
Top Related