Certification Perspectives articles/Webinars/Maintaining... · CEdMA Special Interest Group...

Certification Perspectives

April, 2015

CEdMA Special Interest Group

• Sue Martin

– Global Senior Director of Certification at SAP

– Düsseldorf, Germany

• Joanne Coleman

– Director, Certification at NetSuite

– San Mateo, USA

2

Today’s Panel


• Maintaining Credentials

• Remote Proctoring

• CEdMA Europe Feedback

Today’s Topics

3


Maintaining Credentials | SAP

4



5



6


Maintaining Credentials | NetSuite…

7

www.netsuite.com/certification


• Challenges

– New program

– 2 releases a year

– Cloud model

– Small staff

Maintaining Credentials | NetSuite…

8


• Strategies

– Annual Quiz

• Open Book, online only

– Refresh exam every 3 years

• Lessons Learned

– More lead time to write questions

– 2014 Quiz after 2015.1 release seemed off

– Will have Quiz ready with .2 release

– Published what 2014 Quiz would have looked like

Maintaining Credentials | NetSuite

9


Remote Proctoring | SAP

10



11



12



13



14


Challenges, Strategies and Lessons Learned– Security – initial scepticism but dependent on proctoring rules

– Technology - challenging with multitude of environments, geographies

etc.

– Flexibility – very positive customer feedback on ROI of testing any time,

anywhere

– Alignment – improved alignment with virtual learning environment

– Change resistance – internal reservations as the last post of physical

connection with the customer is eroded


15


Onsite vs Online

Remote Proctoring | NetSuite…


- Limited evening/weekend hours

- Must travel to a location

- Less control over the setting

- Possible external noise—be prepared to use

earplugs

- Photo ID and confirmation code required

In-Person Examinations


+ More scheduling options, evenings, weekends

+ Easy to get to

+ You control your own environment (less stress?)

- Technical setup and software installation required ahead of

time

- Separate webcam required

- What is the physical environment like?

- No breaks during the exam

Online Examinations…


• When done online, the examination is proctored Webcam.

• The proctor must see keyboard, mouse and hands at all

times

– Built-in cameras –will discuss later

– Working microphone also required– the proctor must be

able to hear – no speaking permitted

– Desk must be visibly clear of clutter

– No break

– No leaning back out of view, no other people

Online Examinations


• Advanced Prep required of computer hardware/software

• Vendor provided guide:

o Photo submission and typing biometrics required for registration

and exam launch

o During the examination, the software takes control of computer,

disabling candidate from swapping to another application during

the examination

o This software enables the Proctor to see what is on test-taker

screen, a bit like Webex

Online Examinations continued


• Challenges

– Small program, WW availability

– Hardware

– Software

– Setting limits for behavior

– UI issues with registration onsite vs. online

– Adoption lower than desired


21


• Strategies

– Automatic Out-of-Office message directing

test-takers to vendor for tech issues

– Email templates to internals instructing them

on IT Support cases to install software prior to

exam

– Reviewing feedback of remote test-takers for

their experiences for clearer instructions

– Publish link to vendor manual on remote

proctoring


22


• Lessons Learned

– Consider using embedded laptop webcam

– More lenient with reschedules or vouchers

when candidates use remote proctored

Remote Proctoring | NetSuite

23


• Which role will certification play in the future ?• Transition from ILT to Virtual – Driving learning behaviors

• Renewals business dependent on up to date knowledge and skills in the ecosystem

• Transition from event-driven to continuous learning

• What else should we doing ?• Visibility, closer linkage to social media, digital credentialing etc.

• Crowd sourcing, virtual, collaborative creation approaches

• Testing skills vs. Knowledge

• How will it change?• Modular certification?

• Link to support/maintenance?

• Translations?

• Mobile devices?

• More integration between learning/testing?

• More skills than knowledge?

Feedback from CEdMA Europe Spring Conference

24

Certification Perspectives articles/Webinars/Maintaining... · CEdMA Special Interest Group...

Documents

Transcript of Certification Perspectives articles/Webinars/Maintaining... · CEdMA Special Interest Group...