The Multiple Mini-Interview

CAAHP 2012

Ellen Hughes

Denise MacIver

MMI Presentation Outline

• Multiple Mini Interviews (MMIs):– Why? What? Who? How?

• Interactive Sessions– Training– Rotations (35 minutes)– Debriefing

• MMIs by Distance – Can it work?• Q & A

Why? Benefits of the MMIThe MMI is an innovative, feasible, acceptable, and reliable

interview technique that is:

• Assess different non-cognitive attributes

• Reliable and valid

• Less biased/more defensible than traditional panel interview

• Designed to reflect the values of the profession

• Multiple first impressions

• Ability to interview a large number of applicants in less time

with less resources

MMI

• Non-cognitive qualities of an individual

• Formats: Discussion, Collaborative or Acting.

• Applicant reads a question ( 2min), enters a room, answers the question (5-10 min), leaves room and repeats at next station.

• 6 – 10 questions

MMIs: Multiple First Impressions

What? Assessing Non-Cognitive Abilities

The MMI assesses Non-Cognitive abilities such as:

• Teamwork

• Responsibility

•Ethical & moral judgment

•Communication skills

•Management skills

•Problem solving

•Self awareness

•Conflict resolution

•(Career Investigation)

MMIs: Who?Interviewers and Candidates

Station 1

Station 2

Station 3

Station 4

Station 5

Station6

Station 7

Station 8

Candidate

Collecting Room

IIIIIIII

A B C D

E F G H

Interviewers are trained shortly before the interview day.

On Interview Day:

Candidates are gathered in one room for orientation/training

Interviewers receive their packages, see questions for the 1st

time and are shown their rooms.

MMIs: How? Interviewers and Candidates

Station 1

Station 2

Station 3

Station 4

Station 5

Station6

Station 7

Station 8

IIIIIIII

Candidate’s First Scenario Question

2 minutes outside the room reading the question; 5 minutes in the room.

8 Station Circuit

A buzzer sounds at 2 minutes (reading question),

4 minutes & 30 seconds (wrap up),

then again at 5 minutes (leave room, move to next station)

A B C D E F G H

Rotation of Candidates

Station 1

Station 2

Station 3

Station 4

Station 5

Station6

Station 7

Station 8

IIIIIIII

A B C D E FG H

Candidates Next Scenario Questions

Candidates continue to rotate through the rooms (stations).

Candidates have 2 minutes to read the questions outside the room and 5 minutes to answer the questions in the rooms.

Interviewers do not move.

Candidates move.

A buzzer sounds at 2m, 4m30s, 5m each time

Example Rotation for 1 Interviewer (1 station)

Start Time

End Time Applicant – Question

8:30 8:37 1st Candidate

8:37 8:44 2nd Candidate

8:44 8:51 3rd Candidate

8:51 8:58 4th Candidate

8:58 9:05 5th Candidate

9:05 9:12 6th Candidate

9:12 9:19 7th Candidate

9:19 9:26 8th Candidate

9:26 9:33 Break

An example of what it will

look like for one

interviewer…

8 interviews/hr

• 48 interviews per 6 hr-

day

With 8 interviewers how

many interviews per day?

MMI

• Non-cognitive qualities (decision making, ethical judgment, inter-professional skills).

• “Discussion” Format – 1 interviewer to 1 candidate

• Candidate reads a question (1 min), enters a room, answers the question (4 min), leaves room and repeats at next station.

• 3 questions

CAAHP MMIs: 3-Station Circuit

CAAHP 2012 Simulated MMIs:3 Station Circuits – 5 minutes each

I I ITime A A A

3:15 – 3:20 1 2 3

3:20 – 3:25 3 1 2

3:25 – 3:30 2 3 1

5 minutes to Switch Roles

I I ITime B B B

3:15 – 3:20 1 2 3

3:20 – 3:25 3 1 2

3:25 – 3:30 2 3 1

I I ITime C C C

3:15 – 3:20 1 2 3

3:20 – 3:25 3 1 2

3:25 – 3:30 2 3 1

I I ITime D D D

3:15 – 3:20 1 2 3

3:20 – 3:25 3 1 2

3:25 – 3:30 2 3 1

Training: Role of the Candidate• Prior notice of MMI style of interview• Orientation/Training on Day of Interviews• Review your schedule• Move when the bell rings• You have 1 minute to read the question (bell will ring

after 1 minute)• You can make notes while you read the question• You have 4 minutes to answer the question (warning

bell will ring after 3m, 30 secs (wrap up), then at 4 minutes – time to move to next station)

Training: Role of the Interviewer• Confirm that the correct candidate enters the room –

they will give you a label with their name to put on your score sheet

• Confirm no conflict of interest

• Ask the candidate if they have read the question

• Ensure a fair but rigorous opportunity for the applicant to meet the criteria for the station

Role of the Interviewer…cont.

• Remain objective and do not provide feedback or in any way divulge an opinion of the performance of an applicant

• Do not read the question or clarify the question for the applicant – the question is posted for the candidate

• Provide a considered and justifiable score at the station using the entire scale of ratings for each group of candidates

Scoring• For the first couple of candidates, you may

wish to make notes and score them on a separate piece of paper. Once you get a feeling for the question, you can transfer the scores to the score sheets.

• You CAN change scores you’ve given candidates who have come and gone from your room.

Score Sheet

• Record only negative comments – keep it professional (forms are FOIP-able)

• Use the entire grading scale!• No half marks – only whole numbers• Use check mark to score (not x’s, lines, or

circles)

Interviewer Package

Items included:– Your Scenario question– A supporting document to assist you with the question– Score sheets

– Candidate Rotation Schedule– List of Candidates

– Pencil & eraser, notepaper

CAAHP 2012 Simulated MMIs:3 Station Circuits – 5 minutes each

I I ITime A A A

3:15 – 3:20 1 2 3

3:20 – 3:25 3 1 2

3:25 – 3:30 2 3 1

5 minutes to Switch Roles

I I ITime B B B

3:15 – 3:20 1 2 3

3:20 – 3:25 3 1 2

3:25 – 3:30 2 3 1

I I ITime C C C

3:15 – 3:20 1 2 3

3:20 – 3:25 3 1 2

3:25 – 3:30 2 3 1

I I ITime D D D

3:15 – 3:20 1 2 3

3:20 – 3:25 3 1 2

3:25 – 3:30 2 3 1

• Experiences as a Candidate?

• Experiences as an Interviewer?

• Other?

Debriefing

Validity of videoconferencing for entrance

interviews

(not yet published)

Dr Randy W. Dreger

Heather Gray, BSc, Chair-Diagnostic Laboratory & Medical Transcription

Joy Lutz, CLXT, Instructor-Combined Laboratory & X-Ray Technology.

Denise MacIver, M.Ed., Associate Dean-SHS

Ellen Hughes, M.Ed., Dean-SHS

Scott Paradis, CPT, Research Assistant-SHS

Technical Support

Troy Gregoire, School of Information Communications and Engineering

Background

• Interviewing applicants has been and remains an important part of the selection process.

• Typically done in a face to face environment

• Not always feasible

• New technology may ameliorate this issue

Validity of videoconferencing for entrance interviews

Problem

• ProFitHR a private company who specializes in the interview process were

looking to determine if their product the MMI could be performed via Skype

and produce valid results.

Validity of videoconferencing for entrance interviews

Research Design

• 23 NAIT students (no MMI experience)

• Cross over design

• 10 stations

Validity of videoconferencing for entrance interviews

Day 1 Day 2

Results

• F2F - 6.2 ±1.5.

• Skype - 6.1 ±1.8

• no significant difference between the scores

Validity of videoconferencing for entrance interviews

0

2

4

6

8

10

skype total/10 F-F total/10

Results

• Compared to the F2F condition the applicant ranking on Skype:

• 2 no change

• 12 did better

• 9 did worse

• suggesting no systematic difference

• A secondary question was to determine if there was a day to day or learning effect. The scores for day 1 were 5.9

out of 10 and day 2 was 5.8 out of 10, no significant difference

Validity of videoconferencing for entrance interviews

Results

• Seventy percent of the applicants preferred the F2F method while 17% preferred Skype and 13% liked either method

equally.

• The interviewers also preferred the F2F method (70%) with 30% choosing either.

• When asked about performing the MMI in the future 52% of applicants would prefer F2F, 13% Skype and 35% would use

either.

• Interviewers’ responses were 30% F2F, 10% Skype and 60% either.

Validity of videoconferencing for entrance interviews

Future Projects

• Replicate the study with a large and more diverse sample.

• Replicate this study in a “non-laboratory” setting.

Validity of videoconferencing for entrance interviews

Thank You! Questions?