ASSESSING COMPETENCE IN ASSESSING COMPETENCE IN PROFESSIONAL PSYCHOLOGYPROFESSIONAL PSYCHOLOGY

LICENSING OF PSYCHOLOGISTS IN THE LICENSING OF PSYCHOLOGISTS IN THE UNITED STATES & CANADAUNITED STATES & CANADA

JAMES E. MADDUXJAMES E. MADDUX

DEPARTMENT OF PSYCHOLOGYDEPARTMENT OF PSYCHOLOGY

CENTER FOR THE ADVANCEMENT OF WELL-BEINGCENTER FOR THE ADVANCEMENT OF WELL-BEING

GEORGE MASON UNIVERSITYGEORGE MASON UNIVERSITY

JMADDUX@GMU.EDUJMADDUX@GMU.EDU

START WITH FUNDAMENTAL START WITH FUNDAMENTAL QUESTIONQUESTION

WHAT IS THE PURPOSE OF LICENSING OF WHAT IS THE PURPOSE OF LICENSING OF PROFESSIONALS OF ANY KIND?PROFESSIONALS OF ANY KIND?DOCTOR?DOCTOR?DENTIST?DENTIST?LAWYER?LAWYER?HAIRDRESSER?HAIRDRESSER?MASSEUSE?MASSEUSE?

Purpose of LicensurePurpose of Licensure

Protect the publicProtect the public BY LimitING practice to qualified PERSONS.BY LimitING practice to qualified PERSONS. BY ESTABLISHING STANDARDS OF PROFESSIONAL BY ESTABLISHING STANDARDS OF PROFESSIONAL CONDUCT.CONDUCT.

AND PUNISHING violatORS of standards of AND PUNISHING violatORS of standards of professional conductprofessional conduct

BUT. . WHAT IS A “QUALIFIED” INDIVIDUAL?BUT. . WHAT IS A “QUALIFIED” INDIVIDUAL? HOW DO YOU DETERMINE WHO IS “QUALIFIED?HOW DO YOU DETERMINE WHO IS “QUALIFIED?

WHAT “QUALFIED” PSYCHOLOGIST WHAT “QUALFIED” PSYCHOLOGIST MEANS IN THE USMEANS IN THE US

DOCTORAL DEGREE—PHD OR PSYD.DOCTORAL DEGREE—PHD OR PSYD. EDUCATION—SPECIFIC COURSWORK (APA ACCREDITED EDUCATION—SPECIFIC COURSWORK (APA ACCREDITED PROGRAM OR EQUIVALENT).PROGRAM OR EQUIVALENT).

SUPERVISION CLINICAL EXPERIENCE (PRE- AND SUPERVISION CLINICAL EXPERIENCE (PRE- AND POST-DOCTORAL—USUALLY 3000 HOURS)POST-DOCTORAL—USUALLY 3000 HOURS)

KNOWLEDGE OF PSYCHOLOGY REGULATIONS IN KNOWLEDGE OF PSYCHOLOGY REGULATIONS IN SPECIFIC STATE.SPECIFIC STATE.

PASSING SCORE ON THE EXAMINATION FOR THE PASSING SCORE ON THE EXAMINATION FOR THE PRACTICE OF PROFESSIONAL PSYCHOLOGY—EPPPPRACTICE OF PROFESSIONAL PSYCHOLOGY—EPPP

MAYBE PASSING AN ESSAY EXAM.MAYBE PASSING AN ESSAY EXAM. MAYBE PASSING AN ORAL EXAM.MAYBE PASSING AN ORAL EXAM.

WHAT DOES LICENSING REGULATE IN WHAT DOES LICENSING REGULATE IN THE U.S.?THE U.S.?

1.1. USE OF THE TERM “PSYCHOLOGIST”USE OF THE TERM “PSYCHOLOGIST”

1.1. CERTAIN “PSYCHOLOGICAL” CERTAIN “PSYCHOLOGICAL” ACTIVITIES AND SERVICES.ACTIVITIES AND SERVICES.

1.1. ACCEPTING DIRECT FEE FOR ACCEPTING DIRECT FEE FOR SERVICES. SERVICES.

BUT WHO ELSE CAN DO BUT WHO ELSE CAN DO PSYCHOTHERAPY?PSYCHOTHERAPY?

SOCIAL WORKERS—LICENESED WITH SOCIAL WORKERS—LICENESED WITH MASTER’S DEGREE.MASTER’S DEGREE.

MENTAL HEALTH COUNSELORS—LICENSED MENTAL HEALTH COUNSELORS—LICENSED WITH MASTER’S DEGREE.WITH MASTER’S DEGREE.

PSYCHIATRIC NURSES—LICENSED WITH PSYCHIATRIC NURSES—LICENSED WITH MASTER’S DEGREE.MASTER’S DEGREE.

IT HELPS TO UNDERSTAND THE US IT HELPS TO UNDERSTAND THE US CONSTITUTIONCONSTITUTION

LIMITS POWERS OF FEDERAL GOVERNMENT.LIMITS POWERS OF FEDERAL GOVERNMENT.

GIVES A LOT OF POWER TO STATES & PROVINCESGIVES A LOT OF POWER TO STATES & PROVINCES

PRO—50 + 10 LABORATORIES FOR INNVATIONPRO—50 + 10 LABORATORIES FOR INNVATION

CON—DIFFICULT TO DEVELOP CONSENSUS AND CON—DIFFICULT TO DEVELOP CONSENSUS AND CONSISTENCYCONSISTENCY

  

    

FOR THIS REASON . . .FOR THIS REASON . . .

A NATIONAL LICENSING LAW WAS A NATIONAL LICENSING LAW WAS NEVER REALLY A POSSIBILITYNEVER REALLY A POSSIBILITY

LEFT TO RESPONSIBILITY OF STATESLEFT TO RESPONSIBILITY OF STATES

AND PROFESSIONAL ORGANIZATIONSAND PROFESSIONAL ORGANIZATIONS

Historical DevelopmentHistorical Development

Rapid growth of the practice of Rapid growth of the practice of psychology after ww2psychology after ww2

Greatly expanded training Greatly expanded training opportunities, e.g., through funding opportunities, e.g., through funding from the us Veteran’s Administrationfrom the us Veteran’s Administration

Growing Growing concerns in us & canada concerns in us & canada regarding standards of professional regarding standards of professional practice of psychologypractice of psychology

Needed consistencyNeeded consistency National governments had no power to National governments had no power to act.act.

FROM ACCREDITATION TO LICENSUREFROM ACCREDITATION TO LICENSURE

EARLY 1940s—STATES BEGIN CONSIDERING EARLY 1940s—STATES BEGIN CONSIDERING CERTIFICATION OF PSYCHOLOGISTS AND REGULATION CERTIFICATION OF PSYCHOLOGISTS AND REGULATION OF PRACTICEOF PRACTICE

LOOKED TO APA ACCREDITATION GUIDELINES TO LOOKED TO APA ACCREDITATION GUIDELINES TO DEVELOP REQUIREMENTS FOR LICENSURE.DEVELOP REQUIREMENTS FOR LICENSURE.

1945—CONNECTICUT—FIRST STATE CERTIFICATION 1945—CONNECTICUT—FIRST STATE CERTIFICATION LAWLAW

1946—VIRGINIA—FIRST STATE TO REQUIRE A PHD1946—VIRGINIA—FIRST STATE TO REQUIRE A PHD

  

  

Entry to Independent Practice: Entry to Independent Practice: U.S & CanadaU.S & Canada

Most (49) states require a doctoral Most (49) states require a doctoral degree for licensure as a Psychologistdegree for licensure as a Psychologist

Canada & EU—master’s only is enougH.Canada & EU—master’s only is enougH. One (1) state (West Virginia) requires a One (1) state (West Virginia) requires a masters degree for licensure as a masters degree for licensure as a Psychologist Psychologist

Two (2) states also license at masters Two (2) states also license at masters level for independent practice, level for independent practice, different title:different title:

Oregon: Psychological Associate Oregon: Psychological Associate Vermont: Psychologist – MasterVermont: Psychologist – Master

1111

1967—APA GUIDELINES FOR 1967—APA GUIDELINES FOR LICENSURELICENSURE

MOST STATE LAWS BASED ON APA ACCREDITATION MOST STATE LAWS BASED ON APA ACCREDITATION GUIDELINESGUIDELINES

GOOD EXAMPLE OF COOPERATION BETWEEN GOOD EXAMPLE OF COOPERATION BETWEEN PROFESSIONAL ORGANIZATIONS AND GOVERNMENT.PROFESSIONAL ORGANIZATIONS AND GOVERNMENT.

1. REQUIRE DOCTORAL DEGREE FOR LICENSURE 1. REQUIRE DOCTORAL DEGREE FOR LICENSURE (FIRST SUGGESTED IN THE 1920s)(FIRST SUGGESTED IN THE 1920s)2. APA ETHICAL PRINCIPLES SHOULD BE 2. APA ETHICAL PRINCIPLES SHOULD BE WRITTEN INTO STATE LAWWRITTEN INTO STATE LAW3. EXEMPTIONS FOR PSYCHOLOGISTS IN3. EXEMPTIONS FOR PSYCHOLOGISTS IN INSTITUTIONAL & ACADEMIC SETTINGS.INSTITUTIONAL & ACADEMIC SETTINGS.

1940s & 1950s—GROWING NEED FOR 1940s & 1950s—GROWING NEED FOR CONSISTENCY IN LICENSE REQUIREMENTSCONSISTENCY IN LICENSE REQUIREMENTS

CONSISTENCY NEEDED ACROSS THE STATES AND CONSISTENCY NEEDED ACROSS THE STATES AND PROVINCES.PROVINCES.

U.S. & CANADA ARE MOBILE SOCIETIES.U.S. & CANADA ARE MOBILE SOCIETIES.

LIMITED POWERS OF THE FEDERAL GOVERNMENTS.LIMITED POWERS OF THE FEDERAL GOVERNMENTS.   NO NATIONAL LICENSING LAW IN U.S. OR CANADANO NATIONAL LICENSING LAW IN U.S. OR CANADA   BUT—A LOT OF VOLUNTARY COORDINATION AMONG THE BUT—A LOT OF VOLUNTARY COORDINATION AMONG THE STATE (US) AND PROVINCIAL (CANADA) PSYCHOLOGY STATE (US) AND PROVINCIAL (CANADA) PSYCHOLOGY LICENSING BOARDS.LICENSING BOARDS.

  

November 1959 meeting in Chicago November 1959 meeting in Chicago decideddecided

• Written exam needed to ensure adequate Written exam needed to ensure adequate knowledge for practiceknowledge for practice

• An organizational structure necessary to An organizational structure necessary to oversee development of an examoversee development of an exam

• The American Association of State The American Association of State Psychology Boards (AASPB) was formed, with Psychology Boards (AASPB) was formed, with 29 charter members29 charter members

• Held first meeting in 1961Held first meeting in 1961• later changed NAME to the Association of later changed NAME to the Association of State and Provincial Psychology Boards State and Provincial Psychology Boards (ASPPB) (ONTARIO JOINED)(ASPPB) (ONTARIO JOINED)

1961—ASSOCIATION OF STATE AND 1961—ASSOCIATION OF STATE AND PROVINCIAL PSYCHOLOGY BOARDS (ASPPB)PROVINCIAL PSYCHOLOGY BOARDS (ASPPB)

FORMED BY THE PSYCHOLOGY BOARDS OF A FORMED BY THE PSYCHOLOGY BOARDS OF A NUMBER OF US STATES AND ONTARIO. NUMBER OF US STATES AND ONTARIO.

GOAL—BRING SOME CONSISTENCY TO GOAL—BRING SOME CONSISTENCY TO LICENSING LAWS IN THE US AND CANADA.LICENSING LAWS IN THE US AND CANADA.

FORUM FOR SHARING IDEASFORUM FOR SHARING IDEAS

ASPPB MISSION STATEMENTASPPB MISSION STATEMENT

To enhance services and support its member To enhance services and support its member jurisdictions in fulfilling their goal of jurisdictions in fulfilling their goal of advancing public protection by:advancing public protection by:Offering examination & credentialing Offering examination & credentialing programs.programs.serving as the source for the current and serving as the source for the current and accurate information about the regulation of accurate information about the regulation of psychologists.psychologists.contributing to the critical consumer contributing to the critical consumer protection perspective in the on-going protection perspective in the on-going development of the profession.development of the profession.

FIRST TASK—STANDARDIZED TEST OFFIRST TASK—STANDARDIZED TEST OF BASIC KNOWLEDGE OF PSYCHOLOGY. BASIC KNOWLEDGE OF PSYCHOLOGY.

WHAT INFORMATION IS NECESSARY FOR THE WHAT INFORMATION IS NECESSARY FOR THE COMPETENT AND ETHICAL PRACTICE OF COMPETENT AND ETHICAL PRACTICE OF PSYCHOLOGY?.PSYCHOLOGY?.

EXAMINATION FOR THE PRACTICE OF EXAMINATION FOR THE PRACTICE OF PROFESSIONAL PSYCHOLOGY—EPPP.PROFESSIONAL PSYCHOLOGY—EPPP.

EXAMPLE OF INFLUENCE OF PSYCHOMETRIC EXAMPLE OF INFLUENCE OF PSYCHOMETRIC TRADITION.TRADITION.

GOALS: ESSENTIAL KNOWLEDGE, CONSISTENCY, GOALS: ESSENTIAL KNOWLEDGE, CONSISTENCY, OBJECTIVITY, FAIRNESS.OBJECTIVITY, FAIRNESS.

MULTIPLE-CHOICE EXAM: MULTIPLE-CHOICE EXAM: WHY? PROS? CONS?WHY? PROS? CONS?

Historical & Current DevelopmentsHistorical & Current Developments

• First form of EPPP administered IN 1965 to First form of EPPP administered IN 1965 to 27 candidates in eight states.27 candidates in eight states.

(B.F. SKINNER WROTE ITEMS FOR FIRST EXAM)(B.F. SKINNER WROTE ITEMS FOR FIRST EXAM)

• By 1978 4000 candidates were being tested By 1978 4000 candidates were being tested each yeareach year

• In 2012 5400 candidates were tested in 62 In 2012 5400 candidates were tested in 62 jurisdictions in U.S. & Canada.jurisdictions in U.S. & Canada.

Purposes of the EPPPPurposes of the EPPP Assist licensing boards in evaluating Assist licensing boards in evaluating candidates for licensurecandidates for licensure

Ensure that licensed psychologists have Ensure that licensed psychologists have acquired a broad, basic knowledge of acquired a broad, basic knowledge of psychology. psychology.

ENSURE SOME CONSISTENCY ACROSS JURISDICTIONS.ENSURE SOME CONSISTENCY ACROSS JURISDICTIONS.

Never intended as the only measure of Never intended as the only measure of readiness for practicereadiness for practice

EPPPEPPP USED IN ALL US STATES AND CANADIAN PROVINCES.USED IN ALL US STATES AND CANADIAN PROVINCES.

FRENCH VERSION IN QUEBEC & SPANISH VERSION IN FRENCH VERSION IN QUEBEC & SPANISH VERSION IN PUERTO RICOPUERTO RICO

MAINTAINED AND ADMINISTERED BY A PRIVATE, NOT-MAINTAINED AND ADMINISTERED BY A PRIVATE, NOT-FOR-PROFIT COMPANY.FOR-PROFIT COMPANY.

   REVIEWED AND REVISED AT VARIOUS STAGES OF REVIEWED AND REVISED AT VARIOUS STAGES OF DEVELOPMENT BY ASPPB EXAMINATION COMMITTEE, DEVELOPMENT BY ASPPB EXAMINATION COMMITTEE, WHICH MEETS TWICE YEARLY. WHICH MEETS TWICE YEARLY.

   CONSISTS OF TEN MEMBERS FROM THE US AND CANADA CONSISTS OF TEN MEMBERS FROM THE US AND CANADA REPRESENTING EXPERTISE ON THE VARIOUS DOMAINS REPRESENTING EXPERTISE ON THE VARIOUS DOMAINS REPRESENTED ON THE EXAM. REPRESENTED ON THE EXAM.

EPPPEPPP

175 MULTIPLE-CHOICE QUESTIONS.175 MULTIPLE-CHOICE QUESTIONS. CONTENT IS THE RESULT OF A PERIODIC SURVEY.CONTENT IS THE RESULT OF A PERIODIC SURVEY. THOUSANDS OF PRACTICING PSYCHOLOGISTSTHOUSANDS OF PRACTICING PSYCHOLOGISTS WHAT KNOWLEDGE DO THEY BELIEVE IS NECESSARY WHAT KNOWLEDGE DO THEY BELIEVE IS NECESSARY FOR COMPETENT PRACTICE?FOR COMPETENT PRACTICE?

GENERAL PSYCHOLOGY EXAM, NOT JUST CLINICALGENERAL PSYCHOLOGY EXAM, NOT JUST CLINICAL Computer administered at local sites Computer administered at local sites throughout calendar yearthroughout calendar year

Candidate must be approved by regulatory Candidate must be approved by regulatory board/college to take examboard/college to take exam

Fee = $500?Fee = $500?

EIGHT MAJOR DOMAINSEIGHT MAJOR DOMAINS

(CLOSELY MATCHING APA ACCREDITATION GUIDELINES)(CLOSELY MATCHING APA ACCREDITATION GUIDELINES)

1-BIOLOGICAL BASES OF BEHAVIOR (12%)1-BIOLOGICAL BASES OF BEHAVIOR (12%)

2-COGNITIVE-AFFECTIVE BASES (13%)2-COGNITIVE-AFFECTIVE BASES (13%)

3-SOCIAL & MULTICULTURAL BASES (12%)3-SOCIAL & MULTICULTURAL BASES (12%)

44 -DEVELOPMENTAL (12%)-DEVELOPMENTAL (12%)

55 -ASSESSMENT & DIAGNOSIS (14%)-ASSESSMENT & DIAGNOSIS (14%)

66 -TREATMENT & PREVENTION (14%)-TREATMENT & PREVENTION (14%)

77 -RESEARCH METHODS & STATISTICS -RESEARCH METHODS & STATISTICS (8%) (8%)

88 -ETHICAL & LEGAL ISSUES (15%)-ETHICAL & LEGAL ISSUES (15%)

Developing the EPPP - IIDeveloping the EPPP - II

ITEM-DEVELOPMENT COMMITTEEITEM-DEVELOPMENT COMMITTEETEAM OF ITEM WRITERS ALWAYS WRITING ITEMS.TEAM OF ITEM WRITERS ALWAYS WRITING ITEMS.Pro-exam assembles pretest items into Pro-exam assembles pretest items into domains.domains.Pro-exam assembles examination formsPro-exam assembles examination formsExamination Committee (ExC) reviews & Examination Committee (ExC) reviews & revises pre-test ITEMS.revises pre-test ITEMS.ExC reviews & revises examination formsExC reviews & revises examination formsExaminations administeredExaminations administeredPro-exam and ExC review pretest and test Pro-exam and ExC review pretest and test question statisticsquestion statistics

Central GuidelinesCentral Guidelines Item tests knowledge important for Item tests knowledge important for entry entry levellevel practice.practice.

Knowledge of the item content relevant to Knowledge of the item content relevant to protection of the publicprotection of the public• Would not knowing this information cause Would not knowing this information cause less competent practice that might result less competent practice that might result in harm to the public?in harm to the public?

items should be based on:items should be based on:• Current research orCurrent research or• Best practice, preferably with research Best practice, preferably with research basebase

The content of the test helps to define the The content of the test helps to define the field of professional psychologyfield of professional psychology

Research on the EPPPResearch on the EPPP

Numerous studies supporting reliability & Numerous studies supporting reliability & validity of EPPPvalidity of EPPP

Data suggest best to take EPPP within 3 years Data suggest best to take EPPP within 3 years of graduationof graduation

Correlation education and performance on Correlation education and performance on EPPPEPPP

Those with more or better education Those with more or better education perform better on the EPPPperform better on the EPPP

Those rated more highly by faculty and Those rated more highly by faculty and supervisors do better on the EPPPsupervisors do better on the EPPP

The correlations in scores between the The correlations in scores between the various areas (domains) are highvarious areas (domains) are high

CONTENT VALIDITY: PRACTICE CONTENT VALIDITY: PRACTICE ANALYSISANALYSIS

Practicing psychologists surveyed Practicing psychologists surveyed and focus groupsand focus groups

What do entry levelKNOWLEDGE DO What do entry levelKNOWLEDGE DO psychologists need to know?psychologists need to know?

What knowledge is important for What knowledge is important for protection of the public?protection of the public?

Most Recent Practice AnalysisMost Recent Practice Analysis 4 Task Force Meetings, April 2008, Nov. 2008, July 4 Task Force Meetings, April 2008, Nov. 2008, July

2009, and Nov. 2009.2009, and Nov. 2009. 2 rounds of independent 2 rounds of independent subject matter expertsubject matter expert

reviews (30 reviewers)reviews (30 reviewers) 2 focus panels to refine delineation (Aug.-Sept. 2008)2 focus panels to refine delineation (Aug.-Sept. 2008) Large-scale validation survey of 8,000 psychologistsLarge-scale validation survey of 8,000 psychologists 2 focus panels and additional interviews to explore 2 focus panels and additional interviews to explore

competency assessment competency assessment

FOOD FOR THOUGHT . . .FOOD FOR THOUGHT . . .

HOW IS THIS SIMILAR TO OR HOW IS THIS SIMILAR TO OR DIFFERENT FROM HOW COMPETENCE FOR DIFFERENT FROM HOW COMPETENCE FOR PROFESSIONAL PRACTICE IS DETERMINED PROFESSIONAL PRACTICE IS DETERMINED IN URUGUAY? IN URUGUAY?

PROS & CONS?PROS & CONS?

EPPP CONTROVERSIESEPPP CONTROVERSIES

IS A MULTIPLE-CHOICE EXAM A GOOD WAY IS A MULTIPLE-CHOICE EXAM A GOOD WAY TO DETERMINE COMPETENCE?TO DETERMINE COMPETENCE?

DOES THE CONTENT TRULY REFLECT WHAT A DOES THE CONTENT TRULY REFLECT WHAT A PRACTITIONER NEEDS TO KNOW?PRACTITIONER NEEDS TO KNOW?

NOT ENOUGH “CLINICAL” CONTENT.NOT ENOUGH “CLINICAL” CONTENT.

NOT SUFFICIENTLY BASED ON RESEARCH. NOT SUFFICIENTLY BASED ON RESEARCH.

FOOD FOR THOUGHTFOOD FOR THOUGHT

BIG QUESTION MISSING . . .BIG QUESTION MISSING . . .

•DOES THE EXAM PREDICT COMPETENCE DOES THE EXAM PREDICT COMPETENCE AS A PRACTITIONER?AS A PRACTITIONER?

•HOW WOULD YOU DO THIS?HOW WOULD YOU DO THIS?

•HOW WOULD YOU EVALUATE YOUR OWN HOW WOULD YOU EVALUATE YOUR OWN COMPETENCE? COMPETENCE?

STOP HERESTOP HERE