2013 Annual Report - NBOME · 2014-05-02 · 2 Message from: Wayne R. Carlsen, DO, Board Chair and...

A Clear Vision Being RealizedNBOME 2011 | Annual Report

2013 Annual Report

2 Message from: Wayne R. Carlsen, DO, Board Chair and John R. Gimpel, DO, MEd, NBOME President/CEO

5 Tributes to Our Leadership

8 NBOME Board of Directors

10 Feature: Sharing Our Information through Research

14 COMLEX-USA Examination Series:

15 COMLEX-USA Cognitive Evaluation

16 COMLEX-USA Level 2-Performance Evaluation

18 Reports from the NBOME Departments:

18 Clinical Skills TestingJeanne M. Sandella, DO, Vice President

19 Cognitive TestingBruce Bates, DO, Senior Vice President

23 Continuous Professional Development and InnovationsDot Horber, PhD, Director

25 Client ServicesSandra Waters, MEM, Vice President for Collaborative Initiatives

26 AdministrationJoseph Flamini, MBA, FACHE, Vice President and COO

27 FinanceJoseph Cruitt, MBA, CPA, CGMA, Vice President and CFO

28 Human ResourcesMaya Johnson, MBA, SPHR, Director

29 Community Support

30 NBOME National Faculty

34 NBOME Committees

34 Board Committees

35 Operational Committees

36 Subcommittees and Task Forces

42 Item Writers and Case Author of the Year

43 NBOME Item Writers Listing

47 A Key to Colleges of Osteopathic Medicine

Contents

2 NATIONAL BOARD OF OSTEOPATHIC MEDICAL EXAMINERS | ANNUAL REPORT 2013

2013MESSAGE FROM NBOME BOARD CHAIR AND PRESIDENT/CEO

MESSAGE FROM NBOME BOARD CHAIR AND PRESIDENT/CEO

NBOME’s compelling mission of protecting the publicby providing the means to assess competencies forosteopathic medicine and related health careprofessions is grounded on a foundation of corevalues: patient safety, integrity, accountability,collaboration, and excellence. Of these, integritytook center stage in 2013, which we define as“doing the right thing, the right way.” The MerriamWebster dictionary equates integrity to“incorruptibility, soundness, and completeness . . .the quality or state of being complete or undivided.”By all meanings of the word, the staff and governanceof the NBOME choose it as one we live by.

The year 2013 brought significant advancementswith the work of our Blue Ribbon Panel (BRP) onEnhancing COMLEX-USA, helping to ensure that theosteopathic physician licensure examinationcontinues to remain at the cutting edge of relevancyin meeting the NBOME mission, the needs of thepublic, and the state medical licensing boards. Atthe same time, giving due consideration to otherimportant COMLEX-USA stakeholders and usesincluding candidates, colleges of osteopathicmedicine (COMs), and graduate medical education(GME) programs, also remained a key focus. TheBRP’s elite membership of those from COMs, GME,licensing boards, the profession, and leading expertsin assessment have come forth with newrecommendations for an enhanced COMLEX-USAthat continues to evolve. However, more substantive

changes targeted for 2018-2019 include a new anddistinctive competency-based, clinical presentation-oriented design and further harmonization withexisting assessment checkpoints and milestones inmedical education and training. The BRP will issue areport of this new structure and timing by thesummer of 2014. Their recommendations areconsistent with the consensus statement from the2012 Osteopathic Medical Regulatory Summit:patients are best served by seeking care fromosteopathic physicians who are qualified to practiceosteopathic medicine, including the credentialsearned by completing the COMLEX-USA examinationseries. The distinctive elements of osteopathicmedical practice are well recognized and at the verycore of the profession’s own integrity.

In 2013, the NBOME Department of CognitiveTesting added considerable depth and experience inpsychometrics as well as test developmentexpertise, adding to the capabilities necessary forquality and quality assurance as well as researchnecessary to meet the needs for COMLEX-USA.Concurrently, the department worked diligently onexpanding the COMAT program and the many otherimportant specialty board and specialty collegeexaminations developed and delivered incollaboration with key partner organizations inosteopathic medicine and related health careprofessions. For the COMAT examinations, almostuniversal engagement across the nation’s 30 COMs

“Persons of integrity do not just act consistently with theirendorsements, they stand for something: they stand up fortheir best judgment within a community of people trying to discover what in life is worth doing.”—Cheshire Calhoun, Journal of Philosophy

ANNUAL REPORT 2013 | NATIONAL BOARD OF OSTEOPATHIC MEDICAL EXAMINERS 3

on 41 clinical campuses has allowed for robust andmeaningful data for COMs and students, and forcontinued enhancements and delivery options forthe program. The COMAT-Emergency Medicinecommittee continued their work in 2013 and this newexamination is expected to be available in July 2015.

With all of our examinations, test integrityincludes security, data forensics, and rigorousprotocols as appropriate for the nature of theassessment. The completion of the leadership modelfor the transformation of our NBOME NationalFaculty (NF) in 2013, now with 32 department anddivision chairs and over 900 credentialed DOs andother professional members, was another importantmilestone. These leaders and subject matter expertshelp to assure that COMLEX-USA and other NBOME

assessments remain valid, reliable and defensible fortheir important purposes.

Integrity is at the heart of our management andfinancial stewardship as well in matters both internaland external to the organization. Minimal examinationfee increases have been implemented in recentyears, and at significantly lower rates than increasesthat occurred in relative areas such as tuition atCOMs. Internally, deployment of an anonymoushotline in 2013 provided NBOME staff an opportunityto report any suspected financial fraud and abuse,consistent with this focus on integrity. Additionally,hiring a full-time Director for Human Resourcesenhanced accountability as an organization, andunderscored efforts to engage our workforce.

The NBOME’s stellar clinical skills examination,

Wayne R. Carlsen, DOBoard Chair

John R. Gimpel, DO, MEdPresident and CEO


2013MESSAGE FROM NBOME BOARD CHAIR AND PRESIDENT/CEO

the COMLEX-USA Level 2-PE, continues to lead theway in research, integrity in clinical documentation(during the post encounter SOAP note), andtransition to computer keyboard entry for the SOAPnote (eSOAP) planned for a July 2014implementation. Peer-reviewed manuscripts as wellas abstracts and other presentations internationallycontinue to further the field of assessment inmedical education and training.

Over the past decade in particular, theosteopathic medical profession and our colleaguesacross the house of medicine worldwide have beenworking to enhance the continuous professionaldevelopment initiatives and continuous qualityimprovement activities for physicians, includinginitiatives in continuing medical education (CME),the American Osteopathic Association’s (AOA’s)osteopathic continuous certification (OCC), andmaintenance of licensure (MOL).

For NBOME, our Department of ContinuousProfessional Development and Innovations (CPDI)expanded in 2013 and released its first twoprototypes “Osteopathic Performance Assessmentand Improvement Modules” (OPAIM), achievingapproval status by the AOA-Bureau of OsteopathicSpecialists (AOA-BOS) for Osteopathic ContinuousCertification (OCC) Component 4. Severalosteopathic specialty boards, including the AmericanOsteopathic Board of Emergency Medicine (AOBEM),the American Osteopathic Board of InternalMedicine (AOBIM) and the American OsteopathicBoard of Pediatrics (AOBP) endorsed the OPAIMmodule to meet OCC requirements. In addition,NBOME’s collaboration with the University of North

Texas Health Sciences Center, Texas College ofOsteopathic Medicine and the Reynolds Foundationon modules for inter-professional care of elders andsafety, as well as being awarded official CMEsponsor’s designation for CME by the AOA’s Councilon CME, were significant highlights in this arena.

Throughout the year, discussions of aligning GMEaccreditation for AOA-accredited residency programswith ACGME-accredited residencies were indeedparamount for many NBOME stakeholders, and mostsignificantly the osteopathic medical students. With77% of residency program directors in ACGME-accredited programs, and 100% of those inAOA-accredited programs already utilizing COMLEX-USA performance in the resident selection process,the newly proposed single unified GME accreditationsystem promises to provide further clarity thatCOMLEX-USA is part of the “DO credential,” not justfor licensure in all 50 states and graduation at theCOMs, but for other secondary uses as well.Representatives from the ACGME and theOrganization of Program Director Associations(OPDA) from the “ACGME world,” as well as thosefrom the osteopathic GME community, are part ofthe NBOME National Faculty and Blue Ribbon Panelon Enhancing COMLEX-USA. These leaders haveassured the NBOME that COMLEX-USA remainshighly regarded; that eligibility criteria for GMEapplications, including the DO degree and COMLEX-USA, are not being modified as part of the newlyproposed single unified GME system and, that evenmore opportunities for sharing information aboutDOs and COMLEX-USA with all residency programdirectors nationwide will be availed.

Integrity. It is at NBOME’s core. It means standing for something. Itis why we are part of the equation that allows society to entrust theosteopathic medical profession and individual DOs with the privilegeof being someone’s physician. We take this responsibility seriously,and pledge to continue to work just as arduously to maintain thissacred trust. Thank you for your continued interest in the NBOME.

Sincerely,Wayne R. Carlsen, DO | Board ChairJohn R. Gimpel, DO, MEd | President and CEO

OUR LEADERSHIP


TRIBUTES TO OUR LEADERSHIP

It’s not often an organization has the privilege ofbeing steered by a such a distinguished and tirelessleader as Janice A. Knebl, DO, MBA, one of thenation’s leading medical educators in geriatrics.

Dr. Janice Knebl is a native of Philadelphia whomoved to Fort Worth in 1988 to become Chief,Division of Geriatrics at the University of NorthTexas-Health Sciences Center-Texas College ofOsteopathic Medicine (UNTHSC-TCOM). Currently,she is Professor of Internal Medicine and Geriatricsat TCOM and Principal Investigator for the ReynoldsGeriatric Education and Training in Texas (GET-IT)Program, which is designed to train medical studentsand physicians in the care of the geriatric population.

Dr. Knebl began her service to the NBOME as atest question item writer in the late 1980s, becominga COMLEX-USA Level 2-CE Test Review Committeeparticipant and Chair during the 1990s. She wasappointed to the NBOME Board of Directors in 1999,elected to the Executive Committee in 2003, andserved as Secretary/Treasurer from 2005 to 2009,

serving two terms in that role and establishing thequarterly meeting practices for the FinanceCommittee in place today. She was elected ViceChair of the Board in 2009, and was installed asChair in December 2011. Though she passed theBoard Chair gavel to Dr. Wayne Carlsen in December2013, Dr. Knebl remains Chair of the NBOME’s BlueRibbon Panel on Enhancing COMLEX-USA.

Dr. Knebl is the recipient of numerous awards andhonors including: Top Doc every year since 2004,Fort Worth Magazine; 2010 and 2011 UNTHealthTop 90% Club, Excellence in Patient Satisfaction;2011 and 2012 Texas Super Doctors, Texas MonthlyMagazine; and 2010 Outstanding Citizen for SeniorsAward, Senior Citizen Services of Greater TarrantCounty, Inc. She has and continues to enjoyparticipating in local, statewide, and nationalorganizations that promote health and quality of lifefor older adults. She has a passion for osteopathicmedical education and for positively influencing thefuture practice of American medicine. Her

Janice A. Knebl, DO, MBAExecutive Committee Member, Immediate Past Chair


2013OUR LEADERSHIP

exuberance for life and her devotion to herprofession are always evident making it a privilegeto work with Dr. Knebl. Dr. Knebl was honored at the2013 Annual Board Meeting for her outstandingleadership and tireless devotion to the organization.

Former NBOME Board Chair (2009-2011), John E.Thornburg, DO, PhD, was also honored at the2013 Annual Board Meeting for a history with theorganization that spans more than 25 years. Dr.Thornburg began as a test question item writer andserved as the first Coordinator of COMLEX-USA Level1. Subsequently, Dr. Thornburg served as Chair ofthe Product Committee, a member of the ClinicalSkills Testing Advisory Committee, and was electedto the Board of Directors and then to the ExecutiveCommittee. He was elected Vice Chair of theNBOME Board of Directors before assuming the roleof Chair in December 2009. Now completing histerm as Immediate Past Chair, Dr. Thornburg movesoff of the NBOME Board of Directors. However, in2014 he assumes the position of Chair of COMLEX-USA Level 1 and the Department of FoundationalBiomedical Sciences.

Dr. Thornburg began at Michigan State University

(MSU) in 1970 as a postdoctoral fellow in theDepartment of Pharmacology and Toxicology afterreceiving a PhD in Pharmacology and Toxicologyfrom Purdue University. He has been a facultymember at MSU’s College of Osteopathic Medicinesince 1977 and achieved Emeritus status in January2010. Dr. Thornburg has received numerousteaching awards and has published seven bookchapters and more than 35 papers. For hisoutstanding work with the NBOME, he was awardedthe American Osteopathic Association’s (AOA)highest honor, the Distinguished Service Certificate,in October 2012. The award recognizes leaders ofthe osteopathic medical profession who have madeoutstanding accomplishments and meritoriousservice in scientific, educational, or professionalaffairs. Dr. Thornburg says that involvement with theNBOME has been a highlight of his career. We at theNBOME say, the pleasure of working with Dr.Thornburg is all ours.

John W. Becher, DO, is Professor and Chairman ofthe Department of Emergency Medicine at thePhiladelphia College of Osteopathic Medicine(PCOM). He is also the Director of Osteopathic

John E. Thornburg, DO, PhDFormer NBOME Board Chair


Medical Education at the AtlantiCare RegionalMedical Center in Atlantic City, New Jersey. He is amember of the Board of Trustees of the AmericanOsteopathic Association and past treasurer andmember of the American Osteopathic Board ofEmergency Medicine.

Known by his former residents and studentssimply as “the chief,” Dr. Becher recently retiredfrom active emergency medicine practice and wasrecognized on the floor of the United StatesCongress by a former resident who also happens tobe Nevada Congressman Joseph Heck, DO, whoread a citation honoring Dr. Becher. Dr. Becher isconsidered the “grandfather of the specialty ofemergency medicine” in the osteopathic medicalprofession, serving as the pioneer helping to createthe specialty. He truly is a giant in the history of theNBOME and our profession.

Dr. John Becher first became involved with theNBOME more than twenty years ago as a testquestion item writer for COMLEX-USA. He haschaired several committees for the organization, andserved two terms as NBOME’s Secretary/Treasurer.

As Chair of the Clinical Skills Testing AdvisoryCommittee (CSTAC), Dr. Becher was instrumental indeveloping policy and procedures for COMLEX-USA

Level 2-Performance Evaluation. He was a pioneer inhis efforts to convert the American Board ofEmergency Medicine into a nationally administered,computer-based certifying examination. Workingwith the NBOME, he was able to develop andimplement the new emergency medicinecertification examination, and in 2009, introducedthe recertifying examination in that specialty in thesame format. Dr. Becher’s participation in thePhysician Alliance for Physician Competence (theprecursor to what is now known as the Coalition forPhysician Accountability) and as the NBOME’srepresentative to the Federation of State MedicalBoards Implementation Group on Maintenance ofLicensure is evidence of his passion for improvingmedical education and promoting physiciancompetence.

While Dr. Becher’s service as a member of theNBOME Board of Directors ended in 2013, hecurrently serves on the important Blue Ribbon Panelon Enhancing COMLEX-USA and as Chair of theCOMAT Emergency Medicine Committee. It wasannounced in late 2013 that Dr. Becher will be the2014 nominee for the position of AOA President-Elect, and we wish Dr. Becher all good things as heleads the AOA in the exciting years ahead.

John W. Becher, DOExecutive Committee Member

Wayne R. Carlsen, DOExecutive Committee Member, Board Chair

Athens, Ohio (Installed Dec. 2013)

Gary L. Slick, DO, MA Executive Committee Member, Vice Chair

Tulsa, Oklahoma (Installed Dec. 2013)

Dana C. Shaffer, DOExecutive Committee Member,

Secretary/Treasurer Pikeville, Kentucky (Installed Dec. 2013)

John W. Becher, DOExecutive Committee Member Newtown Square, Pennsylvania (Outgoing EC Dec. 2013)

Gary ClarkExecutive Committee Member Jefferson City, Missouri

(Appointed to EC Dec. 2013)

J. Michael Finley, DOExecutive Committee Member

Tustin, California (Appointed to EC Dec. 2013)

Janice A. Knebl, DO, MBAExecutive Committee Member,

Immediate Past Chair, Fort Worth, Texas (Outgoing Board Chair Dec. 2013)

Rich LaBaere, II, DO, MPHExecutive Committee Member

Ortonville, Michigan (Appointed to EC Dec. 2013)

John E. Thornburg, DO, PhDExecutive Committee Member

Okemos, Michigan (Outgoing EC Dec. 2013)

2013NBOME BOARD OF DIRECTORS


Peter B. Ajluni, DOBloomfield Hills, Michigan

(Appointed Dec. 2013)

William G. Anderson, DODetroit, Michigan

James M. Andriole, DOSarasota, Florida

Susan Belanger, PhD, RN

Silver Spring, Maryland

Ronald R. Burns, DOWinter Park, Florida

Millicent King Channell, DO, MAPhiladelphia, Pennsylvania

H. Timothy Dombrowski, DO, MPH

Stratford, New Jersey

Lori Kemper, DO, MS

Glendale, Arizona

Michael K. Murphy, DO

Charlotte, North Carolina

Geraldine T. O’Shea, DO

Jackson, California

Deborah Pierce, DO, MS

Fort Washington, Pennsylvania

Anita Showalter, DOYakima, Washington

Karen Snider, DOKirksville, Missouri

Roberta Wattleworth,DO, MHA, MPHDes Moines, Iowa



2013SHARING OUR INFORMATION THROUGH RESEARCH

The NBOME continues to conduct research onvarious topics in assessment, with a focus on thevalidity and reliability of COMLEX-USA, novelassessment formats for medical education andcontinuous professional development. Under theleadership of the departments’ directors, Dr. HaoSong, Dr. William Roberts, and Dr. Dot Horber, thestaff of NBOME meet monthly to discuss ongoingprojects and to brainstorm about collaborativeresearch initiatives. Together, the departments havebeen published in peer-reviewed journals such asthe Journal of the American Osteopathic Association(JAOA), Advances in Health Sciences Education, andApplied Psychological Measurement. They haverepresented the NBOME around the globe throughpresentations that disseminate innovative andsubstantive work in the field of assessment.Additionally, the Research Team continues tocollaborate with affiliate organizations such as theAmerican Osteopathic Association (AOA), theAmerican Association of Colleges of OsteopathicMedicine (AACOM), and the specialty college andspecialty board clients such as the AmericanOsteopathic Board of Emergency Medicine (AOBEM)on projects that provide ongoing validity evidencefor our assessment portfolio.

In November 2013, the NBOME exemplified its leadership in the field of research in assessment by convening a Research Advisory Forum.Representatives from the NBOME, the AACOM, the AOA, the National Board of Medical Examiners(NBME), the Education Commission for ForeignMedical Graduates (ECFMG), the AmericanAssociation of Medical Colleges (AAMC/MCAT), the American Board of Internal Medicine (ABIM),colleges of osteopathic medicine, and otherindependent researchers in assessment assembledat the NBOME Philadelphia office to discuss currentresearch regarding issues of timing in assessment,including construct issues, examination purpose,knowledge fluency and the concept of examinationspeededness. The group heard presentations fromthe NBOME, the NBME, the National Commission on Certification of Physician Assistants and others, and discussed future directions for research in these areas. This forum was an excellentopportunity for collaboration and sharing and theattendees were universally positive about theprogram, developed under the leadership of DonaldSefcik, DO, 2013 Chair.

The following is a summary of the researchdisseminated by the NBOME Research Team in 2013.

NBOME Organizational Research Summary for 2013BY JEANNE M. SANDELLA, DO | VICE PRESIDENT FOR CLINICAL SKILLS TESTING


JOURNALS/PUBLICATIONS

PUBLISHED› Gimpel JR. The privilege and responsibility of self-regulation for physicians: A “win-win” for thephysician community and our patients.Osteopathic Family Physician; 5(5): 191-194.

› Levy D, Dvorkin R, Schwartz A, Zimmerman S, Li F.How does the Osteopathic Emergency MedicineResident In-Service Examination correlate with theAmerican Osteopathic Board of EmergencyMedicine Part I board certifying examination?Western Journal Emergency Medicine. In press.

› Zhang X, Roberts WL. Investigation ofstandardized patient ratings of humanisticcompetence on a medical licensure examinationusing many-facet measurement andgeneralizability theory. Advances in HealthSciences Education 2013 Dec; 18(5): 929-44. Doi:10.1007/s10459-012-9433-5.

SUBMITTED› Becker BJ, Wu H. Accuracy of formulas forestimating variances and covariances of correlationcoefficients. Journal Research Synthesis Methods.2013. In review.

› Helstrom J, Langenau EE, Sandella JM, Mote B.Keyboard data entry: Use among osteopathicmedical students and residents. Journal of theAmerican Osteopathic Association. Accepted.

› Kalinowski KE, Natesan P, & Henson RK. Stratifieditem selection and exposure control in unidimensionaladaptive testing in the presence of two-dimensionaldata. Appl Psych Meas. 2013. Accepted.

› Li F, Gimpel J, Arenson E, Song H, Bates B, LudwinF. The relationship between COMLEX-USA scoresand performance on the American OsteopathicBoard of Emergency Medicine Part I CertifyingExamination. Journal of the American OsteopathicAssociation. Revision accepted for publication in2014.

› Li F, Kalinowski KE, Song H, Bates B. Investigatingrelationships within the ComprehensiveOsteopathic Medical Achievement Test (COMAT)subject examinations and COMLEX-USA Level 2-CEexamination. Journal of the American OsteopathicAssociation. Revision accepted for publication in2014.

› Sandella JM, Smith L, Gallagher LA, Langenau EE.

Patterns of misrepresentation of clinical findings onpatient notes during a clinical skills licensingexamination. Journal of the American OsteopathicAssociation. Accepted for publication in 2014.

› Sandella JM, Smith L, Dowling D. Consistency ofinter-rater scoring of student performances ofosteopathic manipulative treatment on theCOMLEX-USA Level 2-PE. Journal of the AmericanOsteopathic Association. 2013. In review.

CONFERENCE ORAL AND POSTER,WORKSHOP AND SYMPOSIAPRESENTATIONS

PRESENTED› Dugosh J, Song H, Ostrem W. Examiningdifferential functioning of geriatric medicinecertification exam items for international and USmedical graduates. Poster presented at the 2013Annual Meeting of the Association of AmericanMedical Colleges (AAMC).

› Goldstein L, Langenau E, Horber D. Web-basedperformance assessment and improvementmodule. Oral presentation at MedBiquitous AnnualConference. Baltimore, MD, April 2013.

› Kachur E, Altshuler L, Langenau E, Zabar S.Creativity in simulation-based education: Let’skeep the juices flowing! Workshop presented at2013 International Meeting on Simulation inHealthcare, Orlando, FL, January 2013.

› Kachur E, Langenau E, Horber D, Sandella J.Remote standardized patients (RSPs): Clinicalencounters and feedback via Skype. Posterpresented at the 2013 Annual Meeting of theAmerican Association of Medical Colleges (AAMC).

› Kachur E, Schroeder L, Langenau E, Altshuler L,Zabar S, Aeder L. Preparing standardized patientsto become standardized healthcare providers andconfederates. Workshop presented at 2013International Meeting on Simulation in Healthcare,Orlando, FL, January 2013.

› Korber K, Langenau E. CME on the Internet:Osteopathic approach to pain management usingSkype and remote standardized patients.Workshop presented at 19th Annual AOA Category1 CME Sponsor Conference, Scottsdale, AZ,January 2013.

› Langenau E, Horber D, Kachur E. Investigation ofweb-based formative assessment of communication

JAN. 2013 NBOME’s Dr. ErikLangenau and KenKorber, PA, MHPE, theNational Director ofEducation &Development for theAmerican College ofOsteopathic FamilyPhysicians, presentedtheir co-sponsored pilotproject to assess web-based communicationusing RemoteStandardized Patients(RSPs) and Skype.


2013SHARING OUR INFORMATION THROUGH RESEARCH

skills using Remote Standardized Patients (RSP).Oral presentation at Association of StandardizedPatient Educators. Atlanta, GA, June 2013.

› Langenau E, Kachur E, Horber D, Gimpel J,Sandella J. Skype as a tool to provide feedback toresident learners. Oral presentation at Associationfor Medical Education in Europe (AMEE), Prague,Czech Republic, August 2013.

› Langenau E, Kachur E, Horber D, Goldstein L.Instruction and assessment of doctor-patientcommunication skills: A novel web-based approach.Oral presentation at MedBiquitous AnnualConference 2013. Baltimore, MD, April 2013.

› Langenau E, Kachur E, Horber D. Using Skype andremote standardized patients (RSPs) for teachingand assessing communication skills. Workshoppresentation at Association of Standardized PatientEducators. Atlanta, GA, June 2013.

› Langenau E, Turner M. Continuous professionaldevelopment in patient safety. Oral presentation at23rd Osteopathic Medical Education LeadershipConference, Scottsdale, AZ, January 2013.

› Langenau E. Web-based instruction andassessment of doctor-patient communication skills,cooperative experience. Oral presentation at DrexelUniversity Learning Technologies Advisory BoardSemi-annual Meeting. Philadelphia, PA, May 2013.

› Li F, Robert B. Measuring medical students'academic growth by growth percentiles: Twoapplications at aggregated level. Paper presentedat the 2013 Annual Meeting of AmericanEducational Research Association, San Francisco,CA, April 2013.

› Li F, Song H, Gimpel J, Ludwin F. The relationshipbetween COMLEX-USA scores and performance onthe American Osteopathic Board of EmergencyMedicine Part I Certifying. Poster presented at the2013 Annual Meeting of the Association ofAmerican Medical Colleges (AAMC).

› Montrey D, Sandella JM. Harder, better, faster,stronger – How to train good SPs in half the time.Presentation at the Association of StandardizedPatient Educators Meeting, Atlanta, GA, June 2013.

› Papa F, Kalinowski KE, & Smith M. Comparison of asystem 1 versus system 2 approach to diagnostictraining. Paper presented at the annual meeting ofthe Association for Medical Education in Europe(AMEE), August 2013, Prague, Czech Republic.

› Roberts WL, Zairul Nor Deana Md D. Multivariate

repeated ratings of aspects in humanism on aclinical skill medical licensure examination.Presented at the American Educational ResearchMeeting, San Francisco, CA, April 2013.

› Sandella JM, Roberts WL, Langenau EE.Assessment of doctor-patient communication,interpersonal skills and professionalism amongtrainees in postgraduate medical education. Posterpresentation at the International Meeting onSimulation in Healthcare, Orlando, FL, January2013.

› Song H, Hess B, Lipner R. Reporting subcontentscores on a medical certification examination.Paper presented at the 2013 Annual Meeting ofAmerican Educational Research Association, SanFrancisco, CA, April 2013.

› Wu H & Almond R. Comparing the generaldiagnostic model (GDM) and bayesian networksusing a simulated diagnostic test. Paper presentedat the 2013 Annual Meeting of the AmericanEducational Research Association, San Francisco, CA.

› Wu H, Liang X, Yurekli H, Becker BJ, Paek I, BiniciS, Kim S. An application of the DINA model to alarge scale assessment. Paper presented at the2013 Annual Meeting of the American EducationalResearch Association, San Francisco, CA, April 2013.

ACCEPTED› Chen H, Li F, Song H. Investigation on theperformance of different test speedednessdetection methods. Accepted for presentation atthe 2014 Annual Meeting National Council onMeasurement in Education, Philadelphia, PA.

› Gallagher LA, Sandella JM, Wilson CD. Put downyour pens! eSOAP has arrived: Electronic dataentry for documentation of post-encounter notes inclinical skills assessment. Accepted for presentationat the 2014 AACOM meeting, Washington DC.

› Kalinowski KE, Song H, Lukasik M. Differential itemfunctioning in the COMAT series of subjectexaminations. Accepted for presentation at the2014 AACOM Meeting, Washington, DC.

› Langenau E, Kachur E, Horber D, Ruggiero J,Montrey D, Sandella J. How to organize remotestandardized patient (RSP) encounters usingSkype. Workshop accepted for presentation at the2014 Annual Meeting of the Society for Simulationin Health Care.

› Natesan P, Kalinowski KE. Item selection and

FEB. 2013 NBOME launches newwebsite to become acritical vehicle ofcommunication to itsstakeholders.


exposure control in unidimensional calibration ofmultidimensionality. Paper accepted forpresentation at the 2014 Annual Meeting of theNational Council on Measurement in Education(NCME), Philadelphia, PA.

› Sandella JM, Roberts WL. Longitudinal evaluationof doctor-patient communication, interpersonalskills and professionalism among osteopathicmedical trainees. Accepted for presentation at the2014 Ottawa International Meeting on ClinicalCompetence, Ottawa ON, Canada.

› Sandella JM, Smith LA. Build a better checklist:Comparing expert consensus checklist developmentwith evidence based checklist creation forperformance assessment activities. Accepted forpresentation at the International Meeting onSimulation in Healthcare, January 2014.

› Smith L, Roberts WL. Test-taking strategy as athreat to validity in performance assessments withchecklist components. Paper accepted forpresentation at the 2014 Annual Meeting of theAmerican Educational Research Association,Philadelphia, PA.

› Turner M, Song H, Horber D. What we are lookingfor in selection of item bank system vendor: Onemedical licensure board’s perspective. Paperaccepted for presentation at the 2014 Innovations

in Testing Meeting of Association of Test Publishers.› Wu H, Arenson E, Song H. Potential impact of itemparameter drift on ability estimation. Paperapproved for presentation at the 2014 AnnualMeeting, National Council on Measurement inEducation, Philadelphia, PA.

› Wu H, Almond R. A comparison of generaldiagnostic models and bayesian networks. Paperaccepted for presentation at the 2014 AnnualMeeting of the National Council on Measurementin Education, Philadelphia, PA.

SUBMITTED› Chuck K, Song H, Waters L. Validity and testtiming: A new index to determine speededness.Submitted to 2014 Innovations in Testing Meetingof the Association of Test Publishers.

› Horber D, Langenau E, Kachur E. Teaching andassessing doctor-patient communication usingremote standardized patients and Skype:Feedback from medical residents. Submitted to the2014 Annual Meeting of the American EducationalResearch Association, Philadelphia, PA.

› Kachur E, Langenau E. Overcoming geographicbarriers in performance-based assessment:Remote standardized patients (RSPs). Submittedto the 2014 Ottawa Conference.

MAR. 2013 NOVA SoutheasternCollege of OsteopathicMedicine (COM), WilliamCarey University-COM,and Touro UniversityNevada COM join 22main campusosteopathic colleges inadding NBOME’s COMATexaminations to theireducational programsfor end-of-clerkship/clinical rotation studentassessment. The COMAT program nowengages all of theosteopathic medicalschools except two.


2013COMLEX-USA EXAMINATION SERIES

COMLEX-USA is the NBOME’s examination series thatprovides the pathway to licensure for osteopathicphysicians in the United States. It is also recognized inmany international jurisdictions. The development andadministration of the COMLEX-USA series requires theexpertise, hard work, intellect and dedication of themany NBOME staff members, as well as our highlyqualified and committed National Faculty, whichincludes committee members, item writers, case authors, raters, etc.

The COMLEX-USA examination seriesencompasses both cognitive testing and clinical skillstesting. Cognitive testing is delivered via computer

by the NBOME’s testing partner, Prometric, athundreds of testing sites around the United Statesand in Canada. Clinical skills testing is conducted atthe NBOME’s National Center for Clinical SkillsTesting in Philadelphia. Post-examination surveys ofcandidates indicate high degrees of satisfaction withthe COMLEX-USA series, particularly with respect toexamination administration. The NBOME regularlyassesses candidate feedback as a means to improveall aspects of the COMLEX-USA series.

This section of the annual report summarizes thekey data and developments related to the COMLEX-USA series in 2013.

PATHWAY TO LICENSURE

› COMLEX-USA Level 1

› COMLEX-USA Level 2-Cognitive Evaluation

› COMLEX-USA Level 2-Performance Evaluation

› COMLEX-USA Level 3

The COMLEX-USA examination series is designed to assess the osteopathic medicalknowledge and clinical skills considered essential for osteopathic generalist physicians topractice osteopathic medicine without supervision.

THE COMPREHENSIVE OSTEOPATHIC MEDICAL LICENSURE EXAMINATION OF THE UNITED STATES – COMLEX-USA


The chart below represents candidate performance on the COMLEX-USA cognitive examinations. These areCOMLEX-USA Level 1, Level 2-Cognitive Evaluation (CE) and Level 3. The information presented representscomplete testing cycles, which run mid-year to mid-year.

COMLEX-USA Cognitive Examinations

YEAR

2010-2011

2011-2012

2012-2013

N1st Exam/Total Exams

4611/5428

4853/5429

5056/5722

87.6%

91.8%

90.6%

83.7%

89.4%

87.1%

PASSING RATE 1st Exam

PASSING RATETotal Exams

1LEVEL 12010-2011

2011-2012

2012-2013

4195/5134

4569/5465

4866/5617

86.5%

86.8%

89.4%

82.1%

82.9%

86.7%2LEVEL 2-CE

2010-2011

2011-2012

2012-2013

3660/4136

4357/4741

4118/4426

91.4%

95.0%

95.1%

88.4%

92.8%

93.6%3LEVEL 3

CANDIDATE PERFORMANCE ON COMPUTER-DELIVERED COMLEX-USA COGNITIVE EXAMINATIONS


2013COMLEX-USA EXAMINATION SERIES

COMLEX-USA Level 2-Performance EvaluationTHE DATA SHOWN BELOW INCLUDES HISTORICAL INFORMATION AS A MEANS TOILLUSTRATE TRENDS.

NUMBER OF CANDIDATES TESTED ACROSS TESTING CYCLES 2010-2013

TEST

ING CYCLE

NUMBER TESTED

COMLEX-USA LEVEL 2-PERFORMANCE EVALUATION

500 1000 1500 2000 2500 3000 3500 4000 4500 5000 55000

n 2010-11 n 2011-12 n 2012-13

5004

5412

4757

The total number of candidates who took theCOMLEX-USA Level 2-Performance Evaluation (PE)for each of the three testing cycles from 2010-2013is shown in the chart below. This cohort includesboth first-time takers and repeat takers.

The number of COMLEX-USA Level 2-PEexaminations administered in the most recent cycle –5,412 – is the largest number in a cycle since theinception of the National Center for Clinical SkillsTesting in 2004. It represents a 7.6% (408) increaseover the previous year.

The COMLEX-USA Level 2-PerformanceEvaluation consists of two domains: humanistic(physician-patient communication, interpersonalskills, and professionalism) and biomedical/biomechanical (osteopathic principles and osteopathicmanipulative treatment, history-taking and physicalexamination skills, integrated differential diagnosisand clinical problem-solving, written communicationand synthesis of clinical findings).

Consistent with many other national high-stakes

examinations for physician licensure worldwide, the NBOME follows industry-standard best practicesin determining pass/fail standards for its COMLEX-USA examinations, and for periodic resetting of thestandards. Periodic review and resetting of thepass/fail standards for COMLEX-USA examinationsensures the standards of osteopathic medicallicensure assessment reflect current medical educationand medical practice.

In the first quarter of 2013, two panels ofosteopathic physicians and other subject matterexperts convened at the NBOME’s National Centerfor Clinical Skills Testing in Philadelphia to review thestandards for the Biomedical/BiomechanicalDomains of the examination. The NBOME Boardreviewed their recommendations along with otherstakeholder survey data and implemented a newpass/fail standard for this domain in July 2013.

The table on the right shows the pass/fail ratefor first-time takers by testing cycle, with additionaldata on each of the domains.

APR. 2013 The NBOME launchestwo interactive andformative OsteopathicPerformance andImprovement Modules(OPAIMs) – MedicationSafety Communicationand OMT for Lower BackPain during Pregnancy.The AOA-Bureau ofOsteopathic Specialists(AOA-BOS) approves theNBOME OPAIM forcomponent 4requirements of theAOA’s osteopathiccontinuous certification(OCC) program.


PASS/FAIL RATE FOR FIRST-TIME TAKERS BY TESTING CYCLE

COMLEX-USA LEVEL 2-PERFORMANCE EVALUATION

N %A %B

2010-2011

2011-2012

2012-2013

PASS

FAIL

Humanistic Domain

Biomedical Domain

Both Domains

GRAND TOTAL

4385

179

105

59

15

4564

58.7

33.0

8.4

96.1

3.9

2.3

1.3

0.3

PASS

FAIL

Humanistic Domain

Biomedical Domain

Both Domains

GRAND TOTAL

4513

236

156

60

20

4749

66.1

25.4

8.5

95.0

5.0

3.3

1.3

0.4

PASS

FAIL

Humanistic Domain

Biomedical Domain

Both Domains

GRAND TOTAL

4827

300

200

85

15

5127

66.7

28.3

5.0

94.1

5.9

3.9

1.7

0.3

A Total fail rate is the base for calculating percentages. B Total tested is the base for calculating percentages.


2013REPORTS FROM THE NBOME DEPARTMENTS

DEPARTMENT OF

CLI NICAL SKILLS TESTINGBY JEANNE M. SANDELLA, DO | VICE PRESIDENT FOR CLINICAL SKILLS TESTING

The Department of Clinical Skills Testingencompasses the COMLEX-USA Level 2-PerformanceEvaluation (PE) examination development,registration, administration, scoring, and researchinitiatives, as well as management of the NationalCenter for Clinical Skills Testing (NCCST) in thegreater Philadelphia area.

The department continues to demonstrateexcellence in the administration of an assessment of osteopathic clinical skills that is valid, reliable and fair.

COMLEX-USA LEVEL 2-PEADMINISTRATIONSIn the 2012-2013 testing cycle, the NBOME tested5,412 candidates at the NCCST. This represents a7.6% increase from the previous test cycle. Startingin July 2013, initial test appointments for theexamination were opened on a rolling basis oneyear from the examination date on the first Mondayof each month. Additional test sessions are provided throughout the year to accommodatecandidate demand.

NBOME’S ENGAGED WORKFORCEWe involve many members of the National Facultyas physician examiners for both SOAP notes andOsteopathic Manipulative Treatment (OMT). Inaddition, committees including the Case DevelopmentWorkshop and Committee, Clinical Skills TestingAdvisory Committee, the Subcommittee for SOAPNote Misrepresentation, and Standard Setting panelsprovide leadership and guidance for the examination.

The staff at the NCCST provides assessmentservices to candidates every month of the year.From scheduling assistance to travel recommendationsto examination day support to scoring concerns, theNCCST staff maintains professional and fairstandards for candidates and school representatives.The addition of several professional staff in 2013-2014 will provide the resources necessary to

meet the demand for more examinationadministrations and continued research in clinicalskills assessment. Key system updates have includedthe integration of new customized software formanagement of the examination, as well as theacquisition of software and hardware necessary toimplement the transition to electronic computerkeyboard entry of the post-encounter SOAP notes,called eSOAP, planned for July 2014.

COLLABORATION AND INTERNATIONAL GROWTH AND DEVELOPMENTNCCST staff has collaborated with the AOA and theAACOM on the “Osteopathic GME Match Report2012” publication, and submitted a proposal to theNational Commission on Certification of PhysicianAssistants for a pilot examination for clinical skills ofPhysician Assistants. In addition, we are nowproviding additional administrative assistance for theAOBEM Oral Board (Part II) Examinations forcertification and recertification, and are beginningthe process of working on a psychometric review ofthis examination as well.

Staff from the NCCST were visible on a nationaland international level in 2013 at variousconferences including the International Meeting on Simulation in Healthcare, American Educational Research Association/National Council of Measurement and Education, the Association for Standardized Patient Educators, the Meeting of the Association of Medical Educators of Europe, the American Association of MedicalColleges, the American Association of Colleges of Osteopathic Medicine Meeting and the OMEDconference. Researchers at the NBOME continue to add to the body of evidence to support thevalidity, reliability and fairness of the COMLEX-USALevel 2-PE with 2013 publications andpresentations. A list of the research activities isprovided in this publication.

MAY 2013 NBOME addresses itsstrategic objective toincrease engagement inthe workforce bypublishing an enhancedemployee handbook tooutline policies,procedures and benefitsfor its growing staff.


DEPARTMENT OF

COGNITIVE TESTINGBY BRUCE BATES, DO | SENIOR VICE PRESIDENT FOR COGNITIVE TESTING

The Department of Cognitive Testing is charged withthe responsibility of developing and evaluatingeffective, valid and reliable assessment services toadvance osteopathic medical education, osteopathicprofessional development, and support licensingboards in protecting the public.

This responsibility is met through a dedicatedstaff, a cadre of highly qualified, credentialednational faculty serving as subject matter experts,and collaborative relationships with testing centervendors working together to deliver high qualityassessment products. The department conductsmore than 35 National Faculty meetings each yearto create, assess and review cognitive assessmentproducts across the spectrum of professionaldevelopment. Additionally, the department conductsand publishes research to validate the assessments,provide continuous quality improvement, anddevelop valid and reliable novel test formats.

In 2013, the department developed andadministered approximately 49,000 examinationsacross more than 150 administration datescomprised of: COMLEX-USA Level 1, Level 2-Cognitive Evaluation (CE) and Level 3 for thepurpose of initial osteopathic medical licensure;COMSAE for self-assessment by osteopathic medicalstudents and colleges of osteopathic medicine(COMs); COMAT subject exams used principally asend-of-clinical rotation/clerkship achievementexaminations for COMs; COMVEX for variablepurposes related to previously licensed physician’sre-entry to practice; client examination development,review and psychometric analysis for eight specialtyboards, specialty colleges and related clients.

REORGANIZATIONThe department instituted a reorganization of its staffinto product-related teams. This matrix approach isintended to produce greater cross-functionality andproductive and efficient use of skills and knowledge,leading to enhanced customer service for our many

stakeholders. The department welcomed several newemployees in 2013, adding considerable assessmentexpertise and experience: Mark Dawley, MBA, Sr.Managing Director; Marc Lukasik, PhD, Senior TestDevelopment Specialist; Mary Browne, MA, Directorof Test Development; Kevin Kalinowski, PhD,Psychometrician; Eric Przybylski, Test PublishingSpecialist; and, Haiyan Wu, PhD, Research Associate.

ITEM BANK SOFTWARE REPOSITORY DEVELOPMENTWhile reorganization and the addition of talentedexpertise were important accomplishments, theselection of a new item bank repository system wasa critical next step for the Department of CognitiveTesting. Initiated in 2012, the effort accelerated in2013 under the direction of Melissa Turner, MS,Senior Director, Quality and Examination Integrity,and Sandra Waters, MEM, Vice President forCollaborative Initiatives, with a competitive Requestfor Proposal (RFP) process and the selection of thenew item bank repository vendor. The new itembank will allow for more efficient and accurate itemselection, coding and test form creation. It willfacilitate test item writing, statistical information,and, importantly, examination integrity and security.

TEST ADMINISTRATION VENDOR:REQUEST FOR PROPOSALThe high-stakes NBOME cognitive examinations,including COMLEX-USA, have been administeredsince 2005 at secure Prometric Testing Centersnationwide. Overall, examinee and other stakeholdersatisfaction with the NBOME and the Prometricpartnership for delivery of these examinations hasbeen good. Quality metrics have continued to befollowed and analyzed. With the current contract upfor renewal and as a standard part of good businesspractice, the organization issued a RFP to nationaltesting delivery companies interested in providingsecure computer-based testing administration

JUN. 2013 NBOME in partnershipwith the University ofNorth Texas HealthSciences Center-TexasCollege of OsteopathicMedicine (UNTHSC-TCOM) is awarded afive-year grant from theDonald W. ReynoldsFoundation’s Aging andQuality of Life programfor the development of e-learning-based,geriatric-focused,InterprofessionalCommunicationImprovement Modules(ICIMs).

services to NBOME. A complex formal processresulted in the consideration of alternate vendors. Arecommendation will be made to the NBOME Boardof Directors in early in 2014.

STANDARD SETTINGIn keeping with the best practices in professionalassessment, the NBOME reviews the standard forpassing the COMLEX-USA examinations on a regularbasis. It is used to define a “cut-score” that servesto classify examinees into those who meet orexceed the cut from those who do not. Periodicreview and resetting of the pass/fail standards forCOMLEX-USA examinations ensures the standards of osteopathic medical licensure assessment reflectcurrent medical education and medical practice. This is central to the mission of the NBOME toprotect the public. In 2013, the NBOME saw theplanning and recruitment of qualified andrepresentative panelists who will be engaged inStandard Setting meetings in 2014 for COMLEX-USALevel 1, Level 2-CE and Level 3.

COMLEX-USAThe COMLEX-USA licensure series remains thefoundation of NBOME’s mission to protect the public.The department continues to work to advance and

enhance the series by adding new test item formats,new technology, and “authenticity” with updatedexhibits and item enhancements (e.g., video clips,audio components) to the assessment. In 2013,16,500 Level 1, Level 2-CE and Level 3 examinationswere administered, which represents a 17%increase over the previous year. An expanded andcredentialed National Faculty serves to create,review and validate the performance of items.

Internal and published research remained a focusfor the department. Validation and reliability studiescontinue to show COMLEX-USA to meet standardsexpected for such a high-stakes examination withreliability in the various level exams of .85 -.92, andfirst-time taker pass rates of 89% to 95%.

COMSAE PROGRAMAn option for a three-phase self-assessmentproduct, COMSAE continues to experience growingacceptance by COMs and students since itsinception in 2008. Each phase corresponds to aCOMLEX-USA Level. Phases 1 and 2 have multipleforms of their respective exam. Almost 10,000students took one or more of the Phase 1examinations. It is noteworthy that the previouslyobserved moderate correlation of COMSAE withCOMLEX-USA performance continues to be seen

INCREASE IN NUMBER OF CANDIDATES TAKING THE COMSAE – 2011 TO 2013



12000

PHASE 1 PHASE 2 PHASE 3

n 2011n 2012n 2013

10000

8000

6000

4000

2000

0

4147

6980

9654

3316

47735481

361996 843


when the examination is taken in a timed andproctored setting.

COMAT EXAMINATION PROGRAMInitiated in 2008, these end-of-clinicalrotation/clerkship examinations in seven disciplinescontinue to show expanding use and importanceacross the COMs. In the first half of the 2013 testingcycle there was an additional 29% growth amongtotal osteopathic medical students taking COMATexaminations. The COMAT test teams continueefforts to standardize the blueprint formattingacross the disciplines. Electronic score reporting hasimproved communications with COMs. Under thedirection of John Becher, DO, and in response tointerests expressed in previous COM surveys, anEmergency Medicine COMAT exam is indevelopment with a target implementation date forJuly 2015. The most recent annual COM survey forCOMAT reveals continued high satisfaction for COMsand students. The most recent survey explored newdiscipline exams and the optional use of securetesting centers and iPad technology for COMATexaminations.

CLIENT EXAMINATION SERVICESThe department provides test development and

psychometric services to eight clients involving 10separate examinations:

› Six resident in-service examinations, in partnershipwith specialty colleges

› Two board certification examinations, inpartnership with specialty boards

› Two board recertification examinations, inpartnership with specialty boards.

The department is assisting clients in a variety ofways including independent consultation, blueprintdevelopment, item writing workshops, testpublishing, web-based or secure test center-basedadministration, the transition to computer-basedexaminations, and psychometric reviews ofcandidate performance, testing difficulty,discrimination, validity and reliability.

In 2013, the American Academy of PediatricDentistry (AAPD) successfully transitioned itsresident in-training examination to web-basedadministration with the NBOME. Also in 2013, theAmerican College of Osteopathic Pediatricians(ACOP) launched its web based resident in-serviceexamination. The department continues to developand enhance services to organizations (see table onpage 22). Discussions continue with potential new

NUMBER OF COMAT EXAMINATIONS GIVEN FROM 2011 TO 2013

4500

4000

FM IM OB OPP PEDS PSYCH SURG

3500

3000

2500

2000

1500

1000

500

0 1052

2667

3472

983

2827

3655

1073

2897

3604

655

2784

3920

1010

2591

3376

896

2363

3214

1043

2868

3560

FMFamily Medicine

IMInternal Medicine

OBObstetrics &Gynecology

OPPOsteopathicPrinciples &Practice

PEDSPediatrics

PSYCHPsychiatry

SURGSurgery

n 2011 n 2012 n 2013

Analysis of COMAT andCOMLEX-USAperformance indicates amoderate correlation ofthe two examinations.Students who tookCOMAT disciplineassessments showed ahigher performance inthe COMLEX-USA Level2-CE examination.

clients to expand the quality of assessments acrossa broader field of practice in osteopathic medicineand related health professions.

ADVANCED AND NOVEL TEST ITEMS The further development of static and video imagesincorporated into the examinations has helped toenhance authenticity to exam items. The heart/lungsounds have complemented the items and expandedthe ability to assess competency subset.

CLINICAL DECISIONS MAKING (CDM)CDM cases (testing “key features”) are anotherexciting potential novel test format for the NBOME.Employed in Canada, Germany, Australia and

elsewhere, the concept of key features in ClinicalDecision Making is an integral component oflicensure and other physician assessments in thesejurisdictions, and also may potentially expand thecompetency elements assessed by the NBOME.Directed by John Goudreau, DO, PhD, CDM casesbegan initial pilot testing targeted for COMLEX-USALevel 3. The format uses short answers andextended menu lists rather than the traditionalmultiple choice questions to measure points ofcritical decisions in clinical presentations,assessment, and patient management. Furtherexpanded pilot testing in 2014 will help to determineif CDM cases will be incorporated into COMLEX-USALevel 3 or other NBOME assessments by 2018.



JUL. 2013 NCCST entered its 10thyear in administering the COMLEX-USA Level2-PE examinations.

2013 NBOME CLIENTS FOR ASSESSMENT SERVICES

American Academy of Pediatric Dentistry (AAPD) In-service examination

American College of Osteopathic Emergency Physicians (ACOEP) In-service examination

American College of Osteopathic Family Physicians (ACOFP) In-service examination

American College of Osteopathic Internists (ACOI) In-service examination

American College of Osteopathic Pediatricians (ACOP) In-service examination

American College of Osteopathic Surgeons (ACOS) In-service examination

American Osteopathic Board of Emergency Medicine (AOBEM) Certification and Recertification examinations

American Osteopathic Board of Pediatrics (AOBP) Certification and Recertification


DEPARTMENT OF

CONTINUOUS PROFESSIONAL DEVELOPMENT AND INNOVATIONS BY DOT HORBER, PHD | DIRECTOR FOR CONTINUOUS PROFESSIONAL DEVELOPMENT AND INNOVATIONS

The primary role of the Continuous ProfessionalDevelopment and Innovations (CPDI) Department isto generate advanced resources and assessments forthe ongoing professional development of osteopathicphysicians and other health care professionals. CPDIaccomplishes its mission through initiatives thatinclude the Osteopathic Performance Assessment andImprovement Module (OPAIM) program and supportof continuous medical education (CME) initiatives.Additionally, CPDI provides assistance to otherNBOME teams by providing assistance withinstructional design to learning technologies andaudiovisual services. Another key role for CPDI is tofacilitate the efforts of the Blue Ribbon Panel (BRP)on Enhancing COMLEX-USA, whose focus is theoutlining and implementation of an enhanced two-decision point, competency-based COMLEX-USA thatis consistent with NBOME’s mission.

With regard to developing innovative resourcesand assessments for the ongoing professionaldevelopment of osteopathic physicians and otherhealth care professionals, the CPDI team hasaccomplished the following during 2013.

OPAIM DEVELOPMENTOPAIM is a collection of learning technologies usinga web-based, asynchronous platform that isconvenient, meaningful and relevant to osteopathicpractice, cost-effective, defensible and osteopathicallydistinctive. Each OPAIM module contains didacticpresentations, expert videos and case studiesoffered in a user-friendly and interactive format thatincorporates formative assessment from actualperformance in practice.

The OPAIM prototype was developed and twoOPAIM modules, Medication Safety Communicationsand OMT for Low Back Pain during Pregnancy, werelaunched in April 2013. In preparation for its officialrelease in October at the 2013 OMED Conference, the

OPAIM prototype was refreshed and updated to bemore interactive and user-friendly and to include expertvideos. Great interest was expressed in the modulesand in 2013, three osteopathic Specialty Boardsapproved the Medication Safety Communicationsmodule for satisfying AOA-BOS’ OCC Component 4requirements, including the AOBP (Pediatrics), theAOBIM (Internal Medicine) and the AOBEM(Emergency Medicine). Several other Boards are likelyto partner with the NBOME in creating new modulesor by adding the currently available OPAIM modulesor additional ones to their “libraries” to expand choicesfor their diplomates in satisfying the AOA’s OCC.

As the content of an OPAIM can be customizedto the needs of individual specialty boards or colleges,the NBOME looks forward to partnering with Boardsand other societies such as the American Associationof Physician Assistants who have expressedsignificant interest in using the NBOME’s productand customized modules for their CertificationMaintenance program.

CONTINUING MEDICAL EDUCATIONIn line with its role in facilitating continuousprofessional development for the osteopathicmedical profession, the NBOME received approval in 2013 as an accredited AOA Council on CMEsponsor. In the NBOME’s first independent CMEactivity, CPDI will provide assistance to the NBOMEClinical Skills Department in early 2014 for a seven-credit hour workshop program on clinicalskills case development.

LEARNING TECHNOLOGY AND VIDEOPRODUCTION SERVICESCPDI continues to partner with other NBOME teamsincluding the Cognitive Testing Department to providevideo production services for multi-media test items.Similarly, CPDI provided support for the Clinical

AUG. 2013 NBOME introducesEthicsPoint Hotlineencouraging employeesto report any suspectedbehavior related tofinancial fraud,dishonesty andunethical conduct.

The AmericanOsteopathicAssociation-Bureau ofOsteopathic Specialists(AOA-BOS) StandardsReview Committeegrants approval for thephysicians of threeosteopathic certificationboards – Pediatrics,Internal Medicine andEmergency Medicine –to use NBOME MedicalSafety CommunicationOPAIM to satisfy AOA-BOS OsteopathicContinuous Certification(OCC) Component 4.

SEP. 2013 3,859 COMATexaminationsadministered in the2013-2014 academicyear at 24 colleges ofosteopathic medicineplus two additionalbranch campuses.

Skills Department in the development of the e-SOAPnote training video in preparation for the transitionfrom written SOAP notes to electronic computerkeyboard entry of SOAP notes launching in 2014.

REYNOLDS GRANT PARTNERSHIP WITH UNTHSC-TCOMUsing its expertise with learning technologies andinstructional design, CPDI began partnering withUNTHSC-TCOM in a five-year grant provided by theDonald W. Reynolds Foundation designed to improvethe quality of life among the elderly through betterphysician education in geriatrics. In fulfillment of thisgrant, the UNTHSC-NBOME team has begun thedevelopment of an Elder Safety Inter-professionalCommunication Improvement Module (ICIM) focusingon Fall Risk Education and Assessment, with futureICIMs dealing with Elder Maltreatment, AdvancedCare Planning and Medication Reconciliation. TheICIM is planned to be an interdisciplinary, formativeassessment web-based module primarily designed toimprove elder safety. One of the unique aspects ofthese modules is their inter-professional focus,particularly essential in caring for the elderlypopulation who typically require the coordination of a number of health care professionals.

BLUE RIBBON PANEL ON ENHANCING COMLEX-USAInitiated in May 2010, the Blue Ribbon Panel on

Enhancing COMLEX-USA was charged withresearching and outlining a plan to implement atwo-decision point, competency-based COMLEX-USAexamination that is consistent with NBOME’smission. In addition, the Blue Ribbon Panel wasasked to consider the primary purpose of COMLEX-USA, as well as its important secondary uses of theexaminations.

During 2013, the BRP made great progresstoward achieving its goal. Much of the work of theBlue Ribbon Panel and its Blueprint Workgroup Sub-Committee focused on finalizing and refiningthe new COMLEX-USA Blueprint with its twodimensions, Competency Domain and ClinicalPresentation. Building on previous accomplishmentsof its 2012 meeting, the Blueprint Workgroup met inMay to focus on defining the Clinical Presentationdimension. The outcome of this meeting wasdevelopment of a proposed Introduction to theClinical Presentation dimension and its high-levelcategories, their nomenclature, together withproposed weighting.

During its meeting in November, the Blue RibbonPanel made substantial progress in finalizing thenew Blueprint and in considering a future vision ofCOMLEX-USA as a whole. A report of theserecommendations, with a planned implementation of an expanded two-day COMLEX-USA Level 3examination in 2019, is expected to be released inApril 2014.



November 2013 meeting ofthe Blue Ribbon Panel on Enhancing COMLEX-USA


DEPARTMENT OF

CLIENT SERVICESBY SANDRA WATERS, MEM | VICE PRESIDENT FOR COLLABORATIVE INITIATIVES

In 2013, the client services team supported over65,000 candidates who applied for and completedassessments for COMLEX-USA, COMAT, COMSAE,and/or the board and resident in-serviceexaminations the NBOME administers. Clientservices continues to take center stage to ensureexceptional customer service and that candidatescan register for their examinations, schedule timesand locations, and receive results efficiently.

EXPANDING COMMUNICATIONCHANNELSIn response to the growing number of candidatesand the need to support the primary communicationchannel, NBOME client services representatives haveextended telephone availability from 7AM to 7PM(ET) during business days to provide live customerservice. In addition, improvements were made tothe format and content of the NBOME website forindividuals seeking self-service. Efforts began for the development of a mobile application, to providecandidates and stakeholders with a tool forconverting COMLEX-USA 3-digit standard scores topercentile scores.

CANDIDATE FEEDBACKNew reporting mechanisms implemented in the fallhave increased organizational knowledge andimproved the team’s ability to anticipate andrespond to candidate issues efficiently andeffectively. Key examples include daily reviews ofupcoming test schedules and analysis of test centerincident reports. This approach has helped theNBOME ensure appropriate staffing levels andenabled timely review of any testing site incidents.

During the summer, the NBOME launched anongoing candidate survey to acquire feedback onthe COMLEX-USA registration process, which iscompleted through the NBOME portal. Candidatesare granted access by their college or specialtycollege/board, pay an administration fee and select

testing dates. Feedback has been provided bycandidates on the tutorial, date and site locationselection process, scheduling timing as well as clientservices customer interaction. Although numerousrespondents commented positively on the NBOMEclient services team, the data will help drivecontinuous improvement of resources, practices andprocesses with the aim of improving the overallcandidate experience.

STRATEGIC BUSINESS PARTNERSThe NBOME continued to refine its interaction withstrategic business partners by implementing bi-weekly team calls and quarterly business reviewswith each strategic supplier. This approach enablesthe NBOME to proactively identify issues andeffectively resolve them in a timely manner.Additionally, it provides a forum for broader strategicdiscussions to enable continuous improvement.

SERVING THE OSTEOPATHIC MEDICALCOMMUNITYIn July, the NBOME team completed its portion ofthe Electronic Residency Application Service (ERAS)system reengineering effort that was orchestratedand managed by the American Association ofMedical Colleges (AAMC). NBOME joined the NationalBoard of Medical Examiners and the EducationalCommission for Foreign Medical Graduates incompleting this initiative in advance of the August2013 deadline. This new web-based platformdelivers residency applicants real-time service,assuring that COMLEX-USA scores are seamlesslydistributed to residency program directors.

The NBOME attended the Administrators inMedicine (AIM) annual meeting in the spring andthe regional meetings in the fall. Founded in 1984,the mission of AIM is to assist and supportadministrators for medical licensing and regulatoryauthorities to achieve administrative excellence andultimately advance public safety. Participation in

OCT. 2013 The NBOME honorsretiring James J.Rechtien, DO, PhD, forhis dedicated leadershipand service asDepartment Chair of theCOMLEX-USA Level 1and FoundationalBiomedical Sciences ofNBOME’s NationalFaculty. Dr. Rechtien hasserved the NBOME formany years, and isretiring from theMichigan StateUniversity College ofOsteopathic Medicine.

DEPARTMENT OF

ADMINISTRATIONBY JOSEPH FLAMINI, MBA, FACHE | VICE PRESIDENT FOR ADMINISTRATION & CHIEF OPERATING OFFICER

The Department of Administration is integrated intothe fiber of the NBOME, operating as both a liaisonand guide in conjunction with the executiveleadership team, department managers, Board, andexternal partners and clients to ensure the day-to-day, month-to-month, and year-to–year continuity ofour work.

As an assessment agency, the NBOMEfundamentally develops and delivers high-stakesexaminations and evaluations for the osteopathicmedical community. In order to design, manage andcontinuously improve these products, the NBOMEutilizes a comprehensive test development processand relies on support from strategic planning efforts,workforce development, client services, informationtechnology, financial systems, strategic partners,and innovation.

Accordingly, the Vice President forAdministration/COO directly oversees thedepartments of Marketing and Communications andInformation Technology, which by their nature also

touch and support each NBOME department. In 2013, these two areas underwent major,

strategic transformation to support theorganization’s growth, especially with regard tostaffing. Up until this time, the NBOME’scommunication’s director was responsible fordeveloping all internal and external communications.As the need arose to embrace Social Media tomaintain relevance among candidates – especiallythe millennial demographic – and to address politicaland environmental changes evolving in the house ofmedicine, the NBOME recognized a need to beproactive in the marketing and communication of itsproducts and services. As a result, the departmentwas reorganized and renamed “Marketing andCommunications” to include a newly hired director, adedicated associate, and shared coordinator supportposition. This department continues to beresponsible for all internal and externalcommunications, but also encompasses tacticaladvertising, public relations, and marketing to meet



these meetings facilitated NBOME interaction withthe executive directors of medical licensing andregulatory boards across the nation. Key topicsincluded the role of COMLEX-USA in assessinglicensure applicants, physician professionalism andstandards of conduct, use of social media,telemedicine and physician mobility.

Colleges of osteopathic medicine throughout thenation continue to use COMSAE to prepare studentsfor the COMLEX-USA series, and over 90% ofeligible schools use one or more of the availableCOMAT examinations.

The NBOME’s support of specialty boards andcolleges and related health care providers for theadministration of resident in-training and specialty

board examinations continues to grow. The NBOMEnow supports five of the largest specialties to deliverboard certification, recertification and residency in-training examinations. Some organizations had beenproviding their examinations via paper and pencil,but by the end of 2013, all of the NBOME’s specialtycollege partners had completed voluntaryconversion to secure proctored web-based delivery.Several other specialty affiliates are in discussionswith the NBOME to provide similar services. Theincreasing interest stems from the desire to reduceadministrative burden and leverage the NBOME’sexperience implementing high quality and secureexaminations that advance the mission of publicprotection.


Through the financial oversight of the NBOME Board ofDirectors, Finance Committee and Audit Committee,the NBOME remains a financially stable organizationcommitted to providing sustainable resources for thefulfilment of its mission to protect the public whilemaintaining the integrity of the organization. Thecontinued integration of financial acumen and strategicobjectives is an important goal for the NBOME. Thefive-year strategic plan includes key strategic directivesrelated to the advancement of accountability forfinancial matters, as well as the long-range financialplanning for evaluation of all NBOME assets includingleased space. The NBOME Finance Department helpsserve a role in creating an environment that raisesthe financial awareness of the organization throughthe reporting and budgeting process.

Some department highlights this year includedimplementing reporting on quarterly financialmeasures for the balanced scorecard, incorporatingbenchmarks on operating reserves as key criteria ininvestment and budget management, anddocumenting NBOME financial systems to evaluatethat the structures that generate financial resultsprovide reasonable assurance that the information isaccurate, timely and consistent.

A year-end audit was completed with an

unmodified “clean” opinion as a result. In conjunctionwith the NBOME Audit Committee, a third partyhotline for confidential reporting related to financialfraud, dishonesty and unethical behavior wasimplemented as mentioned elsewhere in this report.

Additionally, the department completed thetraining and implementation of positive pay and ACHapproval tools related to banking transactions toenhance internal controls, and an upgrade of thefinancial system with enhanced network andreporting capabilities. These items and more werepresented at September 2013 Senior ManagementRetreat with the goal of increasing the awareness ofkey financial indicators among the organization’sleadership, along with enhanced investmentmonitoring reports to measure NBOME’s totalinvestment portfolio performance.

In conjunction with the NBOME FinanceCommittee, the department initiated a request forproposal process resulting in the selection of newfixed income managers. We also developed anddisbursed budget reporting processes bydepartment, which provided transparency formanagement and finance to interact in order toraise awareness of financial matters and improveoverall reporting.

DEPARTMENT OF

FINANCEJOSEPH W. CRUITT, MBA, CPA, CGMA | VICE PRESIDENT FOR FINANCE & CHIEF FINANCIAL OFFICER

the NBOME strategic initiatives and implementguidance from our Board.

Likewise, the Information TechnologyDepartment experienced transformation in 2013 inorder to support the ever-changing technologicalneeds necessary to provide outstanding high-stakesassessments in the 21st century. Some of the IToperations that had been previously outsourced tocontractors were converted to fulltime internalpositions this year, growing to a total of 14 IT staff

members. Collectively, the complementary skill setsof this team merge to provide the organization withinfrastructure, security, interfaces, electronic deliverysystems, wireless and internet support,programming, database development andmaintenance, migration to new systems, and more.

Indeed 2013 was a year of growth for theNBOME, and with strategic direction from bothexecutive leadership and the Board of Directors, theorganization charted a course for future success.

NOV. 2013 The AmericanOsteopathic Association(AOA) Council onContinuing MedicalEducation (CME)approved the NBOMEapplication as arecognized, AOACategory 1 CME Sponsor.

DEPARTMENT OF

HUMAN RESOURCESBY MAYA JOHNSON, MBA, SPHR | DIRECTOR FOR HUMAN RESOURCES



DEC. 2013 The NBOME presentedits “Santucci Award” foroutstandingcontributions to theorganization’s mission toBoyd R. Buser, DO, Deanat the University ofPikeville-KentuckyCollege of OsteopathicMedicine, and previousNBOME Board Chair(2003-2005).

In efforts to meet NBOME’s strategic objectives forthe engaged workforce, a full time human resourcesdirector was hired in 2013 and operates as anintegral member of the organization’s executiveleadership team.

Since joining NBOME, the Director for HumanResources and the team she oversees have steeredand implemented significant investments inemployee welfare and engagement programs andpolicies including the renewal of NBOME’s existingmedical plan. Maintaining this plan was an importantgoal involving competitive analysis while meeting acritical objective in allowing employees to continuerelationships with their current medical providers.Additionally, NBOME offered and advocated free flushots for all staff and promoted wellness throughthe staff monthly newsletter, InTouch.

Employees promoted breast cancer awareness byparticipating in Lee’s National Denim Day, as well asraising donations to benefit ongoing cancer researchtotaling $865 for the American Cancer Society. Inthe same spirit of giving, NBOME staff members atholiday time participated in the Salvation Army’sAngel Giving Tree, which helps children in need;and, in Bringing Hope Home’s Adopt-A-Familyprogram that provides support to families withsomeone battling cancer.

As indicated in our balanced scorecard, wecontinued to see an increase in employeeparticipation in internal and external professionaldevelopment activities. The monthly “Food for theMind” series continued with a variety of sessionsincluding workplace safety, innovations in testing,

retirement savings and OPAIM initiatives.In the area of employee communication, new

human resources bulletin boards have been postedin common areas throughout each of our locations asanother way to ensure employees stay informed ofprograms available to them and upcoming activities.Development of a dedicated human resourcessection of the monthly newsletter was initiated thatfeatures a Department Spotlight; information on thecurrent month’s Gold Star, Peer-to-Peer RecognitionEmployees; an Employee News section whereemployees can share special announcements withthe NBOME family; and, a Wellness Works sectionwith information on overall well-being.

Recruitment efforts peaked in 2013 with over 20new, full-time hires, five of whom are departmentdirectors. The volume of new hires this year providedan opportunity to refine our overall screening andinterviewing process, and to ensure an effectivemethod of identifying high-quality candidates.

The human resources team has been workingdiligently on a standardized NBOME OnboardingProgram that will ensure that all new hires get auniform orientation experience respective of thelocation and department they are joining. This newprogram will extend the current two-week, formalorientation schedule to include “HR Check-In”meetings with new hires at three-month intervalsthroughout the employee’s first 12 months at NBOME.

As the NBOME continues to grow and expand itsstaff, many opportunities arise for increasedprograms like these to retain, enrich, and supportemployee loyalty and engagement.


On December 6, 2013, many NBOME staff andBoard members paused to remember and celebratethe life of Mia Solomon, PhD, who ended her morethan 10 year battle with cancer over theThanksgiving weekend.

Dr. Solomon was influential in the developmentof the COMLEX-USA Level 2-PE examination as sheserved as Coordinator of Doctor-PatientCommunication Training at the NBOME from 2004-2013. She was also instrumental in the developmentof the GPA tool and its use for assessment ofdoctor-patient communication, interpersonal skillsand professionalism.

As a result of her contributions, the NBOMEBoard of Directors voted to approve a $1,000 in-memoriam donation to the Mia Solomon Fund atBryn Mawr Family Practice as one way in whichNBOME will attempt to memorialize Dr. Solomon’scontributions to the NBOME.

In addition, the NBOME contributes to its

stakeholder groups and communities nationally andlocally in Chicago and Philadelphia in many waysthroughout the year. However, one very specialtradition that staff leads each year is that of teamingup to give to families in our communities who are inneed, most notably at the holiday time in December.Together, NBOME staff contributed over $1,000, todirectly benefit families in Philadelphia and Chicagoas mentioned in the Human Resources section ofthis report.

Other regional and national sponsorships in 2013included:› The Advocates for the AOA Fit for Life Runbenefitting student scholarships

› The American Cancer Society› Diamond Sponsor of the Annual Meeting of theAmerican Association of Colleges ofOsteopathic Medicine (AACOM), and

› Gold Sponsor of the Federation of State MedicalBoards Annual Conference.

Community Support

COMMUNITY


2013NBOME NATIONAL FACULTY

NBOME National Faculty

2013 was the inaugural year for the implementationof the restructured NBOME National Faculty, led by32 Department and Division Chairs. The concept ofa transformed National Faculty was developed toassure the highest quality subject matter experts areengaged in the processes required for developmentand quality assurance for NBOME’s examinations.These Chairs credential, mentor and recruit faculty,serve as trusted advisors, and lead by example themany meetings involved in test item or caseauthoring, examination review, and the like. Thesevalued contributors are core to the credibilityrequired for the NBOME to fulfill its mission. A kickoff

orientation meeting of the Chairs convened in early2013 to set principle accountabilities and objectives.

The recruitment and credentialing of a NationalFaculty saw over 900 professionals reviewed andaccepted for participation with the NBOME as testitem writers, physician examiners, case authors,examination reviewers or committee members.Highly representative of the osteopathic medicalprofession, COMs, and teaching hospitalsthroughout the United States, the NBOME NationalFaculty boasts a number of professionals involvedwith state licensing boards as well as participationfor those involved in private clinical practice.


NBOME 2013 NATIONAL FACULTY LEADERSHIP

COMLEX-USA TEST COMMITTEE CHAIRS

COMLEX-USA Level 1 & Foundational Biomedical SciencesJames J. Rechtien, DO, PhD

COMLEX-USA Level 2-CE (Cognitive Evaluation)John L. Goudreau, DO, PhD

COMLEX-USA Level 2-PE (Performance Evaluation)David Kuo, DO

COMLEX-USA Level 3Michael F. Oliverio, DO

Advanced Test ItemsRobert T. Hasty, DO

FOUNDATIONAL BIOMEDICAL SCIENCES – DIVISION CHAIRS

AnatomyRandy J. Kulesza, PhD

BiochemistrySean M. Lynch, PhD

GeneticsDavid P. Gardner, PhD

Microbiology & ImmunologyPeter G. Gulick, DO

PathologyMary Jo Robinson, DO

PharmacologyGerald B. Call, PhD

PhysiologyMichael L. Smith, PhD

CLINICAL DEPARTMENT CHAIRS

Emergency MedicineCharles A. Finch, DO

Family MedicineJoshua S. Coren, DO, MBA

Internal Medicine, Geriatric Medicine & DermatologyGlenn H. Nordehn, DO

Obstetrics & GynecologyJoseph M. Kaczmarczyk, DO, MPH

Osteopathic Principles & Practice /Neuromusculoskeletal MedicineRandy G. Litman, DO

Pediatric and Adolescent MedicineJacqueline M. Kaari, DO

Preventive Medicine & Health PromotionJames E. Foy, DO

Psychiatry, Neurology & Clinical NeurosciencesJed G. Magen, DO, MS

Radiology & Diagnostic ImagingJoseph W. Stengel, DO

Surgery, Surgical Subspecialties & AnesthesiaWilliam R. Henwood, DO

PREVENTIVE MEDICINE / HEALTHPROMOTION – DIVISION CHAIRS

Biostatistics & EpidemiologyAlan G. Glaros, PhD

Health Care Delivery & Patient SafetyOliver W. Hayes, III, DO, MHSA

Medical Ethics, Jurisprudence & ProfessionalismJonathan R. King, DO, JD

Public Health & Preventive MedicinePaul C. Dew, MD, MPH

COMAT CHAIRS

Emergency MedicineJohn W. Becher, DO

Family MedicineTracy O. Middleton, DO

Internal MedicineGary L. Slick, DO, MA

Obstetrics & GynecologySheryl A. Bushman, DO

Osteopathic Principles & Practice /Neuromusculoskeletal MedicineKaren T. Snider, DO

PediatricsAlissa P. Craft, DO

PsychiatryRonald R. Paolini, DO

SurgeryCraig A. Gudakunst, DO

NBOME NATIONAL FACULTY2013NBOME NATIONAL FACULTY


Alabama

10Alaska

1Arizona

60Arkansas

1California

71Colorado

16

New Jersey

40New York

53North Carolina

12Ohio

32Oklahoma

23Oregon

7

Pennsylvania

102

Rhode Island

2

South Carolina

5

Tennessee

19

Texas

35

Virginia

20

Washington

18

West Virginia

19

Wisconsin

3

Wyoming

1


The NBOME National Facultyis comprised of the NBOME Board, Committee and Task Force members, as well as Item Writers. The numbers shown here represent the number of NBOME National Faculty in a given state.

Connecticut

2Delaware

3DC

2Florida

60Georgia

8Idaho

1Illinois

52Indiana

13Iowa

25Kansas

4Kentucky

11Louisiana

1Maine

19Maryland

9Massachusetts

4Michigan

72Minnesota

6Mississippi

6Missouri

57Nebraska

1Nevada

10New Hampshire

1

THE COMMITTEE LISTING IS BASED ON THE BEST AVAILABLE INFORMATION AT THE TIME OF PUBLICATION. WE APOLOGIzE FOR ANY OMISSIONS OR ERRORS.

AN ASTERISK (*) DENOTES A COMMITTEE CHAIR. A GLOSSARY OF SCHOOL ACRONYMS CAN BEFOUND ON PAGE 47.

2013NBOME COMMITTEES

34 NATIONAL BOARD OF OSTEOPATHIC MEDICAL ExAMINERS | ANNUAL REPORT 2013

BOARD COMMITTEESEXECUTIVE COMMITTEE

Bruce Bates, DO NBOME

John W. Becher, DO PCOM

Wayne R. Carlsen, DO* OU-HCOM

Joseph Cruitt, MBA, CPA NBOME

John R. Gimpel, DO, MEd NBOME

Janice A. Knebl, DO, MBA* UNTHSC/TCOM

Geraldine T. O’Shea, DO Foothills Women’s Med. Ctr.

Jeanne M. Sandella, DO NBOME

Dana C. Shaffer, DO UP-KYCOM

Gary L. Slick, DO, MA OSU-COM

Sydney Steele, Esq Kroger Gardis & Regas, LLP

John E. Thornburg, DO MSUCOM

AUDIT COMMITTEE

John W. Becher, DO* PCOM

Susan I. Belanger, PhD, RN Sibley Mem. Hosp./JHM

Anthony L. Cossetti, CPA Beneficial Bank




AWARDS COMMITTEE

William G. Anderson, DO* Detroit Medical Center

Gary R. Clark




COMPENSATION SUBCOMMITTEE



Janice A. Knebl, DO, MBA UNTHSC/TCOM

John E. Thornburg, DO, PhD MSUCOM

FINANCE COMMITTEE


Wayne R. Carlsen, DO OU-HCOM

Gary R. Clark*


H. Timothy Dombrowski, DO, MPH RowanSOM

Tara L. Genstil, MBA, CPA Alpine Investors


Don Jacobson Dean Jacobson Financial Services


Dana C. Shaffer, DO UP-KYCOM

LIAISON COMMITTEE

William G. Anderson, DO Detroit Medical Center


Kaitlin Dewhirst, OMS IV SOMA



Harald Lausen, DO AODME

Shinban Liu, OMS IV COSGP

Linda L. Mascheri AOA


Michael Paddock, DO AOA-CIR

Stephen C. Shannon, DO, MPH AACOM

Jon Thomas, MD, MBA FSMB

Tara Uhler, MD OPDA/CMSS

Norman Vinn, DO AOA

NOMINATING COMMITTEE




Deborah Pierce, DO, MS Albert Einstein Med. Ctr.

Karen Snider, DO ATSU/KCOM

STANDARDS & ASSURANCES COMMITTEE


Bruce B. Cunningham, DO

Martin Diamond, DO NUMC

Anthony Errichetti, PhD NYIT-COM

J. Michael Finley, DO Western U/COMP

William Henwood, DO Trumbull Memorial Hospital

Craig Lenz, DO ACOM

Ronald R. Marino, DO, MPH Winthrop-University Hospital

Richard A. Ortoski, DO LECOM

William F. Ranieri, DO RowanSOM

NBOME CommitteesHundreds of dedicated individuals all across the country support the NBOME’s mission of protecting thepublic with their work as part of our committees and task forces. The NBOME is grateful to the membersof our National Faculty for their valuable contributions.

ANNUAL REPORT 2013 | NATIONAL BOARD OF OSTEOPATHIC MEDICAL ExAMINERS 35

Gary L. Slick, DO, MA* OSU-COM

Doris Stoll, PhD

Melissa Turner, MS NBOME

OPERATIONAL COMMITTEESCLINICAL SKILLS TESTING ADVISORY COMMITTEE

John R. Boulet, PhD, MA ECFMG/Faimer

Sheryl A. Bushman, DO NYU Langone Med. Ctr.

Millicent K. Channell, DO, MA RowanSOM

Gautam J. Desai, DO* KCUMB-COM

Dennis J. Dowling, DO, MA NBOME



Laurie Gallagher, DO NBOME

Sandra Garner, MEd Western U/COMP


Loretta Graham, PhD, MA

David Kuo, DO PCOM


William Roberts, EdD NBOME


R. Taylor Scott, DO MSUCOM

Crystal Wilson, MEd NBOME

COGNITIVE TESTING ADVISORY COMMITTEE



Ronald R. Burns, DO University Family Med. Ctr.

Andrea S. Clem, DO CCOM/MWU

Frank Filipetto, DO UNTHSC/TCOM

James E. Foy, DO TUCOM-CA


John L. Goudreau, DO, PhD* MSUCOM

Robert Hasty, DO CUSOM

Jonathan King, DO, JD RVUCOM

Randy G. Litman, DO UP-KYCOM

Michael Oliverio, DO SUNY Stony Brook SOM

James J. Rechtien, DO, PhD MSUCOM


Roberta A. Wattleworth, DO, MHA, MPH DMU-COM

COMAT ADVISORY COMMITTEE

Jerry Alexander, PhD UNTHSC/TCOM




Alissa P. Craft, DO, MBA Western U/COMP

Tyler Cymet, DO AACOM


Craig Gudakunst, DO MSUCOM

Abraham M. Jeger, PhD NYIT-COM

Rebel Jones UNTHSC/TCOM

Christine S. Kell, PhD LECOM

Thomas E. McWilliams, DO ATSU-SOMA

Tracy O. Middleton, DO AzCOM/MWU

Ronald Paolini, DO Eisenhower Army Med. Ctr.

Mary Jo Robinson, DO PNWU-COM

Donald J. Sefcik, DO MSUCOM




Sandra Waters, MEM NBOME

COMLEX-USA COMPOSITE COMMITTEE



Boyd R. Buser, DO UP-KYCOM

Peter Dane, DO UNECOM



Frank Filipetto, DO UNTHSC/TCOM



John L. Goudreau, DO, PhD MSUCOM

Randy G. Litman, DO UP-KYCOM




Deborah Pierce, DO, MS* Albert Einstein Med. Ctr.




INNOVATIONS IN TESTING ADVISORY COMMITTEE

Jason R. Aronovitz, DO Einstein Healthcare Network

Steve Basile, MBA NBOME



Robert Hasty, DO* CUSOM

Scott Helf, DO, MSIT Western U/COMP

Kenneth E. Korber, PA, MHPE ACOFP


John L. Szarek, PhD TCMC



RESEARCH ADVISORY FORUM

James Andriole, DO

Scott Arbet, PhD Arbet Consulting


Mary Browne, MA NBOME

Kathryn Bugbee, PhD AAMC

Robert Cuzzolino, EdD PCOM

Catherine Farmer, PsyD NBME

Rita Getz, PhD CCOM/MWU


Louis Grosso, MEd ABIM

Thomas Hardie, MSN, EdD Drexel University

Dot Horber, PhD NBOME

Michael Jodoin, PhD NBME


Feiming Li, PhD NBOME

Benjamin Lovett, PhD Elmira College

Sheila Mauldin, MNM NCCPA

Danette McKinley, PhD FAIMER

Kevin Murphy, PhD Adult ADHD Clinic of Central MA

William Roberts, EdD NBOME


Cynthia Searcy, PhD AAMC

Donald J. Sefcik, DO* MSUCOM


Hao Song, PhD NBOME




TESTING ACCOMMODATIONS COMMITTEE

James Andriole, DO


Robert Foster, DO WVSOM

Brian Fulton, DO

Shelby Keiser, MS

Lori Kemper, DO, MS AzCOM/MWU


Richard LaBaere, DO, MPH ATSU/KCOM

Jed Magen, DO, MS* MSUCOM

J William McCord, DO, MS

Casey McGrath NBOME

Gary Palman, DO





Margaret Wong, MBA NBOME

Brian Wood, DO VCOM-VC

SUBCOMMITTEES& TASK FORCESADVANCED ITEMS COMMITTEE

Jonathan Colen, DO Illinois Medical Associates

Danielle Cooley, DO RowanSOM

Carmella D'Addezio, DO Sheppard AFB

Carmine Daniel D'Amico, DO LECOM

Michelle DeVoe, DO Treasury Valley Pediatrics

Shawna Duncan, DO OSU-COM

Thomas J. Fotopoulos, DO LECOM Bradenton

Edward Gotfried, DO NYIT-COM

Robert Hasty, DO* CUSOM

Robert Lee, DO, MS Winthrop Pediatric Associates

Lauren Noto Bell, DO PCOM

Belinda A. Stillman, DO Stairways Behavioral Health


BLUE RIBBON PANEL ON ENHANCING COMLEX-USA



John Bulger, DO, MBA Geisinger Health System

Paul Evans, DO MU-COM



Timothy J. Kowalski, DO VCOM-CC


Kathryn Lambert, DO RowanSOM

Lena Marie Napolitano, MD MSUCOM

Jim Nemitz, PhD WVSOM


John R. Potts, MD ACGME

Donald J. Sefcik, DO MSUCOM



Keith Watson, DO PNWU-COM

BLUEPRINT WORKGROUP SUBCOMMITTEE




Alissa P. Craft, DO, MBA Western U/COMP

Anthony Errichetti, PhD, MA NYIT-COM

Paul Evans, DO MU-COM



Nicole Shields, MD LMU-DCOM

Susan Steele, DO OSU-COM

Thomas Told, DO RVUCOM

Anna Yeung, DO Western U/COMP

COMAT INTERNAL MEDICINE SUBCOMMITTEE

Barbara Atkinson, DO UNTHSC/TCOM

Lawrence Ciesemier, DO ATSU-KCOM

Darrin D'Agostino, DO, MPH UNTHSC/TCOM


John Grider, DO ATSU-KCOM

Peter G. Gulick, DO MSUCOM

Timothy R. Heath, MD UNTHSC/TCOM

Joanne Kaiser-Smith, DO RowanSOM

Jonathan Leo, PhD LMU-DCOM

Thomas Mohr, DO RVUCOM

Glenn Nordehn, DO CCOM/MWU

Gary L. Slick, DO, MA* OSU-COM

Matthew Wilkett, DO OSU-COM

COMAT OB/GYN SUBCOMMITTEE

Georgina Bobkins, DO Fairview Clinics - Elk River

David Boes, DO MSUCOM

Ralph Boling, DO ATSU-KCOM

Sheryl A. Bushman, DO* NYU Langone Med. Ctr.

Lony C. Castro, MD Western U/COMP

Gary Doublestein, DO, COL, MC-USAR Mercy Health Partners

Michael J. Geria, DO

Joseph R. Johnson, DO OSU-COM

Joseph Kaczmarczyk, DO, MPH PCOM

Theresa May-Hartle, DO DeWitt Women's Health

Holly Ray, DO Aurora Health Care

Anita Showalter, DO PNWU-COM

Brent Speak, DO ATSU-KCOM

Lena Weinman, DO

Paul Whitham, DO Utica Park OB/GYN

John Williamson, MD LMU-DCOM

COMAT OSTEOPATHIC PRINCIPLES & PRACTICE SUBCOMMITTEE

Lisa R. Chun, DO MU-COM



Heather Ferrill, DO RVUCOM

Edward K. Goering, DO, DVM, MSHPEWestern U/COMP

Polly E. Leonard, DO, MS Kent Hospital

William F. Morris, DO CUSOM



Tracy O. Middleton, DO AzCOM/MWU


John R. Potts, MD ACGME





Keith Watson, DO PNWU-COM

CLINICAL DECISION-MAKING &KEY FEATURES TASK FORCE



Georges Bordage, MD, PhD UIC College of Medicine


Peter Dane, DO UNECOM

Bruce Dubin, DO RVUCOM


Mollie M. James, DO, MPH

Erik Langenau, DO PCOM





COMAT EMERGENCY MEDICINE SUBCOMMITTEE


John Dery, DO Sparrow Health System

Paul Louis DiModica, DO

Alan Janssen, DO Genesys Regional Med. Ctr.

Fred A. Lepore, Jr. DO CCOM/MWU

Kate Mitzel, DO AzCOM/MWU

Michael Paddock, DO Cook County Hospital


Michael P. Seaman, DO LMU-DCOM

Jeremy Selley, DO Naval Hospital Camp Lejeune

COMAT FAMILY MEDICINE SUBCOMMITTEE

Jane Balbo, DO OU-HCOM

Nancy A. Bono, DO NYIT-COM

Joel Dickerman, DO Saint Mary Corwin Hospital

David Kanze, DO RVUCOM

Tracy O. Middleton, DO* AzCOM/MWU

Steve Miller, DO, MPH LMU-DCOM

Ronna New, DO University of Louisville

Cheryl Sellers, DO LECOM Bradenton



Doris Newman, DO NSU-COM

Jamie Rapacciuolo, DO RowanSOM

Michael A. Seffinger, DO Western U/COMP

Karen Snider, DO* ATSU/KCOM

Michael Wieting, DO, MEd LMU-DCOM

Sheldon C. Yao, DO NYIT-COM

COMAT PEDIATRICS SUBCOMMITTEE

Alissa P. Craft, DO, MBA* Western U/COMP

Kathryn G. Edwards, MD Health Science Center

Lisa Gouldsbrough, DO Southern Maine Med. Ctr.

Shannon Henning, DO Winthrop University Hospital/Good Samaritan Hospital

Michael G. Hunt, DO St. Vincent’s Health Partners, Inc.

Jacqueline M. Kaari, DO RowanSOM


Catherine Macyko, MD CCOM/MWU

Richard D. Magie, DO KCUMB-COM

Heath A. Parker, DO ACOM

Ava Stanczak, DO, CS LMU-DCOM

Lisa Warren, DO Western U/COMP

Maggie zamboni, DO UNECOM

COMAT PSYCHIATRY SUBCOMMITTEE

Danielle Bradshaw, DO University of Missouri

Leah Cobb-Snodgrass, MD Hazard ARH Regional Medical Center

Jonathan Colen, DO Illinois Medical Associates

Justin Faden, DO RowanSOM

Matthew Geromi, DO NSU-COM

Robert N. Gerstman, DO Geisinger Med. Ctr.

James Horst, DO

Teodor Huzij, DO The Trinity Institute

Steven Karp, DO Rosewood Centers for Eating Disorders

Thomas Laton, DO The Regional Center for Sleep Disorders

James MacKenzie, DO Ann & Robert H. Lurie Children’s Hospital of Chicago

Ronald Paolini, DO* Eisenhower Army Med. Ctr.

Robert Piccinini, DO Associates in Psychiatry

David Allen Picone, DO MSUCOM

Stephen M. Scheinthal, DO RowanSOM

Ryan M. Smith, DO Dartmouth Medical School

Kendall Southern, DO Oklahoma Forensic Center

Scott Trayer, DO Franklin Family Services

Christian White, DO RowanSOM

COMAT SURGERY SUBCOMMITTEE

Craig Gudakunst, DO* MSUCOM

William Henwood, DO Trumbull Memorial Hospital

David Scott Kermode, DO Knoxville Hospital


Stephen Laird, DO PNWU-COM

Michael S. Miller, DO The Wound Healing Centers of Indiana

Robert Wilmoth, MD LMU-DCOM

COMLEX-USA LEVEL 1 ITEM REVIEW

Tiffany Alley, PhD LMU-DCOM

Tafline Arbor, PhD DMU-COM

Andrew Brittingham, PhD DMU-COM

Terry Else, PhD, MT (AMT) TUNCOM

Edward Finnerty, PhD, SC(ASCP), NAOMEDMU-COM

Charles Fleschner, PhD ATSU-KCOM

Schoen Kruse, PhD RVUCOM


Kathy LePard, PhD CCOM/MWU

Kathryn Lovell, PhD MSUCOM

Mary E. Malcom, DO

Blaine Maley, PhD DMU-COM

Jack S. Moskowitz, DO

Pamela Potter, PhD AzCOM/MWU

James J. Rechtien, DO, PhD* MSUCOM

Michael Smith, PhD UNTHSC/TCOM

Vivian Stevens, PhD OSU-COM

David Strom, PhD DMU-COM

Melissa Stuart, PhD ATSU-KCOM

John Sutton, DO

Susan Viselli, PhD CCOM/MWU

Wayne Wilson, PhD DMU-COM

Karim zaman, DO GA-PCOM

COMLEX-USA LEVEL 1 PRELIMINARY EXAM REVIEW

Rani Bright, MBBS, HCLD PCOM

Gerald Call, PhD AzCOM/MWU

Raeann Carrier, PhD WVSOM


Charles Fleschner, PhD ATSU-KCOM



David Gardner, PhD ATSU-SOMA

Jacalyn Green, PhD CCOM/MWU



Richard D. Magie, DO KCUMB-COM

Joseph C. Nemcok, DO Osteopathic Ob-Gyn Inc.

Craig I. Schwartz, DO, RVT

Ryan M. Smith, DO Dartmouth Med. School

Brett Stecker, DO Tristan Medical

Belinda A. Stillman, DO Stairways Behavioral Health

Wayne G. Tamaska, DO

Michael Terzella, DO NYIT-COM

Gregory A. Thompson, DO ACOM

COMLEX-USA LEVEL 2-CE REFERENCING

Draion M. Burch, DO Magee Women's Hospital

Jennifer N. Caudle, DO Sinai Hospital


Rocco J. Crescenzo, DO PCOM


Sarah Hall, DO OSU-COM


Abby White, DO St. Luke’s University Health Network

COMLEX-USA LEVEL 2-PE CASE DEVELOPMENT COMMITTEE (CDC)

Peter Bell, DO, MBA OU-HCOM

Kathryn Brandt, DO, MS UNECOM

Kyla Carney, DO DMU-COM

Kym Carpentieri, DO

Rebecca Cherner, DO NSU-COM

Thomas Dayberry, DO UNTHSC/TCOM

Joseph Dimeo, DO PNWU-COM


Kelly David Halma, DO ATSU/KCOM

Ronald Hedger, DO TUNCOM

Patricia Hiserote, DO TUCOM-CA

David Kuo, DO* PCOM

Steven Thomas O'Donnell, DO LECOM

Thomas H. O'Hare, DO AzCOM/MWU

Burt Routman, DO LMU-DCOM

Hortense P. Russell, DO RowanSOM

Joseph Stasio, DO RVUCOM

Gregory A. Thompson, DO ACOM

COMLEX-USA LEVEL 3 FINAL EXAM REVIEW

Ralph Boling, DO ATSU-KCOM


Joshua S. Coren, DO, MBA RowanSOM

Charles Finch, DO AzCOM/MWU


Blake Hoppe, DO LECOM

T. Bucky Jones, PhD AzCOM/MWU


Jonathan Kalmey, PhD LECOM

Patricia Kooyman, DO NYIT-COM

Randy Kulesza Jr., PhD LECOM

Laura Michael, DO Bostwick Laboratories

David Mokler, PhD UNECOM

Kathleen O'Hagan, PhD CCOM/MWU

Cyrus Parsa, DO WesternU/COMP

Balbina Plotkin, PhD, MEd CCOM/MWU


Paul R. Rennie, DO TUNCOM



John Sutton, DO

Edward Wagner, PhD WesternU/COMP

Donald Walters, PhD WesternU/COMP

COMLEX-USA LEVEL 2-CE ITEM REVIEW

Draion M. Burch, DO Magee Women's Hospital

Carmine Daniel D'Amico, DO LECOM

William Downs, DO Monmouth Med. Ctr.



Francis A. Komara, DO MSUCOM


Elizabeth McCraven, DO

Edward E. Packer, DO NSU-COM

James Powers, DO VCOM-VC

Keven C. Schattner, DO

Richard K. Schulz, DO, MBA


Randall L. Sisam, DO

Carly Snyder, DO

COMLEX-USA LEVEL 2-CE PRELIMINARY EXAM REVIEW

Craig D. Cameron, DO


Carmella D'Addezio, DO


Mark Gabay, DO

Terrie Beth Ginsberg, DO RowanSOM


Gregory Joseph Hellier, DO



Randy Litman, DO UP-KYCOM



Mollie M. James, DO, MPH


Mary E. Malcom, DO

Heather McCarthy, DO NSU-COM

Glenn Nordehn, DO CCOM/MWU

Michael F. Oliverio, DO* SUNY Stony Brook SOM

Deborah M. Scheinthal, DO White Plains Hospital Center, Greenwich Hospital

COMLEX-USA LEVEL 3 ITEM REVIEW

Shawna Duncan, DO OSU-COM

Michael Fabbro II, DO



Regina Lewis, DO OSU-COM


Tom Oryszczak, DO Northwest Community Hospital

Jeff Rabrich, DO St. Luke’s - Roosevelt Hospital Center

Narasinga Rao, DO St. Barnabas Hospital

Rhonna Shatz, DO Henry Ford Hospital

Joseph Stengel, DO South Sound Radiology

Stuart Williams, DO VCOM-CC

COMLEX-USA LEVEL 3 PRELIMINARY EXAM REVIEW



Michelle DeVoe, DO Treasury Valley Pediatrics


Timothy J. Hogan, DO

Robert Hostoffer, DO Allergy/Immunology Associates Inc.

Edward J. Jelonek Jr., DO

Amanda Y. Laubenthal, DO


Heather McCarthy, DO NSU-COM

Todd A. Moyerbrailean, DO MSUCOM


Deborah M. Scheinthal, DO White Plains Hospital Center, Greenwich Hospital


COMLEX-USA LEVEL 3 REFERENCING


Steve Lee, DO WesternU/COMP

J. Michael Metts, DO DMU-COM


Bunnie Richie, DO

Carlton A. Richie, III, DO

Carol Rogala, DO

Joey Rottman, DO

COMVEX SUBCOMMITTEE


Ronald R. Burns, DO University Family Med. Ctr.

H. Timothy Dombrowski, DO, MPH* RowanSOM

John Goudreau, DO, PhD MSUCOM

Thomas Pickard, DO OSU-COM

Anita Steinbergh, DO Westerville Family Medicine

Scott Steingard, DO Steingard Medical Group


CONTINUOUS PROFESSIONAL DEVELOPMENT ADVISORY COUNCIL

James Andriole, DO


Gautam J. Desai, DO KCUMB-COM

Joel Dickerman, DO* Saint Mary Corwin Hospital



Anna Hayden, DO North Broward Hospital District

W Ashley Hood, DO

Dot Horber, PhD NBOME

Beth Korinek, MPH The Center for Personalized Education for Physicians


Thomas Told, DO RVUCOM

CSTAC SUBCOMMITTEE FOR SOAP NOTE MISREPRESENTATION


Gautam J. Desai, DO KCUMB-COM


J. Michael Finley, DO* Western U/COMP

Eugene Oliveri, DO, MS


DSM-5 TASK FORCE

Dennis Dowling, DO NBOME

Jeffrey Frey, DO MSUCOM


R. Gregory Lande, DO Walter Reed National Military Med. Ctr.


Ronald Paolini, DO* Eisenhower Army Med. Ctr.

Robert Piccinini, DO Associates in Psychiatry


Paul R. Rennie, DO TUNCOM

Mark Sandhouse, DO NSU-COM

David Shoup, DO AzCOM/MWU

Stevan Walkowski, DO OU-HCOM

Barbara zajdel, DO Botsford Hospital

SUBCOMMITTEE ON PHARMA AD ITEMS

Richard E. Reese, DO UNECOM

John L Szarek, PhD The Commonwealth Medical College

John E Thornburg, DO, PhD* MSUCOM

TASK FORCE ON FACILITIES AND SPACE PLANNING

James Andriole, DO


Gary R. Clark


Lori Kemper, DO, MS AzCOM/MWU



TASK FORCE ON UNLEASHING THE POWER OF OUR INFORMATION

Gary R. Clark




Richard LaBaere, DO, MPH* ATSU/KCOM

Geraldine T. O'Shea, DO Foothills Women's Med. Ctr.


Natalie Pantaleo Smoley, MA NBOME

USAGE AND STYLE SUBCOMMITTEELaurie Gallagher, DO NBOME


Jonathan King, DO, JD* RVUCOM


HPDP/HCD

HPDP/HCD ITEM REVIEW COMMITTEE


Paul C. Dew, MD, MPH Kansas City Health Dept.

Joanna L. Drowos, DO, MPH, MBA Charles E Schmidt College of Medicine - FAU

James E. Foy, DO* TUCOM-CA

Alan Glaros, PhD KCUMB-COM

Kristine Healy, MPH, PA-C Northwestern University Feinberg School of Medicine


Mary E. Malcom, DO

Ali Moradi, MD, MPH, TM LECOM Bradenton

Elizabeth Petsche, JD MSUCOM

Patricia S. Sexton, DHEd ATSU/KCOM

Suporn Sukpraprut, PhD, MSc, MA VCOM-VC

LABORATORY VALUES TASK FORCE

Duane T. Brandau, DO, PhD RVUCOM


Erik Langenau, DO PCOM


Jack S. Moskowitz, DO


Rex Wilford, DO, RPh Summa Health System

OSTEOPATHIC PRINCIPLES & PRACTICE

OPP/OMM APPROVED ITEM REVIEW


William Devine, DO AzCOM/MWU

Sharon M. Gustowski, DO, MPH UNTHSC/TCOM

Drew Lewis, DO DMU-COM

Randy G. Litman, DO* UP-KYCOM

Kate McCaffrey , DO Western U/COMP

William F. Morris, DO CUSOM


Victor Nuño, DO TUCOM-CA

OPP/OMM NEW ITEM REVIEW



Robin R. Dyer, DO OSU-COM

Walter C. Ehrenfeuchter, DO GA-PCOM


Kelly David Halma, DO ATSU/KCOM

David G. Harden, DO VCOM-VC

Jan T. Hendryx, DO LECOM

Jonathon Kirsch, DO ATSU-SOMA

Randy G. Litman, DO* UP-KYCOM

Item Writers andCase Author of theYearThe NBOME undertook an objective evaluation of the more than 290 item writers and the many caseauthors who contributed to the COMLEx-USA examination series in the last annual testing cycle andselected the Item Writers and Case Author of the Year:

ITEM WRITER OF THE YEAR

COMLEX-USA Level 1 Jonathan K. Kalmey, PhDLake Erie College of Osteopathic Medicine

CASE AUTHOR OF THE YEAR

COMLEX-USA Level 2-PE D. Thomas Dayberry, DO, PhDUniversity of North Texas HealthScience Center at Fort Worth

Texas College of OsteopathicMedicine


COMAT Examination Joel Dickerman, DOSt. Mary Corwin Hospital


COMLEX-USA Level 3 Jeff Rabrich, DOSt. Luke’s - Roosevelt Hospital Center


COMLEX-USA Level 2-CE Brett Stecker, DOTristan Medical


Osteopathic Principles and Practices Michael Terzella, DONew York College of Osteopathic Medicine

New York Institute of Technology


Health Promotion & Disease Prevention Shawna R. Duncan, DO, FACOPOklahoma State University Center for Health Sciences

College of Osteopathic Medicine

2013ITEM WRITERS



Ronald Paolini, DO Eisenhower Army Med. Ctr.

Jamie Rapacciuolo, DO RowanSOM

Holly Ray, DO



Ryan Smith, DO Dartmouth Medical School


Lena Weinman, DO Ingham Regional Medical Center

Paul Whitham, DO Utica Park OB/GYN

John Williamson, MD LMU-DCOM

Sheldon Yao, DO NYIT-COM

Anna Yeung, DO WesternU/COMP

COMLEX-USA LEVEL 1

Samina Akbar, PhD MU-COM

Kenneth Alonso, MD Morehouse School of Medicine

Mary Beth Babos, RPh, PharmD, CDE LMU-DCOM

Mark Best, MD, MBA, MPH LECOM Bradenton

xiaoning Bi, MD, PhD WesternU/COMP

Michael Bradbury, PhD LECOM

Duane Brandau, DO, PhD RVUCOM

Kristie Bridges, PhD WVSOM


Gerald Call, PhD AzCOM/MWU

Neal Chamberlain, PhD ATSU/KCOM

Yingzi Chang, MD, PhD ATSU/KCOM

Allison Chatterjee, PhD MU-COM

James Cox, PhD ATSU/KCOM

Camille DiLullo, PhD PCOM

Amber Eade, PhD LECOM at Seton Hill

Keith Elmslie, PhD ATSU/KCOM

Terry Else, PhD, MT, (AMT) TUNCOM

Edward Finnerty, PhD, SC(ASCP), NAOME DMU-COM

Charles Fleschner, PhD ATSU/KCOM

James Foster, PhD ACOM

David Gardner, PhD ΜU-COM

Gregory Gayer, PhD TUCOM-CA

Walter Gearheart, PhD UP-KYCOM

Leslie Goldstein, PharmD NYIT-COM

Amber Heck, PhD RVUCOM

Kenneth Hentschel, DO, PhD St. Vincent's Spine and Brain Institute

Evan Hermel, PhD TUCOM-CA

Jose Hernandez, PhD AzCOM/MWU

Mark Hernandez, PhD ACOM

Jennifer Hotzman, PhD WCU-COM

Alice Hudder, PhD LECOM

ADVANCED ITEMS

Edward Barnes, MD WesternU/COMP

Craig Stephen Boisvert, DO WVSOM

Michelle F. DeVoe, DO




Ronald Januchowski, DO VCOM-CC

Wayne Reynolds, DO

Brett Stecker, DO Tristan Medical

Patrick Woodman, DO, MSCR ΜU-COM

COMAT

Barbara Atkinson, DO, MA UNTHSC/TCOM

Sheryl Bushman, DO NYU Langone Med. Ctr.


Leah Cobb-Snodgrass, MD Hazard ARH Regional Medical Center

Jonathan Colen, DO

Ronna Compton, DO University of Louisville School of Medicine


Darrin D'Agostino, DO, MPH UNTHSC/TCOM

Joel Dickerman, DO Saint Mary Corwin Hospital

Gary Doublestein, DO, COL, MC-USAR Mercy Health Partners

Kathryn Edwards, MD

Justin Faden, DO RowanSOM

Craig Gudakunst, DO MSUCOM

Peter Gulick, DO MSUCOM

James Horst, DO

Jacqueline Kaari, DO RowanSOM

Joseph Kaczmarczyk, DO PCOM


David Kermode, DO Knoxville Hospitals & Clinics

Stephen Laird, DO ATSU/KCOM




Richard Magie, DO KCUMB-COM

Tracy Middleton, DO AzCOM/MWU

Steve Miller, DO, MPH LMU-DCOM

Thomas Mohr, DO RVUCOM

William Morris, DO CUSOM

Doris Newman, DO NSU-COM

2013ITEM WRITERS LISTING


Rami Ibrahim, MSc, PharmD MSUCOM

Manish Issar, PhD WesternU/COMP

T. Bucky Jones, PhD AzCOM/MWU

Jonathan Kalmey, PhD LECOM

Raj Kandpal, PhD WesternU/COMP

Frances Kennedy, DVM, MS MSUCOM

Schoen Kruse, PhD RVUCOM

Randy Kulesza Jr., PhD LECOM

Min-Hao Kuo, PhD MSUCOM

Bryan Larsen, PhD MU-COM


Kathy LePard, PhD CCOM/MWU

Alyse Ley, DO MSUCOM

Kathryn Leyva, PhD AzCOM/MWU

Kathryn Lovell, PhD MSUCOM

Sean Lynch, PhD CCOM/MWU

Blaine Maley, PhD MU-COM

Beth Mapow, DO Drexel University College of Medicine

Sarah McCarthy, PhD LECOM

Paul McCulloch, PhD CCOM/MWU

William McIntosh, DO UNTHSC/TCOM

Christina McManus, PhD ACOM


Katherine Mitsouras, PhD WesternU/COMP

Shin Murakami, PhD TUCOM-CA

Swapan Nath, PhD LECOM

Marie Nguyen, DO WesternU/COMP

Kathleen O'Hagan, PhD CCOM/MWU

Cyrus Parsa, DO WesternU/COMP

Charles Pavia, PhD NYIT-COM

Robin Pettit, PhD ATSU/SOMA

Balbina Plotkin, PhD, MEd CCOM/MWU

Milton Pong, PhD ATSU/SOMA

Samuel Pope, PhD, JD UP-KYCOM

Pamela Potter, PhD AzCOM/MWU

M. Renee Prater, DVM, MS, PhD VCOM-VC

James Rechtien, DO, PhD MSUCOM


Neil Sargentini, PhD ATSU/KCOM

Joyce Savage, DO, MS CCOM/MWU

Beatrice Saviola, PhD WesternU/COMP

Martin Schmidt, PhD DMU-COM

Shirley Siew, MD MSUCOM

Vineet Singh, PhD ATSU/KCOM

Michelle Singleton, PhD CCOM/MWU

Heather Smith, PhD AzCOM/MWU


Eric Spokas, PhD

Melissa Stuart, PhD ATSU/KCOM

John Taylor, PhD KCUMB-COM

Tracey Taylor, PhD KCUMB-COM

Robert Theobald, PhD ATSU/KCOM

Emily Thomas, DO WVSOM

Megan Thomas, PhD

Kathryn Thompson, PhD UNECOM

Helga Toriello, PhD

Lex Towns, PhD PNWU-COM

Vishwanath Venketaraman, PhD WesternU/COMP

Gordon Wahler, PhD CCOM/MWU

Margaret Wilson, DO ATSU/KCOM

Stanley Wong, PhD WesternU/COMP

Ted Wong, PhD WesternU/COMP

Bruce Wright, PhD KCUMB-COM

Richard Wyeth, PhD VCOM-CC

Naunihal zaveri, PhD LECOM Bradenton

Li zhong, PhD WesternU/COMP

COMLEX-USA LEVEL 2-CE

Dennis Agostini, DO, PhD CUSOM

Kenneth Alonso, MD Morehouse School of Medicine

Amy Arnold, DO South Pointe Hospital

John Boccio, DO Beth Page Primary Care

Natasha N. Bray, DO NSU-COM

Draion Burch, DO University of Pittsburgh

Christine Clary, DO OSU-COM

Joshua Coren, DO, MBA RowanSOM

Rocco Crescenzo, DO PCOM

Carmella D'Addezio, DO

Joseph DeGaetano, DO, MSEd NSU-COM

John Dougherty, DO KCUMB-COM

William Downs, DO Monmouth Medical Center

Harriett Fellows, DO

Charles A. Finch, DO AzCOM/MWU

Mark Gabay, DO NSU-COM

Michael Geria, DO Inspira Health Network


Eric Greenfield, DO Huntsville Hospital

Michael Guma, DO St Michael's Medical Center

Gregory Hellier, DO LECOM

James C. Jones, DO WesternU/COMP

Ami Joshi, DO, MBA Pennsylvania Hospital

Michelle Langaker, DO CUSOM


HEALTH PROMOTION/DISEASE PREVENTIONHEALTH CARE DELIVERY

Tiffany L. Alley, PhD LMU-DCOM

Ronald Berezniak, PhD LECOM Bradenton

Mark Best, MD, MBA, MPH LECOM Bradenton

Rajivinder S. Brar, DO, PhD WesternU/COMP


David Canton, DO, MPH, JD TUCOM-CA

Meredith Davison, PhD, MPH OSU-COM

Paul Dew, MD, MPH Kansas City Health Dept.

Joanna Drowos, DO, MPH, MBA FAU - Schmidt College of Medicine

William Elliott, MD, PhD PNWU-COM

James Foy, DO TUCOM-CA

Katherine Galluzzi, DO, CMD PCOM

Alan Glaros, PhD KCUMB-COM

Oliver Hayes, DO, MPH Genesys Regional Med. Ctr.

Kristine M. Healy, MPH, PA-C Northwestern University Feinberg School of Medicine

Brian Kessler, DO CUSOM


Peg Lechner, MS, RN CCOM/MWU

Joy Lewis, DO, PhD ATSU/SOMA

Rubin Lin, DO, MSHS-HPE

Philip Malouf, MD TUCOM-CA

Cynthia Mears, DO CCOM/MWU

Ali Moradi, MD, MPH, TM LECOM Bradenton

Elizabeth Petsche, JD MSUCOM

Lawrence Sands, DO, MPH AzCOM/MWU

Patricia Sexton, DHEd ATSU/KCOM

Richard Snow, DO, MPH OU-HCOM

Ava Stanczak, DO LMU-DCOM

Suporn Sukpraprut, PhD, MSc, MA VCOM-VC

Judith Thierry, DO, MPH Maternal and Child Health Bureau

Alesia Wagner, DO TUCOM-CA

Roberta Wattleworth, DO, MHA, MPH DMU-COM

OSTEOPATHIC PRINCIPLES & PRACTICE

Reem Abu-Sbaih, DO NYIT-COM

Aisha Bailey, DO RowanSOM

Jonathan Bruner, DO MSUCOM

Elizabeth Caron, DO NYIT-COM

Andrea Clem, DO CCOM/MWU


Jay Danto, DO ATSU/KCOM

Brett DeGooyer, DO PNWU-COM

Amanda Laubenthal, DO

Brookshield Laurent, DO NYIT-COM


Brett Lindgren, DO MCMC

Jed Magen, DO, MS MSUCOM

Michael Mount, DO Spartanburg Regional Healthcare System

Joseph Nemcok, DO Osteopathic Ob-Gyn Inc.

Edward Packer, DO NSU-COM

Steven Perkins, DO Mayo Clinic Health System

Paul Petry, DO Freeman Pediatric Care

James Powers, DO VCOM-VC

Sara Ragsdale, DO Newport Hospital

Surinder Rai, DO Brookhaven Memorial Med. Ctr.

Roy Reeves, DO, PhD University of Mississippi

Laura Rhee, DO

Peter Rhee, DO Mayo Clinic

Craig Rush, DO, MS Stairways Behavioral Health

Richard Schulz, DO, MBA

Pierce Sherrill, DO Aurora Baycare Occupational Health

Nicole Shields, MD LMU-DCOM

Ryan Smith, DO Dartmouth Medical School

Ricaurte Solis, DO Georgia Health Sciences University

Belinda Stillman, DO Stairways Behavioral Health

Melodie Stocks, DO Northeast Regional Health Council

Dominic Valentino, DO Mercy Catholic Med. Ctr.

Greg Warren, DO Albemarle Nephrology

Patrick Woodman, DO, MSCR MU-COM

COMLEX-USA LEVEL 3

Shirin Clark, DO Sparrow Hospital

Michelle DeVoe, DO

Michael Fabbro, II, DO

Michael Hunt, DO St. Vincent’s Health Partners, Inc.

Mollie James, DO, MPH

Glenn Nordehn, DO CCOM/MSW


Frank Paul, DO

Jaime Rawson, DO 673d MDOS/SGOMN

Gregory Reinhold, DO MSUCOM

Theodore Spevack, DO

Emily Thomas, DO WVSOM

H. Lauren Vogel, DO

2013ITEM WRITERS LISTING


Theodore Flaum, DO NYIT-COM

Regina Fleming, DO ATSU/KCOM

Thomas Fotopoulos, DO LECOM

David Fuller, DO PCOM

Rich Geshel, DO

Rebecca Giusti, DO Western U/COMP

Edward Goering, DO, DVM, MSHPE Western U/COMP

Sharon Gustowski, DO, MPH UNTHSC/TCOM

Simeon Hain, DO OU-HCOM

Kelly Halma, DO ATSU-KCOM

David Harden, DO VCOM-VC

Deborah Heath, DO ATSU/SOMA

Kurt Heinking, DO CCOM/MWU

Greg Heller, DO AzCOM/MWU

Michelle Hobson, DO PCOM

Ronald Januchowski, DO VCOM-CC

David Kanze, DO RVUCOM

Robert Kessler, DO TUNCOM

Patricia Kooyman, DO NYIT-COM

Andrew Kusienski, DO NSU-COM

Charles Lehnardt, DO ATSU/KCOM

To Li, DO NYIT-COM

Randy Litman, DO UP-KYCOM

Michael Lockwood, DO ATSU/KCOM

Jayme Mancini, DO NYIT-COM

William Morris, DO CUSOM

Alexander Nicholas, DO PCOM

Evan Nicholas, DO PCOM



Melissa Pearce, DO TUCOM-CA

Yasmin Qureshi, DPT, MHS NSU-COM

Carlton Richie, III, DO

Luke Robinson, DO OU-HCOM

Mark Sandhouse, DO NSU-COM

Gregory Sayegh, DO RowanSOM

Bob Schneider, DO ATSU/KCOM

Shannon Scott, DO AzCOM/MWU

Eva Shay, DO LMU-DCOM

Richard Sloan, DO WCU-COM

Peter Sprague, DPT NSU-COM

Billy Strait, DO ATSU/KCOM

Michael Terzella, DO NYIT-COM

Jonathan Torres, DO RowanSOM

Elaine Wallace, DO OSU-COM

Tony Will, DO AzCOM/MWU

Sue Yang-Novellino, DO RowanSOM

Sheldon Yao, DO NYIT-COM

Barbara zajdel, DO Botsford Hospital

A Key to Colleges of Osteopathic Medicine


ACOM Alabama College of Osteopathic Medicine

ATSU-KCOM A.T. Still University-Kirksville College ofOsteopathic Medicine

ATSU-SOMA A.T. Still University-School ofOsteopathic Medicine in Arizona

AZCOM/MWU Arizona College of OsteopathicMedicine of Midwestern University

CCOM/MWU Chicago College of Osteopathic Medicineof Midwestern University

CUSOM Campbell University School of OsteopathicMedicine

DMU-COM Des Moines University College ofOsteopathic Medicine

KCUMB-COM Kansas City University of Medicine andBiosciences College of Osteopathic Medicine

LECOM Lake Erie College of Osteopathic Medicine

LECOM Bradenton Lake Erie College of OsteopathicMedicine Bradenton Campus

LMU-DCOM Lincoln Memorial University-DeBuskCollege of Osteopathic Medicine

MSUCOM Michigan State University College ofOsteopathic Medicine

MU-COM Marian University College of OsteopathicMedicine

NSU-COM Nova Southeastern University College ofOsteopathic Medicine

NYIT-COM New York College of Osteopathic Medicineof New York Institute of Technology

OSU-COM Oklahoma State University Center forHealth Sciences College of Osteopathic Medicine

OU-HCOM Ohio University Heritage College ofOsteopathic Medicine

PCOM Philadelphia College of Osteopathic Medicine

GA-PCOM Georgia Campus-Philadelphia College of Osteopathic Medicine

PNWU-COM Pacific Northwest University of HealthSciences College of Osteopathic Medicine

Rowan-SOM Rowan University School of OsteopathicMedicine

RVUCOM Rocky Vista University College ofOsteopathic Medicine

TouroCOM-NY Touro College of OsteopathicMedicine-New York

TUCOM-CA Touro University College of OsteopathicMedicine - California

TUNCOM Touro University Nevada College ofOsteopathic Medicine

UNECOM University of New England College ofOsteopathic Medicine

UNTHSC/TCOM University of North Texas HealthScience Center at Fort Worth Texas College ofOsteopathic Medicine

UP-KYCOM University of Pikeville Kentucky College of Osteopathic Medicine

VCOM-CC Edward Via College of Osteopathic Medicine - Carolinas Campus

VCOM-VC Edward Via College of Osteopathic Medicine - Virginia Campus

WCU-COM William Carey University College ofOsteopathic Medicine

Western U/COMP Western University of HealthSciences/College of Osteopathic Medicine of the Pacific

WVSOM West Virginia School of Osteopathic Medicine

The National Board of Osteopathic Medical Examiners (NBOME) is exempt from income taxes under Section 501(c)(3) of the Internal Revenue Code. In addition, NBOME qualifiesfor the charitable contribution deduction under Section 170(b)(1)(A) and has been classified as an organization other than a private foundation under IRC Section 509(a).

© Copyright 2014 | NBOME

Executive Offices – Suite 230National Center for Clinical Skills Testing – Suite 150

101 West Elm StreetConshohocken, PA 19428

Phone: 610.825.6551

Chicago Corporate Offices & Conference Center8765 West Higgins Road, Suite 200

Chicago, IL 60631Phone: 773.714.0622

www.nbome.org

National Board of Osteopathic Medical Examiners

2013 Annual Report - NBOME · 2014-05-02 · 2 Message from: Wayne R. Carlsen, DO, Board Chair and...

Documents

Transcript of 2013 Annual Report - NBOME · 2014-05-02 · 2 Message from: Wayne R. Carlsen, DO, Board Chair and...