Roundtable Methodology and Standardization in an Experiential Learning Curriculum

1
Roundtable Methodology and Standardization in an Experiential Learning Curriculum Andrew N. Schmelz, PharmD and Jasmine D. Gonzalvo, PharmD, BCPS Purdue University School of Pharmacy, Indianapolis, IN OBJECTIVE DISCUSSION To develop standardized roundtable discussions across multiple geographic regions to provide PharmD Candidates with opportunities for professional development and educational advancement. BACKGROUND The Purdue University School of Pharmacy Experiential Learning curriculum currently includes monthly roundtable discussions, which are developed by Regional Faculty Coordinators (RFCs) in each region where PharmD Candidates complete rotations. RFCs are encouraged to design their own roundtable topics, which generally have been related to therapeutic topics or professional development. METHODS EVALUATION DESIGN A roundtable evaluation form was created based on validated questions from the PharmD Candidates Evaluation of Educational Quality (SEEQ). Evaluations assessed four major constructs, including: For each evaluation item, PharmD Candidates rated their levels of agreement on a 5-point scale (1 = strongly disagree; 2 = disagree; 3 = neutral; 4 = agree; 5 = strongly agree). DATA COLLECTION AND ANALYSIS The evaluation form was distributed at each roundtable in every geographic region by the RFCs. Evaluations were collected and were grouped based on roundtable topic. Summative scores for each construct were calculated (with a ANALYSIS OF RESULTS Roundtables covering interviewing skills, NAPLEX review, and therapeutic topics were rated highest overall by PharmD Candidates. Significantly lower scores for content (p = 0.03) and overall rating (p < 0.01) were noted with roundtables covering professional development topics. PharmD Candidates indicated highest prior interest in roundtable subject matter with roundtables covering interviewing skills and NAPLEX review. RECOMMENDATIONS Based on the results of the evaluations, standard core roundtable topics will be recommended to the RFCs. Each region would be required to host roundtable topics covering: Professional development roundtable topics would continue to be supported due to the overall high PharmD Candidate rating of this content. STRENGTHS The number of evaluations submitted (n=296) represents a large number of PharmD Candidates attending roundtables. Evaluations were completed anonymously, including questions from a validated course evaluation questionnaire. LIMITATIONS A larger number of evaluations for Therapeutic Topics and Professional Development than for other topics were collected and analyzed, increasing the potential for Type II error. Regional differences in number of roundtables offered may also influence outcomes. IMPLICATIONS Creation of core roundtable topics will provide Purdue PharmD Candidates completing rotations in any region with comparable educational experiences. Similarly, other colleges of pharmacy can develop a comparable model of standardized roundtables to provide PharmD Candidates with opportunities for PICTURE HERE Evaluation Construct No. of Questio ns Cronbac h alpha Content Evaluation 3 0.84 Group Interaction 3 0.92 Overall Rating 1 N/A Prior Interest 1 N/A RESULTS PRIMARY OUTCOME Two hundred ninety-six (n=296) evaluations were collected and included in the analysis. Mean scores are presented for each major roundtable topic: COMPARISON OF TOPICS To compare professional development and educational advancement topics, each grouping of roundtable topics was compared to “Therapeutic Topics” as one category. Independent sample t-tests are presented for these comparisons: Content Group Interact ion Overall Rating Prior Interest Professional Development p = 0.03 p = 0.70 p < 0.01 p = 0.16 Interviewing Skills p = 0.22 p = 0.94 p = 0.19 p < 0.01 NAPLEX Review p = 0.50 p = 0.04 p = 0.34 p < 0.01 Interviewing skills NAPLEX review One therapeutic topic 10 11 12 13 14 15 M eanConstruct Score ContentEvaluation Group Interaction 0 1 2 3 4 5 O verall Rating PriorInterest TherapeuticTopics Professional Dev. Interview ing Skills NAPLEX Review Other ROUNDTABLE TOPICS

description

ROUNDTABLE TOPICS. Roundtable Methodology and Standardization in an Experiential Learning Curriculum Andrew N. Schmelz, PharmD and Jasmine D. Gonzalvo, PharmD, BCPS Purdue University School of Pharmacy, Indianapolis, IN. PICTURE HERE. - PowerPoint PPT Presentation

Transcript of Roundtable Methodology and Standardization in an Experiential Learning Curriculum

Page 1: Roundtable Methodology and Standardization in an Experiential Learning Curriculum

Roundtable Methodology and Standardizationin an Experiential Learning Curriculum

Andrew N. Schmelz, PharmD and Jasmine D. Gonzalvo, PharmD, BCPSPurdue University School of Pharmacy, Indianapolis, IN

OBJECTIVE DISCUSSIONTo develop standardized roundtable discussions across multiple geographic regions to provide PharmD Candidates with opportunities for professional development and educational advancement.

BACKGROUND

The Purdue University School of Pharmacy Experiential Learning curriculum currently includes monthly roundtable discussions, which are developed by Regional Faculty Coordinators (RFCs) in each region where PharmD Candidates complete rotations. RFCs are encouraged to design their own roundtable topics, which generally have been related to therapeutic topics or professional development.

METHODS

EVALUATION DESIGNA roundtable evaluation form was created based on validated questions from the PharmD Candidates Evaluation of Educational Quality (SEEQ). Evaluations assessed four major constructs, including:

For each evaluation item, PharmD Candidates rated their levels of agreement on a 5-point scale (1 = strongly disagree; 2 = disagree; 3 = neutral; 4 = agree; 5 = strongly agree).

DATA COLLECTION AND ANALYSISThe evaluation form was distributed at each roundtable in every geographic region by the RFCs. Evaluations were collected and were grouped based on roundtable topic. Summative scores for each construct were calculated (with a maximum score of 15), as well as means and standard deviations. Cronbach alpha values were also calculated to verify internal consistency of evaluation items.

ANALYSIS OF RESULTSRoundtables covering interviewing skills, NAPLEX review, and therapeutic topics were rated highest overall by PharmD Candidates. Significantly lower scores for content (p = 0.03) and overall rating (p < 0.01) were noted with roundtables covering professional development topics. PharmD Candidates indicated highest prior interest in roundtable subject matter with roundtables covering interviewing skills and NAPLEX review.

RECOMMENDATIONSBased on the results of the evaluations, standard core roundtable topics will be recommended to the RFCs. Each region would be required to host roundtable topics covering:

Professional development roundtable topics would continue to be supported due to the overall high PharmD Candidate rating of this content.

STRENGTHSThe number of evaluations submitted (n=296) represents a large number of PharmD Candidates attending roundtables. Evaluations were completed anonymously, including questions from a validated course evaluation questionnaire.

LIMITATIONSA larger number of evaluations for Therapeutic Topics and Professional Development than for other topics were collected and analyzed, increasing the potential for Type II error. Regional differences in number of roundtables offered may also influence outcomes.

IMPLICATIONS

Creation of core roundtable topics will provide Purdue PharmD Candidates completing rotations in any region with comparable educational experiences. Similarly, other colleges of pharmacy can develop a comparable model of standardized roundtables to provide PharmD Candidates with opportunities for professional development and educational advancement.

PICTURE HERE

Evaluation Construct No. of Questions

Cronbach alpha

Content Evaluation 3 0.84Group Interaction 3 0.92

Overall Rating 1 N/APrior Interest 1 N/A

RESULTSPRIMARY OUTCOMETwo hundred ninety-six (n=296) evaluations were collected and included in the analysis. Mean scores are presented for each major roundtable topic:

COMPARISON OF TOPICSTo compare professional development and educational advancement topics, each grouping of roundtable topics was compared to “Therapeutic Topics” as one category. Independent sample t-tests are presented for these comparisons:

Content Group Interaction

Overall Rating

Prior Interest

Professional Development

p = 0.03 p = 0.70 p < 0.01 p = 0.16

Interviewing Skills p = 0.22 p = 0.94 p = 0.19 p < 0.01NAPLEX Review p = 0.50 p = 0.04 p = 0.34 p < 0.01Other p = 0.14 p < 0.01 p = 0.05 P = 0.05

• Interviewing skills• NAPLEX review• One therapeutic topic

10

11

12

13

14

15

Mea

n Co

nstr

uct S

core

Content Evaluation Group Interaction0

1

2

3

4

5

Overall Rating Prior Interest

Therapeutic Topics Professional Dev.Interviewing Skills NAPLEX ReviewOther

ROUNDTABLE TOPICS