Presented by

edTPA Data Summit – June 2014Diana B. Lys

What brings us together?

Our Starting Point

Goal of the Data SummitJune 2013

Review Unit and Program Level edTPA Data to Develop Priority

Questions to Guide edTPA Work in 2013-14

What is a Priority Question?

Priority Questions have these characteristics:– Be generated from a collaborative process that engages

most of the people working to address the question– Is focused on educational matters, other student-

related issues beyond the school’s control– Serves a narrow focus of inquiry, a SLO, a rubric, a

standard– Accounts for the unit’s current resources and

represents something the faculty want to investigate

(from Data Wise: Boudett, City, and Murname, 2010)

Priorities for 2013-14

First Priority

What courses inside and outside of the

program teach feedback/

assessment?

To what extent, if any do the professional

core courses support our students

and programs?

Second Priority

What standardization do we have in intern

final grading?

Why are there disparities among the

different program pathways?

Third Priority

How do we improve local scoring?

Data Summit 2013 Survey

Break out to feedback survey on last year’s edTPA Data Summit.

http://bit.ly/1ktmxjK

Goal of the Data Summit

Expand our edTPA Data Summit to link preservice performance assessments with other teacher preparation program performance metrics to build a “chain of evidence”

Model data utilization protocols for use at the program level.

Today we will…

Examine three unit-level datasets Begin to examine edTPA scores– Local evaluation v. Pearson scores

Examine one edTPA portfolio, in-depth, with a focus on Task 2

Next Steps, but Not Today

If question or idea does not align with today’s goal, write it on a post-it and post on the “Next Steps, but Not Today” board– Process/procedural questions would fall into this

category:• Local scoring protocols• Due dates• Licensure expectations

Principles Guiding the edTPA Data Summit

ACE Habits

Shared Commitment to Action, Assessment and Adjustment

Intentional Collaboration

Relentless focus on Evidence

Norms for Collaborative Work

Assume positive intentions Take an inquiry stance Ground statements in evidence

Logistics

To be comfortable… Breaks

– Morning Break– Lunch

Restrooms Phones

To support our work… Wireless Log-in Nearpod Google docs TracDat

Find a Partner

Quadrant Partner #1 – own program, if possible

Quadrant Partner #2 – different program

Quadrant Partner #3 – different college

Quadrant Partner #4 – free choice

Let’s Move!

Find your Quadrant Partners, #1-4

Find a table with QP#2

Move to your first table & Take your stuff

PART 1: DATA EXPLORATION

Expanding the Data Summit

A little background…

Teacher education programs are required to collect many key assessments about their candidates (CAEP, 2013).

In Initial Teacher Preparation (ITP) programs, some examples include:– edTPA– Progress Report– Dispositions forms

Research literature tells us to…

Include performance assessments (Darling-Hammond, 2006); standardized performance assessments are even better (Peck, et al., 2014).

Include data from preservice and inservice sources (Diez, 2010).

Engage faculty in data utilization (Peck & McDonald, 2013).

Develop “culture of evidence” (Peck & McDonald, 2013) and “chains of evidence” (Cochran-Smith, 2005) to support faculty leaders in programmatic improvement.

Today’s Data Parfait

Priority Questions

IHE Report Card

Exit Survey

edTPA

Datasets for Examination

ECU Local Evaluation edTPA Scores (Spring 2014)

– Unit level aggregate of final scores and other tables repeated from June 2013 edTPA Data Summit

– http://bit.ly/1pCqPZv

Datasets for Examination

Initial Licensure Teacher Education Exit Survey Data (Spring 2014)

– Includes all pathways in the licensure area– Excludes open ended responses

Datasets for Examination

IHE Report Cards, 2011-12 and 2012-13– Unit level data only

What is a Priority Question?

Priority Questions have these characteristics:– Be generated from a collaborative process that engages

most of the people working to address the question– Is focused on educational matters, other student-

related issues beyond the school’s control– Serves a narrow focus of inquiry, a SLO, a rubric, a

standard– Accounts for the unit’s current resources and

represents something the faculty want to investigate

(from Data Wise: Boudett, City, and Murname, 2010)

Priority Question Formulation, pt.1

With colleagues at your table:1. Assign a RECORDER and a REPORTER 2. Review assigned dataset, individually and as a

group3. Consider Guiding Questions and RECORD

responses/findings4. Examine findings and generate Priority Questions5. Discuss and Prioritize Questions – select Top 36. Record Top 3 Priority Questions

Priority Question Formulation, pt. 2Refine the Priority Questions:1. Join with the other table2. REPORT out on Top 3 Priority Questions

1. Share rationale behind each

3. Question the questions:1. Are these the right questions?2. Is there consensus across the unit?3. What supports are needed?

4. Refine Top 3 Priority questions for the Combined Group and Assign a final REPORTER

Report Out on Priority Questions

Priority Questions

IHE Report Card

Exit Survey

edTPA

Priorities for 2014-15

edTPA Local Eval Scores

UG Exit Survey Data

IHE EPP Report Card

Data Set Questions

Please fill out your top 3 questions about your data set.

http://bit.ly/1v9o547

Let’s take a break!

Check email and catch up with the world…

Special thanks to the OAA team to preparing for today’s Data Summit– Mary Worthington– Ellen Dobson– Jason Whited– Mary Langley, GA

When we return,find a seat with

Quadrant Partner #1

PART 2:EDTPA FOCUS

ECU Local Evaluation Scores v. Pearson Scores

Before we dig…

ECU Local Evaluation Scores Pearson Scores

Limitations

BIG Question

So, how did we do??

ECU v. Pearson Raw Scores

ECU v. Pearson Standardized Scores

Evaluators

Preliminary Priority Questions

1. Review assigned dataset, individually and as a team

2. Consider Guiding Questions and RECORD responses/findings

3. Be prepared to share with larger group

4. This is just a peek.

PART 3:DIGGING DEEPER

Finding common ground in Task 2

Examining Task 2

Why Task 2? Portfolio selection

http://bit.ly/1l2Gmyu

Link to Sample Portfolio, Task 2

Password is summit2014

http://bit.ly/1mhwi0K

CLOSING OUT

Data Summit 2014 FEEDBACK

Please fill out the feedback survey for the 2014 Data Summit

http://bit.ly/1lZrd2Q

THANK YOU!!