Perkins Accountability I Secondary and Postsecondary

OverviewSeptember 15, 2011

JoAnn Simser Susan Carter & Denise Roseland

State Director, CTE Office of the ChancellorSystem Director, Perkins Grant susan.carter@so.mnscu.edu

joann.simser@so.mnscu.edu denise.roseland@so.mnscu.edu

Dan Smith Marlys BucherSupervisor, Adult and Career EducationCenter for Postsecondary Success

CTE Assessment/Evaluation Perkins CoordinatorCenter for Postsecondary Success

dan.smith@state.mn.us marlys.bucher@state.mn.us

Slide 2

Review the secondary & postsecondary accountability indicators-- definitions-- data sources-- changes from previous year

Discuss the Local Negotiation Process for FY12 and FY13

Goals

Slide 3

Secondary Data Sources

Student Data Collected Annually

• Collected using EDEN (MCCC)

• Data match with the Office of Higher Education and with employment data from Department of Employment and Economic Development (DEED)

• Technical Skill Assessment results

Slide 4

Secondary Definitions

Secondary Participant: an individual who has participated in career and technical education courses in one career field for 100 hours or more

Secondary Concentrator: an individual who has participated successfully (passing grade) in career and technical education courses in one career field for 240 hours or more

Secondary Completer: a secondary concentrator who graduates from high school

Slide 5

Postsecondary Data Sources

• Student data from the system’s Integrated Student Record System (ISRS)

• Transfer data from the National Student Clearinghouse

• Employment information from the system Graduate Follow-up process and from DEED

• Licensing board and Technical Skill Assessment results

Slide 6

Postsecondary Data Structure

Minnesota is one of a handful of states to use a cohort model. The use of cohorts aligns with other system initiatives and reporting.

Spring 2010

Summer 2009

Spring 2011

Summer 2010

FY

09

Coh

ort

Perkins IV: Entry Cohort Reporting

Spring 2009

Fall 2009

Fall 2010

FY 2009 FY 2010 FY 2011

Spring 2010

Enter in Fall

2008

Spring 2011

Summer 2010

Spring 2009

Fall 2009

Fall 2010

Spring 2010

Spring 2011

Summer 2010

Enter in Spring 2009

Fall 2009

Fall 2010

Fall 2008

Enter in Summer

2008

Summer 2009

Summer 2009

For example, the FY2009-2011 cohort includes students entering in FY2009 and tracked for three years: 2009, 2010, and 2011

Slide 7

Postsecondary Definitions

Postsecondary Participant: a student taking a CTE course OR who has a Perkins eligible major

Postsecondary Concentrator: a student with a Perkins eligible major who has declared a CTE award (AAS, AS, Certificate, Diploma) and has earned 12 or more credits OR who has received an award in a short term Perkins eligible program (less than 12 credits)

Postsecondary Completer: a student who has received an award (AAS, AS, Certificate, Diploma) in a Perkins eligible program

Slide 8

Final Agreed Upon Performance Levels (FAUPL)

State Negotiated Performance Level – Accountable in Dec. 2011 CAR

State Negotiated Performance Level – Accountable in Dec. 2012 CAR

Definitions for Core Indicators State Negotiated Performance Levels

Definitions for Core Indicators

Indicator

Slide 9

1S1 Academic Attainment – Reading Language

Arts

1S2 Academic Attainment – Mathematics

Perkins Core Indicators Academic Attainment

Secondary

NonePostsecondary

Slide 10

2S1 Technical Skill Attainment

Perkins Core Indicators Technical Skill Attainment

Secondary

Postsecondary

1P1 Technical Skill Attainment

For more information on Technical Skills Assessments, visit:

http://www.cte.mnscu.edu/programs/mntsa.html

Slide 11

Career Pathways Currently Expected to Implement Technical Skill Assessments within courses under Perkins IV:

• AGRICULTURE, FOOD, & NATURAL RESOURCES Animal Systems Plant Systems

• ARTS, COMMUNICATIONS, & INFORMATION SYSTEMS

Printing Technology

Visual Arts

• BUSINESS, MANAGEMENT, & ADMINISTRATION

Accounting

Marketing Management

Merchandising

Professional Sales

• ENGINEERING, MANUFACTURING, & TECHNOLOGY

Engineering and Technology

Facility and Mobile Equipment Maintenance

• HEALTH SCIENCE TECHNOLOGY

Diagnostic Services

Therapeutic Services

• HUMAN SERVICES

Early Childhood Education (Early Childhood Development and Services AND Teaching/Training (Birth to Gr 3)

Law Enforcement Services

• FOUNDATION KNOWLEDGE & SKILLS

Slide 12

3S1 School Completion

Perkins Core Indicators Completion/Graduation

Secondary

Postsecondary

2P1 Credential, Certificate or Degree

4S1 Student Graduation Rate (NCLB)

Slide 13

None

Perkins Core Indicators Student Retention or Transfer

Secondary

Postsecondary

3P1 Student Retention or Transfer

Slide 14

5S1 Placement

Perkins Core Indicators Placement

Secondary

Postsecondary

4P1 Student Placement

Slide 15

6S1 Nontraditional Participation

Perkins Core Indicators Nontraditional Participation

Secondary

Postsecondary

5P1 Nontraditional Participation

Slide 16

6S2 Nontraditional Completion

Perkins Core Indicators Nontraditional Completion

Secondary

Postsecondary

5P2 Nontraditional Completion

Slide 22

State and Local Negotiations

OVAE/State Negotiations

Evaluation of State Performance -- Improvement Plans

State/Local Consortia Negotiations

Evaluation of Local Performance -- Improvement Plans

Slide 23

OVAE/State Negotiation Process for 2012 and 2013

Initial OVAE Proposal for FY2012 and FY2013

March 2011

Deadline for State Response March 2011

OVAE Review of State Proposed Levels

April – June 2011

Final FAUPL (Final Agreed Upon Performance Levels)

June 2011

Evaluation of Performance 2012 & 2013 CAR

Slide 24

State/Local Consortia Negotiation Process for FY2012 Targets

Target Date

Development of State Proposed Targets

September 2011

Distribution of Proposed Targets to Local Consortia

October 18, 2011

Accountability Workshop OverviewSecondary Postsecondary

September 15, 2011September 22, 2011September 29, 2011

Consortia Responses Due November 16, 2011

Initial State Response November 29, 2011

Negotiations Completed December 9, 2011

Evaluation of Performance January 2013

Slide 25

Negotiating Your Targets

Review the proposed targets

Look at your data

– trends/preliminary data if available

Discuss the targets with your partners

– any changes in policy or practice that may affect

performance outcomes?

Understand the context and rationale for the proposed targets• Expectation of continuous improvement at the state and

local level

• Need for the state to be able to meet state targets negotiated with OVAE

Slide 26

Negotiating Your Targets

Determine if you will accept the proposed targets or will propose alternatives.

If you accept the state proposals--• Return the Negotiated Performance for

FY12-13 form

• Include BOTH secondary and postsecondary signatures

If you don’t accept the state proposals--• Notify the state

• Submit alternative target(s) along with the rationale for the proposed alternative(s).

Slide 27

Factors in State Review of Consortia Proposed Targets

Rationale provided by the consortium

Trend data

Impact of proposed alternatives on the ability of the state to meet the state negotiated target

Slide 28

Improvement Plans

The language in the Act regarding improvement plans and the withholding of funds is very similar for states and local recipients.

Section123(a)(1): State Improvement Plan

Section 123(a)(3)(A): Withholding State Funds

Section123(b)(2): Local Improvement Plan

Section 123(b)(4)(A): Withholding State Funds

State Local

Slide 29

State Improvement Plan Requirement

…fail to meet at least 90 percent of an agreed upon State adjusted level of performance for any of the core indicators……develop and implement a program improvement plan (with special consideration to performance gaps within subgroups) …during the first program year succeeding the program year for which the state failed to meet the performance level.

Section 123(a)(1)–Failure to Meet Agreed Upon State Level of Performance

Slide 30

Local Improvement Plan Requirement

Section 123(b)(2)–Failure to Meet Agreed Upon Local Level of Performance

…fail to meet at least 90 percent of an agreed upon State adjusted level of performance for any of the core indicators……develop and implement a program improvement plan (with special consideration to performance gaps within subgroups) …during the first program year succeeding the program year for which the local recipient failed to meet the performance level.

Slide 31

Withholding of Funds

Section 123(a)(3)(A) … the Secretary may withhold all or a portion the state’s administrative and leadership funds if a state …

Fails to implement an improvement plan. Fails to make any improvement within the

first program year of implementation of the improvement plan.

Fails to meet at least 90% of an agreed upon performance level for three consecutive years.

Section 123(b)(4)(A) … the State may withhold all or a portion of a local recipients funding if the local recipient…

Slide 32

Withholding of Funds–State & Local

Sanctions may be waived due to exceptional or uncontrollable circumstances.

Withheld funds are to be used to provide technical assistance.

Plans are underway to develop statewide technical assistance for all core indicators by consortia.

Slide 33

Evaluation of Performance – Local

Negotiated Level

90% of Negotiated Level

At or above target –

No action

Below 90% of target – Perkins Law requires an

Improvement Plan

Below target, but above 90% threshold

Report Required

Slide 34

Components of a Performance Improvement Plan and Report

Examination of the data—comparison of the target level and actual performance (incl. subgroups)

Context—an explanation of why the target was not met

Identification of general strategies to address performance gaps.

Specific actions to be taken to improve performance and to help the consortium meet negotiated targets in subsequent years.

Needed to complete

both Improvement reports and

improvement plans

Needed to complete

improvement plans only

Slide 35

Slide 36

TIME FOR YOUR QUESTIONS!

Please take a moment to enter your questions in the Chat field to the right.

Slide 37

Upcoming Accountability Webinars

Perkins Accountability II – Secondary Sept. 22, 20112:00 p.m. – 3:00 p.m.

Perkins Accountability II – Postsecondary Sept. 29, 20112:00 p.m. – 3:00 p.m.

To register, go to:www.cte.mnscu.edu/professionaldevelopment

Slide 38

Parting comments…

Thank you for all your valuable suggestions, diligent efforts and hard work to improve MN career and technical education for students, staff and employers.

Slide 39

Thanks for joining us today!

We value your feedback about today’s session. Please click on the link in

the chat window now to complete the session evaluation form.

 

REMINDER: For secondary participants, Continuing Education Units (CEU’s) will be made available for teachers and administrators for this series of webinars. In order to get the necessary certificates you MUST complete the session evaluation.