Perkins Accountability I: Secondary and Postsecondary Overview

September 20, 2012

Goals

Gain an understanding of

• Secondary and postsecondary core indicators

• Definitions of participants, concentrators and completers

• Data sources• State and local negotiation process• Improvement plans and reports

Secondary Data Sources

Student Data Collected Annually

• Collected using EDEN (MCCC)

• Data match with the Office of Higher Education (OHE) and with employment data from Department of Employment and Economic Development (DEED)

• Technical Skill Assessment results

Secondary Definitions

Secondary Participant: 100 hours or more in one career field

Secondary Concentrator: 240 hours or more in one career field

Secondary Completer: A concentrator who graduates

Postsecondary Data Sources

• Student data from the system’s Integrated Statewide Record System (ISRS)

• National Student Clearinghouse

• Employment information from the system Graduate Follow-Up process and from DEED (Department of Employment and Economic Development)

• Licensing board and Technical Skill Assessment results from third parties

Postsecondary Data Structure

Spring 2011

Summer 2010

Spring 2012

Summer 2011

FY 1

0 C

ohor

t

Perkins IV: Entry Cohort Reporting

Spring 2010

Fall 2010

Fall 2011

FY 2010 FY 2011 FY 2012

Spring 2011

Enter in Fall

2009

Spring 2012

Summer 2011

Spring 2010

Fall 2010

Fall 2011

Spring 2011

Spring 2012

Summer 2011

Enter in Spring 2010

Fall 2010

Fall 2011

Fall 2009

Enter in Summer

2009

Summer 2010

Summer 2010

The FY2011-2012 cohort includes students entering in FY 2010 and tracked for three years: 2010, 2011 and 2012.

Minnesota is one of a handful of states to use a cohort model. The use of cohorts aligns with other system initiatives and reporting.

Postsecondary Definitions

Participant: Student taking a CTE course OR who has a Perkins eligible major.

Concentrator: Student with a Perkins eligible major who has declared a CTE award (AAS, AS, Certificate, Diploma) and has earned 12 or more college level credits OR who has received an award in a short term Perkins eligible program (less than 12 credits).

Completer:Student who received a CTE award (AAS, AS, Certificate or Diploma) in a Perkins eligible program.

Final Agreed Upon Performance Levels (FAUPL)

State Negotiated Performance Level – Accountable in Dec. 2011 CAR

State Negotiated Performance Level – Accountable in Dec. 2012 CAR

Definitions for Core Indicators State Negotiated Performance Levels

Definitions for Core Indicators

Indicator

Perkins Core IndicatorsAcademic Attainment

1S1 Academic Attainment – Reading Language Arts

1S2 Academic Attainment – Mathematics

Secondary

NonePostsecondary

Perkins Core IndicatorsTechnical Skill Attainment

2S1 Technical Skill Attainment

Secondary

Postsecondary 1P1 Technical Skill Attainment

Career Pathways CurrentlyExpected to Implement Technical Skill Assessments

AGRICULTURE, FOOD, & NATURAL RESOURCES• Animal Systems• Plant Systems• Environmental Services Systems • Natural Resources Systems

ARTS, COMMUNICATIONS, & INFORMATION SYSTEMS• Printing Technology• Visual Arts

BUSINESS, MANAGEMENT, & ADMINISTRATION• Accounting• Marketing Management• Merchandising• Professional Sales• Administrative Support

ENGINEERING, MANUFACTURING, & TECHNOLOGY• Engineering and Technology• Facility and Mobile Equipment

Maintenance• Construction• Production• Manufacturing Production Process

Development • Web & Digital Communications

FOUNDATION KNOWLEDGE & SKILLS

HEALTH SCIENCE TECHNOLOGY• Diagnostic Services• Therapeutic Services• Health Informatics

• More on the next slide….

Career Pathways CurrentlyExpected to Implement Technical Skill Assessments

HUMAN SERVICES

Early Childhood Education (Early Childhood Development and Services AND Teaching/Training (Birth to Gr 3)

Law Enforcement Services

• Emergency & Fire Management Services

• National Security

• Personal Care Services

• Restaurants & Food/ Beverage Services

• Teaching/ Training (K-12)

Resources for Technical Skill Attainment

MDE/MnSCU Position on Technical Skill Assessment Implementation

FY10-FY14 Implementation Timeline

FY13 TSA Planning Calendar

MnSCU Program Inventory by College an CIP

2012 Technical Skill Assessment Handbook

List of approved assessments for pathways currently requiring technical skill assessments

http://www.cte.mnscu.edu/programs/mntsa.html

Perkins Core IndicatorsCompletion/Graduation

Secondary

Postsecondary

3S1 School Completion

2P1 Credential, Certificate or Degree

4S1 Student Graduation Rate (NCLB)

Perkins Core IndicatorsStudent Retention or Transfer

Secondary

Postsecondary

None

3P1 Student Retention or Transfer

Perkins Core IndicatorsPlacement

Secondary

Postsecondary

5S1 Placement

4P1 Student Placement

Perkins Core IndicatorsNontraditional Participation

Secondary

Postsecondary

6S1 Nontraditional Participation

5P1 Nontraditional Participation

Perkins Core IndicatorsNontraditional Completion

Secondary

Postsecondary

6S2 Nontraditional Completion

5P2 Nontraditional Completion

State & Local Negotiations

OVAE/State Negotiations

Evaluation of State Performance Improvement Plans

State/Local Consortia Negotiations

Evaluation of Local Performance Improvement Plans

OVAE/State NegotiationProcess for 2012 and 2013

Initial OVAE Proposal for FY2012 and FY2013 March 2011

Deadline for State Response March 2011

OVAE Review of State Proposed Levels April – June

2011

Final FAUPL (Final Agreed Upon Performance Levels) June 2011

Evaluation of Performance 2012 & 2013 CAR

State/Local NegotiationProcess for FY 2013 Targets

Target DateDevelopment of State Proposed Targets September/October 2012Accountability Workshops: Overview

Secondary

Postsecondary

September 20, 2012September 26, 2012September 27, 2012

Distribute Proposed Targets to Consortia Mid to Late October 2012Fall Coordinators Meeting—Breakout session on negotiations November 14, 2012

Consortia Responses Due Late November, 2012Initial State Response Early December 2012

Negotiations Completed Mid December 2012

Evaluation of Performance January 2014

Negotiating Your Targets

Review the proposed targets

Look at your data

– trends/preliminary data if available

Discuss the targets with your partners

– any changes in policy or practice that may affect performance outcomes?

Understand the context and rationale for the proposed targets

• Expectation of continuous improvement at the state and local level

• Need for the state to be able to meet state targets negotiated with OVAE

Negotiating Your Targets

Determine if you will accept the proposed targets or will propose alternatives.

If you accept the state proposals--

• Return the Negotiated Performance for FY13-14 form

• Include BOTH secondary and postsecondary signatures

If you don’t accept the state proposals--

• Notify the state

• Submit alternative target(s) along with the rationale for the proposed alternative(s).

Negotiating Your Targets: Factors in State Review of Consortia Proposals

Rationale provided by the consortium

Trend data

Impact of proposed alternatives on the ability of the state to meet the state negotiated target

Requirements for State and Local Improvement Plans

The language in the Act regarding improvement plans and the withholding of funds is very similar for states and local recipients.

…fail to meet at least 90 percent of an agreed upon State adjusted level of performance for any of the core indicators……develop and implement a program improvement plan (with special consideration to performance gaps within subgroups) …

Withholding Funds

Applies to State and Local Recipients … the Secretary may withhold all or a portion the state’s administrative and leadership funds if a state …

Fails to implement an improvement plan. Fails to make any improvement within the first

program year of implementation of the improvement plan.

Fails to meet at least 90% of an agreed upon performance level for three consecutive years.

… the State may withhold all or a portion of a local recipients funding if the local recipient…

Withholding Funds

Sanctions may be waived due to exceptional or uncontrollable circumstances.

Withheld funds are to be used to provide technical assistance.

Development of statewide technical assistance for core indicators.

Evaluation of Local Performance

Negotiated Level

90% of Negotiated Level

No actionAt or above target

Improvement Plan Below 90% of target

Report RequiredBetween 90% and 99%

Improvement Plans and Reports

Examination of the data—comparison of the target level and actual performance (incl. subgroups)

Identification of general strategies to address performance gaps.

Context—an explanation of why the target was not met (optional for reports)

Data and contextual factors for sub-populations or groups where gaps exist.

Specific actions to be taken to improve performance and to help the consortium meet negotiated targets in subsequent years.

Improvement Reports and

Plans

Improvement Plans

Resources for Improvement Plans and Reports

http://www.cte.mnscu.edu/directories/portal.html

Template and Overview

MN Guide to Improvement Planning

Please take a moment to enter your questions in the “Chat” field … or unmute yourself and ask your questions.

Time for Your Questions!

Other Upcoming Accountability Webinars

Perkins Accountability II - SecondarySeptember 26, 201210:00 - 11:00 a.m.

Perkins Accountability II - PostsecondarySeptember 27, 201210:00 – 11:00 a.m.

http://www.cte.mnscu.edu/professionaldevelopment/index.html

• Perkins Fiscal Webinars

• Annual Fall Perkins Contacts and Coordinators MeetingNovember 14, 2012Minnesota Department of Education, Roseville, MN

• Career Technical Education Fall ConferenceCTE: Learning that Works for MinnesotaNovember 15, 2012Crowne Plaza Minneapolis West, Plymouth, MN

http://www.cte.mnscu.edu/professionaldevelopment/index.html

Tuesday, October 9, 2012Overview: Perkins Fiscal Training Part IPerkins Law

Monday, October 15, 2012Overview: Perkins Fiscal Training Part IIRequirements to Receive Funds

Wednesday, October 17, 2012Perkins Postsecondary Fiscal Procedures and Requirements-Treatment of Money

Wednesday, October 24, 2012Perkins Secondary Fiscal Procedures and Requirements-Treatment of Money

Other Upcoming Webinars and Events

MDE Website

http://education.state.mn.us/MDE/Academic_Excellence/Career_Technical_Education/Forms_Resources/index.html

MnSCU Websitehttp://www.cte.mnscu.edu/

Important Websites

Today’s presenters

Marlys J. Bucher, Ph.D.Secondary Perkins CoordinatorCTE Assessment and Evaluation Specialist

Minnesota Department of Educationmarlys.bucher@state.mn.us

JoAnn SimserState Director, Career and Technical

Education Minnesota State Colleges and Universitiesjoann.simser@so.mnscu.edu

Susan CarterAssociate Director for ResearchMinnesota State Colleges and

Universitiessusan.carter@so.mnscu.edu

Dan SmithSupervisor, Adult and Career EducationCenter for Postsecondary SuccessMinnesota Department of Educationdan.smith@state.mn.us

Thanks for joining us today!

We value your feedback about today’s session. Please click on the link here or in the chat

window now to complete the Session Evaluation Form.

 

REMINDER: For secondary participants, Continuing Education Units (CEU’s) will be made available for teachers for this series of webinars. In order to get the necessary certificates you MUST complete the session evaluation.