Continuing Progress Towards Powerful TAACCCT Applications

Continuing Progress TowardsPowerful TAACCCT

ApplicationsApril 12, 2012

Welcome COMPLETE COLLEGE AMERICA is a national nonprofit working to significantly

increase the number of Americans with a college degree or credential of value and to close attainment gaps for traditionally underrepresented populations

CCA is again providing facilitation and support to:– Build state-based consortia to develop strong proposals incorporating

completion objectives for the U.S. Department of Labor’s TAA Community College Career and Training Grant

– To create a national consortia of colleges to focused on embedded remediation

Technical Assistance Team: Complete College America and our strategic partners—FutureWorks and Corporation for a Skilled Workforce (CSW)

This meeting is an important component of our technical assistance activities = draws on success of last year’s Dallas meeting

2

ArkansasColoradoConnecticutFloridaGeorgiaHawaiiIdahoIllinoisIndianaKentuckyLouisianaMaineMarylandMassachusettsMinnesota

MississippiMissouriNevadaNew MexicoOhioOklahomaOregonPennsylvaniaRhode IslandSouth DakotaTennesseeTexasUtah VermontWest Virginia

30 Member States

TAACCCT Logic Model

InputsWhat we have now

& need going forward

Statement of Need

StrategyWhat we will do to address the needs

Strategic Approach and Core Elements

OutputsAccelerated pathways

to certificates & degrees

Implementation

ResultsOutcomes produced by our new program

Skilled Workers with Good Jobs, and

Competitive Industries

TAA Certification in at least one community and associated threat to or loss of jobs

Education needs of TAA workers

Evidence of job opportunities and understanding of education requirements in targeted industries

Evidence of gaps in ed/training programs and impact on institutions serving TAA workers

Evidence-Based Design and change strategies

Stacked and Latticed Credentials that are market-relevant and interconnected

Online and Technology-Enabled Learning

Transferability and Articulation from non-credit to credit

Strategic Alignment with WFS, educational institutions and employers

Expanded and improved ability to deliver education & training

Improved education and employment outcomes, particularly for TAA workers

Work Plan Outcome measures –

participant and deliverable

Evaluation Plan

Recommended MilestonesBy now you should have:• Confirmed lead college• Identified all colleges in consortium• Identified the relevant TAA certification(s)By now you may have:• Begun (or finished) assessment of TAA worker education and training needs• Begun engaging employers to help plan strategy• Selected occupational areas of focus• Consulted with public workforce system• Connected with key state level contactsIdeally you have also:• Begun outlining your approach to the five Core Elements• Started connecting this approach with activities required for implementation• Begun mapping out tasks and their sequence• Identified outcomes and begun inventorying systems available (and gaps) to track• Thought about project management and consortium organizational plan• Assigned responsibility for budgetary planning

5

Statement of Need

6

Total points: 20/101

1. Serving the Education and Training Needs of TAA-Eligible Workers (10 points)

– TAA Certification determinations in one or more community to be served (on or after 1/1/2007) and impact of foreign trade

– Partnerships with TAA Agencies– Education & training needs of TAA workers in communities to

be served– Industries/occupations in which these workers were employed;– Current skill and educational attainment levels;– Additional barriers

Statement of Need

Statement of Need

2. Evidence of Job Opportunities in the Targeted Industries and Occupations (5 points)

Factor One: Identify targeted industries and occupations, describe how employers are involved and what resources they are bringing to the project.

Factor Two: Provide strong evidence (LMI) that the targeted industries and occupations will yield job opportunities for TAA workers; identify specific employers expected to hire participants.

Factor Three: Demonstrate understanding of the job knowledge, skills, abilities and credentials required to work in the targeted industries and occupations; describe employer engagement to provide feedback on content developed in grant.

7

Statement of Need

3. Gap Analyses (5 points)

Factor One: Describe the gaps in existing education and training programs and infrastructure based on data collected through community outreach and MIS or other data sources. (Match geographic scope and provide summary of outreach process.)

Factor Two: Describe the current institutional technology and systems infrastructure and activities related to the SGA’s Core Elements and identify areas for improvement.

Factor Three: Describe the overall impact of the gaps described above on your ability to effectively serve TAA and other workers – how does this limit your capacity?

8

Point-Value Overview Statement of Need

9

Serving the Education and Training Needs of TAA Eligible Workers

(10 pts)

Gap Analyses (5 pts)

Evidence of Job Opportunities in the

Targeted Industries and Occupations (5 pts)

Evidence Based Design (8 pts)

Stacked and Latticed Credentials (8 pts)

Project Work Plan (10 pts)

Project Management

(10 pts)

Process for Tracking and Reporting

Outcome Measures(10 pts)

Analysis of Outcome Projections (5 pts)

Statement of Need Description of the Project: Strategic

Approach and Core Elements

Outcomes

Online and Technology- Enabled

Learning (8 pts)

Transferability and Articulation

(8 pts)

Strategic Alignment (8 pts)

Using Data for Continuous

Improvement (5 pts)

Work Plan & Project Management

Point-Value Overview Statement of Need

10

Statement of Need

Tips and Pitfalls• Execute a plan to meaningfully engage employers

and workforce partners• Consider surveying colleges to inventory services

currently available in order to identify gaps • Research outstanding questions unaddressed by

outreach (i.e., trade impact certification, labor market information, etc.)• Use the freshest data available

• Remember to document outreach processes • Don’t rely solely on old outreach performed for

unrelated projects• Remember that this section sets the stage for your

strategic approach and work plan


(10 pts)




Description of the Project: Strategic Approach and Core

ElementsTotal points: 40/101

1. Evidence-Based Design (8 points)– Factor One: Describe research findings and present the strongest evidence available

for your proposed program design, discuss any mixed or negative evidence. Cite all sources and identify as strong, moderate or preliminary.

– Factor Two: Describe the education and training strategies you are proposing, and how the evidence cited above influenced the design, as well as how this evidence will be incorporated into program development/delivery plans. Indicate here whether you will be implementing new strategies or replicating existing evidence-based strategies and cite applicable research.

11



2. Stacked and Latticed Credentials (8 points)– Factor One: Describe plans to work with industry to identify clusters of

courses and market-relevant credentials.

– Factor Two: Describe plans to develop interconnected specific credentials, how they are compatible with or same as those use broadly, and process for connecting these credentials. (Indicate which institutions will award each credential.)

– Factor Three: Describe plans to assess prior learning, identify types of assessments to be used and explain how credit will be awarded for prior learning. Military personnel experience considered.

12



3. Online and Technology Enabled Learning (8 points)

– Factor One: Describe how technology is incorporated into the design of the program and describe how online and technology enabled learning will be used in your project.

– Factor Two: Explain how this use of technology will impact program outcomes (such as accelerating completion, expanding reach and capacity, improving learning outcomes, etc.) Technology-based infrastructure projects must support all proposed programs.

13



4. Transferability and Articulation (8 points)

– Factor One: Describe plans to establish transferability options and strengthen credit to non-credit transitions, including across consortium members, other TAACCCT funded programs and other institutions.

– Factor Two: Describe plans to develop articulation strategies that support career pathways, including at least one agreement between 2- and 4-year institutions. Credit to non-credit potential.

14



4. Strategic Alignment (8 points)

– Factor One: Show substantial involvement of at least one employer or group of employers for each targeted industry (include letter of commitment.) Specify roles for employers and industry.

– Factor Two: Describe your plan to collaborate with the public workforce system in developing and delivering programs. Provide evidence of their commitment.

– Factor Three: Describe your plans to outreach to first round winners and other educational institutions.

15

Point-Value Overview Strategic Approach and Core

Elements

16


(10 pts)







Project Management

(10 pts)






Outcomes


Learning (8 pts)


(8 pts)



Improvement (5 pts)


Point-Value Overview Strategic Approach and Core

Elements

17

Strategic Approach and Core Elements

Tips and Pitfalls• Work together to develop a strategic approach

that addresses identified needs with common strategies across the consortium• Clearly address each Core Element• Avoid cobbling together disparate strategies

at each institution• CCA can help equip you with evidence supporting

completion-related strategies




Learning (8 pts)


(8 pts)


Work Plan and Project Management

Total points: 20/101

1. Project Work Plan (10 points)– Factor One: Present clear and reasonable activities with associated

timeframes and deliverables that reflect understanding of costs and activities required for implementation.

– Factor Two: Identify and outline adequate and reasonable costs associated with each major project activity described.

– Factor Three: Describe new intellectual property that will be developed or improved and expected date of delivery to DOL.

18


Total points: 20/1012. Project Management (10 points)

– Factor One: Demonstrate that project will be lead by a competent, full-time project manager, involve well-qualified fiscal and administrative management, and staff with marketing expertise. Describe qualifications and hiring plan.

– Factor Two: Propose a management structure for effective communication among project staff and organizations. Attach an organizational chart identifying leadership, program, administrative, advisory positions.

– Factor Three: Explain how project will ensure timely and accurate financial and performance reporting and enable expedient procurement. You must:• Demonstrate that you’ve submitted timely reports for most recent ETA or other grants;• Describe grant management used to complete grant activities on time; and• Describe procurement processes, systems, procedures and those of consortium members.

– Factor Four: List consortium members’ roles and responsibilities throughout planning and implementation. Attach a Consortium Agreement.

– Factor Five: Explain how you’ll use data to determine which strategies were effective and how to integrate in the future. Describe how you’ll sustain relationships with employers. 19

Point-Value Overview Work Plan and Project Management

20


(10 pts)







Project Management

(10 pts)






Outcomes


Learning (8 pts)


(8 pts)



Improvement (5 pts)


Point-Value Overview Work Plan and Project Management

21


Tips and Pitfalls• Designate a Grantee (lead) Applicant…

• …but maintain a functional team with shared responsibility for planning and implementation

• Develop tools to develop consistent cost estimates for college labor and equipment needs

• Agree on a process for selecting project management staff

• Discuss what kinds of future financial resources may be available, and be realistic about your ability to raise outside funds


Project Management

(10 pts)

OutcomesTotal points: 20/101

1. Analysis of Outcome Projections (5 points)– Factor One: Provide numerical outcome projections (raw, not percentages) for each

of nine outcome measures for each grant year and total grant period. Include as a table in the technical proposal.

– Factor Two: Explain how the outcome projections are appropriate targets for program by providing an explanation of how the targets were derived and fit into implementation timeframe.

– Factor Three: Provide an explanation for a mix of proposed outcomes (participants served) vs other deliverables (courses developed).

22


2. Process or System for Tracking and Reporting Outcome Measures (10 points)– Factor One: Provide specifics about existing procedures for tracking students,

including which outcomes are already captured.

– Factor Two: Describe and explain gaps between what is already collected and what is required and plans to bridge those gaps. Provide a specific plan (staffing, resources, technology, etc.) as well as the process to obtain employment outcome information.

23


3. Using Data for Continuous Improvement (5 points)– Factor One: Describe the process that will be used to formally review the data

within educational institutions, with partners as applicable. Include how often reviews will occur, staffing and partners involved and how they are involved, how decisions will be made about adjustments, and how progress or improvement will be assessed.

24

Non-Participant Data SubmissionBonus Point

Total points: 1/101

Background: USDOL will facilitate tracking of employment outcomes for a broader population of students by arranging for grantees to submit basic individual-level information (name, SSN, DOB) about students enrolled in selected non-TAACCCT funded programs. USDOL will arrange for matching the data with employment records using secure IT, and will provide grantees with a report on employment and earnings outcomes aggregated by program.

– Factor One: Provide an affirmative statement committing to provide data annually during grant performance.

– The Grantee (lead) Institution or one consortium member must make this commitment to be eligible for the bonus.

25

Point-Value Overview Outcomes

26


(10 pts)







Project Management

(10 pts)






Outcomes


Learning (8 pts)


(8 pts)



Improvement (5 pts)


Point-Value Overview Outcomes

27

Outcomes

Tips and Pitfalls• Invite college staff that work with data to participate

in planning• Agree on measures

• Work with your local workforce partners to see what information they already track

• Identify system software compatibility issues• Use leveraged expertiseAnalysis of Outcome

Projections (5 pts)




Improvement (5 pts)

Point-Value Overview

28


(10 pts)







Project Management

(10 pts)






Outcomes


Learning (8 pts)


(8 pts)



Improvement (5 pts)


Program Evaluation Plan

29

– You are required to hire (may be paid for from grant funds) a third party evaluator. Many applicants engage an evaluator during the proposal development process to help them write this section.• However, it is important to note that you will still have to competitively procure the

evaluator after receiving the grant funds.

– The evaluation plan page limit does not count against Technical Proposal page limit, but cannot exceed 10 pages.

– Evaluation plans will be reviewed separately from technical proposals.– Technical proposal rankings will serve as the initial basis for selection.– As with round one, two general types of outcomes will be tracked to

measure participant progress and implementation progress.– You can expect to track more implementation (or process) measures in the

first year of implementation.


30

1. Participant Outcomes or Impacts– Provide a detailed plan for rigorous evaluation of the participant outcomes or

impacts, including a complete description of methodology and data collection methods.

– Explain how the methodology proposed is the most rigorous for the participant outcomes or impacts given the number of participants (including TAA workers) the project intends to serve.

– Explain how the anticipated follow-up data will be successfully collected from participants and the control/comparison group. Identify chosen methodology on first page of evaluation plan.• For random assignment, fully explain:

– How the recruitment plan will yield a sufficient number of qualified applicants (program and controls) to produce valid estimates of the key outcomes: program completion, credential attainment, placement into employment, and employment retention, as well as average earnings;

– How random assignment will be performed; and– What procedures will be in place to ensure fidelity of random assignment. Note that TAA workers cannot be

randomly assigned.

• For comparison group methodology, fully explain:– The source of the comparison group and how individuals will be selected into this group, including showing that

data on both the comparison and program participant group will be from comparable sources.


31

2. Program ImplementationProvide a detailed plan for the program implementation analysis component of the evaluation,

including how the evaluation will:– Analyze the steps taken by the consortium to create and run the program;– Assess the operational strengths and weaknesses of the project after implementation; and– Suggest how it might be improved.Specific questions to be answered through evaluation activities must include:– How was the particular curriculum selected, used, or created?– How were the programs and design improved or expanded with grant funds? What delivery

methods were offered? What was the administrative structure? What support and other services were offered?

– Did the grantees conduct an in-depth assessment of participants’ abilities, skills, interests to select for inclusion in program? What assessments were used? Who conducted them? How were the results used? Were the results useful in determining the appropriate program and course sequence for participants? Was career guidance provided and, if so, through what methods?

– What contributions did each partner (including employer, workforce, philanthropy, etc.) make in terms of program design, curriculum development, recruitment, training, placement, program management, leveraging resources and commitment to sustainability. What contributed to involvement? Which contributions were most critical? Which were not?

Program Evaluation Plan and Budget Narrative

32

3. Selection of Third Party Evaluator– Describe the process for selecting and procuring a third party evaluator prior to

enrolling participants, including the capacity and expertise required.

Program Evaluation Budget Narrative– The program evaluation budget narrative is separate from the overall budget

narrative for the proposed project. Has no page limit.– Program evaluation costs should not exceed 10% of the total proposed grant

budget.– The program evaluation budget narrative should provide a description of all

program evaluation costs, and all costs should be reasonable and appropriate to timelines and deliverables.

– Be sure to include the program evaluation costs together with all grant activities on the SF-424 and SF-424A forms.

Required Reporting

33

Fourteen required outcome measures: Unique participants served Total number who have completed a grant-funded program of study Total number still retained in their program of study or another grant-funded program Total number retained in other (non-grant funded) programs of study Total number of credit hours completed Total number of students completing credit hours Total number of earned degrees/certificates Total number of students earning certificates (less than one year) Total number of students earning certificates (more than one year) Total number of students earning degrees Total number employed after grant-funded program of study completion Total number retained in employment after program of study completion Total number of those employed at enrollment (incumbent workers) who receive a wage increase

post-enrollment.

Next Steps

We will offer an in depth review of your draft proposals. Please submit your draft by:– Monday, May 7 (to have response back by May 10); OR– Monday, May 14 (to have response back by May 17)

Applications are due Thursday, May 24.

34

Discussion

35

What are the implications of what you’ve heard here today for your grant development process?

Do any key areas of your grant process require attention or refocusing?

Have you identified any specific areas of confusion?

Thank you.

COMPLETE COLLEGE AMERICA and our strategic partners—FutureWorks and Corporation for a Skilled Workforce (CSW)

______

Questions, comments or feedback:Dominique (Domy) [email protected]

36

mailto:[email protected]

Continuing Progress Towards Powerful TAACCCT Applications

Documents

Transcript of Continuing Progress Towards Powerful TAACCCT Applications