TransLight/StarLight Tom DeFanti (Principal Investigator) Maxine Brown (Co-Principal Investigator)
1 Employment Service Systems Research and Training Center David Vandergoot, Ph.D., Co-Principal...
44
1 Employment Service Systems Research and Training Center David Vandergoot, Ph.D., Co-Principal Investigator Robert Stensrud, Ph.D. Co-Principal Investigator Developing an Evidence Base for Evaluation Research The ESSRTC is supported through Grant No. H133B040014 to Hunter College, City University of New York from National Institute on Disability and Rehabilitation Research, U.S. Department of Education.
-
Upload
shawn-grant -
Category
Documents
-
view
215 -
download
0
Transcript of 1 Employment Service Systems Research and Training Center David Vandergoot, Ph.D., Co-Principal...
1
Employment Service Systems
Research and Training Center
David Vandergoot, Ph.D.,
Co-Principal Investigator
Robert Stensrud, Ph.D.
Co-Principal Investigator
Developing an Evidence Base for
Evaluation Research
The ESSRTC is supported through Grant No. H133B040014 to Hunter College, City University of New York from National Institute on Disability and
Rehabilitation Research, U.S. Department of Education.
2
ESSRTC Projects
Study RSA 911 to Identify Predictors of Unsuccessful Closures
Study Best Practices in VR Counselors Study Current Consumer Satisfaction with VR and
One-Stop Services Study One-Stop Collaboration and Integration Study Provider Collaboration Around Demand Side
Services Demonstrate Models for Predicting Employment of
People with Disabilities for State Planning Design Employment Service Systems to Develop and
Demonstrate Evidence-Based Practices
3
ESSRTC Products
Employer Openness Survey Consortium for Employment Success Model VR Current Consumer Satisfaction Survey VR Closed Consumer Satisfaction Survey VR Consumer Satisfaction Follow-Up Survey Employment Prediction Model DigitalChalk Training Modules
RSA 911 National DataClosed Before Plan Initiated (Status 30)
4
National RSA 911 Data 2003
Each set of factors added sequentially to the model
Status 26 Status 30Overall Correct
Demographics 1% 99% 60%Education and Work History 3% 98% 60%Current Situation (at application) 33% 85% 64%Primary Disability 36% 83% 65%
Correct Classification of Status Outcome (cut score .5)
New York VR (VESID) DataClosed Before Plan Initiated (Status 30)
5
New York State VR (VESID) 2002-2005
Each set of factors added sequentially to the model
Status 26 Status 30Overall Correct
Demographics 100% 0% 64%Education and Work History 99% 1% 64%Current Situation (at application) 89% 28% 67%Primary Disability 89% 31% 68%
Correct Classification of Status Outcome (cut score .5)
RSA 911 National DataClosed After Plan Initiated (Status 28)
6
National RSA 911 Data 2003
Each set of factors added sequentially to the model
Status 26 Status 28 Overall
Demographics 1% 99% 59%Education and Work History 20% 87% 59%Current Situation (at application) 34% 81% 62%Primary Disability 37% 80% 62%
Correct Classification of Status Outcome (cut score .5)
Comparison – National vs. State Data
7
Comparison of National to State Data
Closed Before Plan Initiated (status 30)
RSA 911 National
RSA 911 New York
New York Data
Demographics 0% 2% 3%Education and Work History 6% 4%Current Situation (at application) 10% 11%Primary Disability 13% 12% 14%
Explanation of Outcome
Consumer Satisfaction Survey
Current Consumer Satisfaction with VR and Partner Services
Consumer Satisfaction at Case Closure Consumer Satisfaction at 12-Month Follow-
Up Tied to Case Data Tied to Service Self-Assessment Data Can Be Tied to Employment Forecasting
Model
VESID Survey12 month Response Rates
Response rate: 595 of 5003 surveys returned (11.9% response rate)
Response rate by closure status:
Status 26: 410 of 2730 (15%)
Status 28: 185 of 2273 (8.1%)
Employment Outcomes
Closure Status
Employed full time
Employed part-time
Self-employed
Employed Supp. Emp.
Employed Sheltered
Not employed
but looking
Not seeking employ.
26 - successful 36.6% 27% 3.1% 3.8% 0 19.3% 10.2%
28 - unsuccessful 11.9% 10.2% 2.3% 2.8% 1.1% 44.1% 27.7%
Weekly Earnings
Frequency PercentValid
PercentCumulative
Percent
Valid
1 $50 or less 59 9.9 15.8 15.8
2 $51 to $100 50 8.4 13.4 29.2
3 $101 to $200 74 12.4 19.8 49.1
4 $201 to $300 60 10.1 16.1 65.1
5 $301 to $400 50 8.4 13.4 78.6
6 $401 to $500 31 5.2 8.3 86.9
7 $501 to $750 31 5.2 8.3 95.2
8 $751 or more 18 3.0 4.8 100.0
Total 373 62.7 100.0
Missing System 222 37.3
Total 595 100.0
Health Benefits from Job
Frequency PercentValid
PercentCumulative
Percent
Valid
No 164 27.6 63.1 63.1
Yes 96 16.1 36.9 100.0
Total 260 43.7 100.0
Missing System 335 56.3
Total 595 100.0
Opportunities for Advancement
Frequency PercentValid
PercentCumulative
Percent
Valid
No 133 22.4 47.2 47.2
Yes 149 25.0 52.8 100.0
Total 282 47.4 100.0
Missing System 313 52.6
Total 595 100.0
More Financially Independent
Frequency PercentValid
PercentCumulative
Percent
Valid
No 79 13.3 31.2 31.2
Yes 174 29.2 68.8 100.0
Total 253 42.5 100.0
Missing System 342 57.5
Total 595 100.0
Improved Job Skills
Frequency PercentValid
PercentCumulative
Percent
Valid
No 58 9.7 25.0 25.0
Yes 174 29.2 75.0 100.0
Total 232 39.0 100.0
Missing System 363 61.0
Total 595 100.0
Because of Job QOL Improved
Frequency PercentValid
PercentCumulative
Percent
Valid
No 56 9.4 22.8 22.8
Yes 190 31.9 77.2 100.0
Total 246 41.3 100.0
Missing System 349 58.7
Total 595 100.0
Participation in Work-Related Social Events
Frequency PercentValid
PercentCumulative
Percent
Valid
No 142 23.9 51.4 51.4
Yes 134 22.5 48.6 100.0
Total 276 46.4 100.0
Missing System 319 53.6
Total 595 100.0
Because of Job Able to Meet More People
Frequency PercentValid
PercentCumulative
Percent
Valid
No 119 20.0 42.8 42.8
Yes 159 26.7 57.2 100.0
Total 278 46.7 100.0
Missing System 317 53.3
Total 595 100.0
Satisfaction with Job
FrequencyValid
PercentCumulative
Percent
Very satisfied 126 35.1 35.1
Satisfied 144 40.1 75.2
Dissatisfied 60 16.7 91.9
Very dissatisfied 29 8.1 100.0
Total 359 100.0
Overall Satisfaction
Ability to Reach Counselor
Time to Receive Services
Treatment by Reception Staff
Treatment by Counseling Staff
Job Choice and Skills Matched
Understanding Services
Participation in Planning Services
Planning for Job or Training
Informed about Hearing
Recommend VESID
Employment Forecasts for State VR Agencies
Develop a prediction model to forecast the employment of people with disabilities
Work with officials from the Iowa VR, Iowa DOL, and Iowa SSA to develop a prototype of the VR State Plan section dealing with future needs
Apply to Assessment of One-Stop Performance Apply to Services for Ticket Holders Apply to Transitioning Services Apply to State Budgeting Process
31
Forecasting
Available Labor Force Employment By Industry Employment By Occupation Employment By Firm Size Occupational Wage Estimates Unemployment Rates Available Jobs Per Worker
32
Forecasting for Consumers
We will adapt this work to address the employment of people with disabilities by integrating existing data sources that have not been effectively integrated before and used for state-level planning and program development
33
Disability Data Sources
Census Bureau Rehabilitation Services Administration Social Security Administration Federal Department of Labor
34
Result
An improved mechanism by which state VR agencies can develop plans and budgets based on sound data and identified areas where promising practices might be implemented. This would enable agencies to better target unserved and underserved populations and direct outreach to regions and employment sectors with greater hiring potential.It can be adapted to transition planning for youth with disabilities.
35
Comprehensive StatewideNeeds Assessment Model
36
Review of Literature
Analysis of Extant Data
Key Informant InterviewsFocus Group
Random Survey (Interview)
ImplementationPlanning
VRSYSTEM
Resource Assessment
Toward Evidence-Based Practices
Dependent Variables Current Consumer Satisfaction Satisfaction At Closure Follow-Up Satisfaction Casefile Data
Moderating Variables Forecasting Model Collaboration
Independent Variables Promising Practices Grant Applications and External Evaluation
Online Training Partnerships
A virtual classroom, DigitalChalk, that allows learners to adapt the learning portal to their learning needs, including a note taking capability It utilizes synchronized audio, video, power point presentations, downloadable documents, learning assessments, and certification credentialing Closed captioning can be turned on/off from portal The training can be accessed at any time and at the learners’ desired paceESSRTC can assist agencies in designing best practice training
38
Disability Stats RTC
Five year project funded by NIDRR Hunter College lead agency Partners
New Editions Mathematica Policy Research Center for Essential Management Services
39
Mission
The Rehabilitation Research and Training Center on Disability Statistics and Demographics (StatsRRTC) will facilitate evidence-based decision making in many different service and policy arenas to benefit persons with disabilities, leading to improved education and employment outcomes
40
VR Data Processes & Analyses
Utilizes a combination of formats, including workshops, conferences, the DigitalChalk Learning Platform, and our Webinar Series to work with the 80 general and blind vocational rehabilitation (VR) state agencies.
41
VR Data Processes & Analyses Yr 1
Develop network of VR state agency personnel with focus on data, research and evaluation
Conduct assessment of their needs regarding disability data/statistics
Collect information on their current data collection, analysis and reporting practices
42
43
VR Data Processes & Analyses Yr 2
Inquire into evidence regarding validity and reliability of these data collection processes
Coalesce these practices into a “menu of practices” that documents the different data collected and how they are used
Develop a set of promising practices based on what we observe in the field.
Field test these practices
44
VR Data Processes & Analyses Yrs 3-5
Convey the menu and promising practices back to the agencies (State of Science)
In collaboration with the training participants, develop plans for future research aimed at improving data collection, analysis, and reporting.
