Post on 16-Jan-2016
Massachusetts Department of Elementary & Secondary Education
1
College and Career Readiness Webinar Series:
College and Career Readiness
Data Tools
District and School Profiles
Massachusetts Department of Elementary & Secondary Education
2
About the C&CR Webinar SeriesSeptember Sept 15, 2015 Edwin: EWIS and Post Secondary
Reportshttp://www.doe.mass.edu/conference/?ConferenceID=8169
October Oct 13, 2015 9th Grade Transition http://www.doe.mass.edu/conference/?ConferenceID=8170
November Nov 17, 2015 Labor Market Information http://www.doe.mass.edu/conference/?ConferenceID=8171
January Jan 12, 2016 Individual Learning Plans http://www.doe.mass.edu/conference/?ConferenceID=8172
February Feb 9, 2016 Graduation Rates http://www.doe.mass.edu/conference/?ConferenceID=8173
March March 8, 2016 Career Development Education http://www.doe.mass.edu/conference/?ConferenceID=8174
April April 13, 2016 Maximizing Graduation Coaches and Other Adult Advocates
http://www.doe.mass.edu/conference/?ConferenceID=8175
May May 10, 2016 Early College Pathways http://www.doe.mass.edu/conference/?ConferenceID=8176
Massachusetts Department of Elementary & Secondary Education
3
Welcome!
Please type your question or comment in the chat window at any point during the presentation
All phones will be muted PowerPoint slides will be sent to all registered
participants
Massachusetts Department of Elementary & Secondary Education
4
Goals for the Session
Understanding of the nature of data
Introduction to college and career readiness data tools offered by ESE
“Information is a beacon, a cudgel, an olive branch, a deterrent--all depending on who wields it and how.” Steven Levitt
Massachusetts Department of Elementary & Secondary Education
5
The Nature of things…
Qualitative data are everything that refers to the quality of something. For example, a description of experiences, observations and interviews are all qualitative data.
Quantitative data are data that refers to a number. The numbers of students, test scores, anything that can be added, multiplied, subtracted or divided.
Simply put, data is information that helps in our decision making.
Massachusetts Department of Elementary & Secondary Education
6
What is the Cycle of Inquiry?
Massachusetts Department of Elementary & Secondary Education
7
Making the Data Dance Data is a tool…
Data can help inform our decisions…
Behind the data are real human beings…
Use data to tell the story…
Data is our friend…
Massachusetts Department of Elementary & Secondary Education
8
School Profiles: http://profiles.doe.mass.edu/Graduation rates, MCAS results, discipline data
Edwin Analytics: https://gateway.edu.state.ma.us/ Early Warning Indicator System (EWIS) reportsPostsecondary Readiness and Success reports
Success After High School DART:http://www.doe.mass.edu/apa/dart/SAHS.xlsx 5-year trend lines for individual high schools
Overviews of College & Career Readiness
related data tools
Massachusetts Department of Elementary & Secondary Education
9
Profiles
Massachusetts Department of Elementary & Secondary Education
10
First, a quick look at Profiles
http://profiles.doe.mass.edu/
Profiles are a great way to find basic information about schools and districts and also acts as an access point to a great deal of other publicly available data.
Massachusetts Department of Elementary & Secondary Education
11
Edwin Analytics
Massachusetts Department of Elementary & Secondary Education
12
What is Edwin Analytics? Goes beyond but includes reports previously available in the
Education Data Warehouse (EDW) A state-level platform that provides a more comprehensive view
of students, teachers, schools, districts and the state; Timely and actionable information that empowers educators and
informs better decision making at every level Tools and resources that will help educators improve teaching,
learning, school readiness and education outcomes
New reports are constantly being added
Massachusetts Department of Elementary & Secondary Education
13
Out of the many reports in Edwin Analytics, today we are focusing on…
Identifying current students in grades 1-12 who may be at risk of missing key educational targets (Early Warning Indicator System (EWIS) reports)
Identifying how your former students did after they graduated from your school/district (Postsecondary Readiness and Success)
Massachusetts Department of Elementary & Secondary Education
14
Early Warning Indicator System (EWIS)
Massachusetts Department of Elementary & Secondary Education
15
What are Early Warning Indicators?
Methodological way of looking at students and their likelihood of meeting specific academic goals
Traditionally implemented at the high school level to help predict which students are most likely to drop out
Tool for educators to better design and target student interventions in a timely way
Massachusetts Department of Elementary & Secondary Education
16
Grade Groupings & Goals
=Age Groups
Grade Level
s
Academic Goals (expected student outcomes
for each age group)
2013-14 Statewide Results for Goal
Early Elementary
Grades 1-3
Reading by the end of third grade: Reaching proficient or advanced on 3rd grade ELA MCAS
57%
Late Elementary
Grades 4-6
Middle school ready: Reaching proficient or advanced on 6th grade ELA and math MCAS
54%
Middle Grades
Grades 7-9
High school ready: Passing grades on all 9th grade courses
78%
High School
Grades 10-12
High school graduation: Meeting all local and state graduation requirements
85%
Use when setting school and district
goals!
Massachusetts Department of Elementary & Secondary Education
17
EWIS Key Concepts Provides risk level information for all students
based on prior year data
The risk levels are not based on a student’s relative likelihood for reaching an academic goal when compared with other students
Individual indicators in the risk model are not reflective of the level of risk - taken together, the indicators (data points) collectively form a risk level
Only includes data from existing statewide collections (SIMS, SSDR and SCS) and state assessments (MCAS and ACCESS)
Massachusetts Department of Elementary & Secondary Education
18
EWIS is / is not…
=
The Massachusetts EWIS is… The Massachusetts EWIS is not…
A tool to better target interventions and supports at the individual, small group, and whole school levels.
A “life sentence” or a reason to label students.
A systematic way to flag students that need to be further examined to determine what additional support are necessary.
A diagnostic tool that provides details on the exact reason(s) why a student is at risk for not meeting an expected academic goal.
Related to measures that are included in the state’s school and district accountability system (PPI), but is not itself an accountability measure.
An accountability measure.
Based on data and risk models that the Department will reexamine each year to continually improve the system.
A stagnant system that will remain exactly the same in future years.
Massachusetts Department of Elementary & Secondary Education
19
Edwin Analytics: EWIS Reports
There are Five EWIS reports in Edwin: EWIS District View (EW301) EWIS Student List (EW601) EWIS Graphical View (EW302) EWIS Risk Level Indicator Analysis (EW317) EWIS Subgroup Analysis (EW318)
All can be filtered numerous way (e.g., selecting specific
schools, grade levels, student subgroups)
Massachusetts Department of Elementary & Secondary Education
20
EW301: District Overview
Massachusetts Department of Elementary & Secondary Education
21
School Name
Grade
Last Name
First Name
SASIDRisk Level
Attend Rate
Suspension
Retained
School
Move
Low Incom
e
SPED Level
Gender
Urban Reside
nce
Overage
Title1 Schoolwide
ACCESS for ELLs
ELA MCAS 2014
Math MCAS 2014
Math Course
Perf
ELA Course
Perf
Sci Course
Perf
SS Course
Perf
Non-Core
Course Perf
Previous
Year Risk Level
Race/Ethnic
ityELL
ELL Progra
m
Special
Education
Placement
Any High School
9 Aardvark
Arnold High 98% 0 No No Free None Female Yes No Yes 1.8 - - Pass Pass Pass Pass Pass N/A Hispanic or Latino
Y Enrolled in sheltered English immersion
Not a Special Education Student, age 6-21
Any High School
9 Bailey Billy High 90% 0 No No Free Moderate
Female Yes Yes Yes None Needs Improvement
Warning
Pass Pass Fail Fail Fail High White N N/A Full Inclusion special education services outside the general education classroom less than 21% of the time
Any High School
9 Colorado
Carlos High 88% 0 No No Reduced
None Female Yes No Yes 2.6 - - Pass Pass Pass Pass Pass N/A White Y Enrolled in sheltered English immersion
Not a Special Education Student, age 6-21
Any High School
9 Denton Daisy High 99% 0 No No Free None Male Yes Yes Yes None Proficient
Needs Improvement
Pass Pass Fail Pass Fail High Hispanic or Latino
N N/A Not a Special Education Student, age 6-21
Any High School
9 Everett Elena High 74% 0 No Yes Free None Female Yes No Yes None Needs Improvement
Warning
Pass Pass Pass Pass Fail High White N N/A Not a Special Education Student, age 6-21
EW601: The Student LevelStudent ID info Indicators in the risk model Student info
Massachusetts Department of Elementary & Secondary Education
22
EW302: Graphical View
Massachusetts Department of Elementary & Secondary Education
23
EWIS Risk Level Indicator Analysis (EW317)A tool to analyze specific attendance, behaviors, and course Early Warning Indicator System (EWIS) indicators for students in each risk level for a selected grade.
EWIS Subgroup Analysis (EW318)Provides educators with aggregate student risk levels of not achieving their next educational outcome as determined by the Early Warning Indicator System (EWIS) by student subgroups within a District
THE NEWEST EWIS TOOLS!
Massachusetts Department of Elementary & Secondary Education
24
Insert EW 318 Screen shot
Massachusetts Department of Elementary & Secondary Education
25
Insert EW317 Screen shot
Sample of larger amount of data
Massachusetts Department of Elementary & Secondary Education
26
Postsecondary Outcome Reports
Massachusetts Department of Elementary & Secondary Education
27
Postsecondary Outcomes of Public High School Students
Collecting and analyzing data about what college-bound students actually do after graduating high school helps district and school leaders assess the effectiveness of their programs in developing graduates who are college ready.
The data for these reports are drawn from existing ESE data sources such as SIMS, SCS and MCAS as well as College Board (for SAT) , the Mass. Dept. of Higher Education HEIRS system and the National Student Clearinghouse.
Massachusetts Department of Elementary & Secondary Education
How did our students do after graduating?
The Three Basic Reports: Postsecondary Outcomes of Public HS Graduates:
All Institutions (CR301) Postsecondary Outcomes of Public HS Graduates:
MA Public Institutions Only (CR302)
Postsecondary Outcomes of Public HS Graduates:Academic Preparation (CR303)
28
Massachusetts Department of Elementary & Secondary Education
Comparing the Three ReportsPotential Questions CR301 CR302 CR30
3
How many graduates go on to postsecondary? X X XWhat type of institutions (4-year/2-year, private/public) do graduates attend?
X X X
Which specific institutions did students attended? How many went to each?
X X
What are the enrollment rates of students who complete MassCore or AP coursework compared to those who don’t?
X X X
What are the persistence and degree obtainment rates of students who complete MassCore or AP coursework?
X
What is the postsecondary experience of students from a specific subgroup? (CVTE, ELL, SWD, high needs, etc)
X X X
What percentages of students enroll in and complete remedial courses?
X X
In what remedial subjects to do students enroll? XWhat are the MCAS scores of students who take remedial coursework in math and reading?
X X
How many credits, on average, do public high school graduates earn in their first year of college?
X X
29
Use when setting
school and district goals!
Massachusetts Department of Elementary & Secondary Education
30
How many high school graduates enroll in postsecondary education?
… at MA public institutions?
On top: data from CR301; on bottom: data from CR302
Drill down to student level records
Massachusetts Department of Elementary & Secondary Education
31
What Types of Institutions are Your Students Attending?
Massachusetts Department of Elementary & Secondary Education
32
What does persistence look like across subgroups?
How many return for a 2nd year?
Massachusetts Department of Elementary & Secondary Education
33
Where did students enroll? (Anywhere in the US)
This data from CR301See CR302 for MA Public Institutions Only
Massachusetts Department of Elementary & Secondary Education
34
What are enrollment rates of students who complete AP or
MassCore?
Massachusetts Department of Elementary & Secondary Education
35
Of those in MA public postsecondary,
what % enroll in remedial courses?
In which subjects?
Data from CR302
Massachusetts Department of Elementary & Secondary Education
36
How many of your graduatesobtain a degree?
Massachusetts Department of Elementary & Secondary Education
37
… and this is just the beginning of what we can do!
We could also explore… What is the relationship between
MCAS scores and the type of institution where students enroll? (4-year, 2-year, public, or private)
What is the postsecondary experience of students from a specific subgroup (CVTE, ELL, students with disabilities, high needs, etc)?
Massachusetts Department of Elementary & Secondary Education
38
Several additional new Edwin Analytics reports may assist schools and districts in analyzing post-secondary data for program improvement.
CR304 Postsecondary Outcomes of Public HS Graduates View by MA Public Postsecondary Institution: Details postsecondary enrollment, achievement, and outcomes of MA public graduating students from a fall enrollment class in a specific MA public postsecondary institution. It also contains details by “feeder” MA public high schools. (Postsecondary data source: MA Department of Higher Education)
CR321 CVTE Graduate Pathway Summary: MA Public Postsecondary: Details postsecondary enrollment, outcomes, and continuation of vocational field of study for MA public school graduates who were CVTE concentrators and who enrolled in a MA public postsecondary institution. (Postsecondary data source: MA Department of Higher Education)
Additional Post-Secondary Reports
Massachusetts Department of Elementary & Secondary Education
39
Two other reports are available on the Student tab for those who have been granted access to student-level data:
CR608 Student High School Academic Preparation and Postsecondary Experience: This source provides student-level high school academic experience, postsecondary enrollment, and outcomes for students graduating from MA public schools and enrolling in public or private postsecondary institutions.. (Postsecondary data source: National Student Clearinghouse)
CR601 Student Progress towards MassCore: While not specific to postsecondary education, this report displays a list of high school students and their progress towards completing the MassCore recommended program of study. It identifies students who are falling behind, enables drill-drown to investigate course completion for specific students, and is available for all students in grades 9-12.
Student Level Data
Massachusetts Department of Elementary & Secondary Education
40
For more information… Watch the Edwin website for updates, including materials and professional
development opportunities: www.doe.mass.edu/Edwin
Follow Edwin on Twitter! @ Edwin_DESE
Questions can be submitted to: Edwin@doe.mass.edu
If you need access to Edwin Analytics – contact your district directory administrator (List is available at http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx)
EWIS use workshop day: October 1: http://www.surveygizmo.com/s3/2307782/Early-Warning-Indicator-System-EWIS-Workshop-10-1-15
Early warning implementation guide available at http://www.doe.mass.edu/edwin/analytics/ewis.html
Massachusetts Department of Elementary & Secondary Education
41
Success After High School DART Detail
Massachusetts Department of Elementary & Secondary Education
The District Analysis and Review Tools (DARTs) turn the Department's vast amount of data into valuable, easily consumable information.
The DARTs offer snapshots of district and school performance, allowing users to easily track select data elements over time, and make sound, meaningful comparisons to the state or to "comparable" organizations.
DARTs are free and available to the public on the ESE website
What is the DART?
46
Massachusetts Department of Elementary & Secondary Education
43
What is the Success After High School DART?
The Success After High School Dart is a DART: Detail tool DART: Detail tools provide in-depth data on targeted topic
areas The Department already released DART Detail’s: Staffing and
Finance and English Language Learners to go along with the more comprehensive DART tools
The intent of the Success After High School DART is to synthesize and summarize existing information available concerning secondary and post-secondary education in a freely, well-organized, accessible format for schools, districts, non-profit organizations, researchers, families and the general public.
Massachusetts Department of Elementary & Secondary Education
44
Example elements for DART Detail: Success After High School
High School Indicators: Graduation, dropout, suspension, and retention rates.
High School Performance: Students scoring proficient on MCAS, students scoring on SAT and AP tests, and participation in SAT and AP tests.
Program of Study: Students completing MassCore and Advanced Placement coursework. Students passing all ninth grade courses, Students passing 12th grade mathematics and science technology/engineering coursework.
Use when setting
school and district goals!
Massachusetts Department of Elementary & Secondary Education
45
Example elements for DART Detail: Success After High School (continued)
Post-Secondary Educational Outcomes: Students enrolling in post-secondary education, students persisting in post-secondary education, percentage of students enrolling in developmental (remedial) coursework in Massachusetts Public Colleges.
Workforce Development: Students participating in career/technical education by cluster, Students completing work based learning plans and Connecting Activities, links to other regional workforce development data.
Use when setting
school and district goals!
Massachusetts Department of Elementary & Secondary Education
46
DART for Success After High School is a publicly accessibletool that provides a snapshot of high school,postsecondary, and career development education data.
This tool allows users such as district and school staff, parents, students, workforce partners and organizations to:
Find comparable high schools based on demographic characteristics
Look at trends over several years
View school data in charts that are easy to interpret
Evaluate and reflect on schools and their progress
Massachusetts Department of Elementary & Secondary Education
47
Find comparable high schools based on demographic characteristics
School Overview
2012-13 Enrol lment
SchoolGradespan
MA Level 2013 WIB Region
Tota l#
High Needs
%
Low Income
%SWD
%ELL%
Brockton - Brockton HS* 09 - 12 Level 3 Brockton Area 4,081 79.2 75.7 10.6 17.2Everett - Everett High* 09 - 12 Level 3 Metro North 1,931 76.2 69.0 12.1 9.7Holyoke - Holyoke HS* 09 - 12 Level 3 Hampden County 1,354 77.4 74.9 14.3 10.9Lowell - Lowell HS* 09 - 12 Level 3 Greater Lowell 3,099 73.5 68.3 11.3 18.3Lynn - Classical High* 09 - 12 Level 1 North Shore 1,528 83.6 79.8 13.3 11.2Lynn - Lynn English High* 09 - 12 Level 3 North Shore 1,653 82.0 79.6 12.8 10.8Malden - Malden High* 09 - 12 Level 3 Metro North 1,847 67.4 59.1 12.7 12.5Quincy - North Quincy High* 09 - 12 Level 1 South Shore 1,222 59.0 51.0 12.7 9.9Quincy - Quincy High* 09 - 12 Level 2 South Shore 1,568 61.4 53.8 14.3 7.2Revere - Revere High* 09 - 12 Level 1 Metro North 1,537 75.5 71.0 10.7 7.5Worcester - Doherty Memorial HS* 09 - 12 Level 3 Central Mass 1,333 67.9 59.3 15.3 25.8
*Schools most similar to your district in terms of grade span, total enrollment, and special populations.Orange-shaded row: Your school Blue-shaded row: Highest performing of the other 10 schools.
Comparable schools
Malden - Malden High
Select comparable school
Select your school If desired, select a "comparable" school, no school or any other school.
Massachusetts Department of Elementary & Secondary Education
48
Trend over several years with easy to interpret charts
4-year cohort graduation rate
Your School
Comparable school
State
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
2008 2009 2010 2011 2012
Massachusetts Department of Elementary & Secondary Education
49
“The Waterfall”
Massachusetts Department of Elementary & Secondary Education
50
And recently released!
2006 Cohort 5 Year Grad for 2006 Cohort
Enroll in college (immediate fall)
Persist 1st-to-second year*
Graduate PS within 6 years**
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% State AvgCambridgeNeedham
Massachusetts Department of Elementary & Secondary Education
51
The Success After High School DART is available at http://www.doe.mass.edu/apa/dart/DARTSAHS.xlsx
It is openly accessible to anyone, however it is a large file due to all the data in the file, so…
a. it is best to download it to your computer andb. won’t go through most email systems
Massachusetts Department of Elementary & Secondary Education
52
Questions or comments?