Mining GED Analytics™ for routine reports FINAL

GEDtestingservice.com • GED.com

Mining GED Analytics™ for Routine Reports and Insights

Jane Bledsoe

Join the conversation! #GEDTS16 #LearnLeadInspire


Agenda

• 2016 Super Users!

• What’s new in GED Analytics™?

• Routine reports

• Special reports

• Tips and tricks and lessons learned from administrators

• What’s coming next?

2


Super users

• These GED® State Administrators have used GED Analytics™more than once/day for the past two years

• Tap into their expertise for more ideas on how they use GED Analytics™!– Valerie Fischer, ND

– Tobias Wood, KS

– Rae Smith, KY

– Tambra Nicholson, AR

– Sue Mansfield, VA

– Molly Dugan, MD

3


What’s new in GED Analytics?

• GED College Ready and GED College Ready + Credit

• New information displayed in existing reports– County

– Student opt-in for marketing

– Exam language

• Completer and First time Completer

• Weekly trend for program-to-date

• New user guide link

4


GED College Ready and GED College Ready + Credit Prominently Displayed on Test Summary Tab

5

• The percentages reflect test-takers with at least one test at the College Ready and/or College Ready + Credit level

• These headline reports have a detailed report behind them allowing you to:- Identify Test Centers with the highest number of College-Ready tests and test-

takers- Track numbers of College-Ready students that may be seeking local college

admittance


County information can be found on several reports in GED Analytics™

6

• Reports where County information is available:o Test-Takerso Completerso Passerso GED Tests Taken


Students Opt-in to Marketing Available on Several Reports

7

• Available on Passers Report on the Test Taker Summary Tab• Passed 1, 2, 3 Tests and Passed All Tests on Performance Summary Tab

• Permission to send Marketing offers can be leveraged for local program outreach


Exam Language Available on GED® Tests Report

8

• In GED® Tests Report, College Ready and College Ready + Credit Reports on Test Summary Tab

• ESP = Spanish;; ENU = English• Additional analysis can be done in Excel to understand pass rates for Spanish (ESP) tests


Completer and First Time Completer number• The Completer metric shown in the first row of numbers on the Test Taker Summary tab is the Completer number used in the Pass Rate calculation

• It includes first-time Completers as well as anyone who may have had a Completion activity in the timeframe you selected

• First Time Completers – the original way we computed Completers – is still available in the second row for historical tracking

• Completers will equal First Time Completers when you select program-to-date reporting• Review the definition provided for the Completer number if you have a question about its definition

9


Weekly Trend for Program To-DateThe view has been expanded so you can see weekly trends for the entire 2014 series – test volume, test takers and completers

10

Test Summary Tab

Test Taker Summary Tab


New User Guide now available on GED Analytics™

• Describes each of the utilities on the site (print, support, save, etc.)

• Demonstrates how to filter your reports

• Highlights the most important content on each tab

11


What are State Administrators Using Routinely?• Test takers weekly, monthly, quarterly tracking• Pass rate comparisons for different student populations• Performance gains tracking for program funding• % College-ready for WIOA tracking• No Show management• Test Center activity reporting• DOC and Regional reporting• GED Ready™ voucher usage

12


Test-takers Weekly Volume Review

• If you want to see all activity for the prior week, select the prior week in the date filter on the Performance Summary tab– See last week’s test takers, tests taken, GED Ready® tests taken, and how many passed 1, 2, 3, or all tests;; you can also see test volumes by subject area tests

• If you merely want to see week over week test volumes, go to the Test Summary page and hover over the week of choice to get a quick snapshot of your test volume compared to prior weeks

13

Several administrators check GED Analytics™ every Monday morning to see the prior week’s volume


Test-taker Weekly Trends Comparison: Public Test-takers vs. Corrections• Beth Lewis (WI) noticed a difference in weekly test-taker trends for public test-takers vs. Corrections test-takers when she looked at the weekly test-takers report on the Test-Taker Summary Tab

• She used the inmate filter (“true”) on the Test-Taker Summary Tab to show the results on the right

14

No significant drop-off in Corrections test-takers during summer months


Monthly Comparisons: Volume and Performance• Rae Smith (KY) shows state leaders the change in numbers of test-takers and performance month-to-month– Use the Test Summary tab for volume of tests by month – Change the date range in the date filter to compare this month with last for test-takers in the pipeline: Test-takers, Completers and Passers

15

May 1 –May 31, 2016 Jun 1 – Jun 30, 2016

1,205Test-takers

411Completers

356Passers

1,194Test-takers

472Completers

437Passers


AR Program Supervisors Use Reports to Prepare for Visits to Adult Education Programs• Tambra Nicholson prepares PDFs of the Test Taker Summary, Performance Summary and Demographics tabs for program supervisors– In the Test Center Selector, Tambra selects the Test Center location (all are tied to an adult education program), and prepares a PDF of each tab by clicking the print icon in the upper right corner of each page

16

Test Taker Summary Performance Summary Demographics Summary


KS Quarterly Meetings Compare Results of Public Students with Corrections Students

Public Student Performance Corrections Student Performance

17

Tobias Wood (KS) uses the Inmate filter on the Performance Summary tab and selects ‘false’ for public students results;; he selects ‘true’ for Corrections results


Performance Gains Tracking: How Many Test-takers Achieve 165 or Better Over Time

College Ready and College Ready plus Credit on Test Summary Tab

This information can be downloaded and sorted to determine which programs yield the most college-ready students

18

• In ND, Valerie Fischer tracks the number of students who achieve 165 or better• She uses this with her Community College partners to let them know who is in the college pipeline, and for WIOA tracking

2014 2015


Performance Gains Tracking: Number of Students That Take GED Ready® That are Also on a Passers Report• In AR, performance gains for state funding are determined by reviewing the students that took a GED Ready® and are on a Passers Report

• In the example below, the date range is Jan 1 – June 30, 2016;; several hundred GED Ready test-takers were passers during this timeframe

19

Several hundred demonstrate performance gains when lists are combined in Excel


No Shows Management – Especially Important in States that Subsidize the Cost of the Test• In AR and KY, a portion of GED® test fees are paid for students

• No Shows cause expense without outcomes in these states

• No Shows management involves downloading the list of test-takers and putting rules in place for future scheduling– In AR and KY, No Shows are not given another testing voucher on future test appointments

20


Test Center Activity Reporting• Rae Smith (KY) uses the Test Center list for the most up-to-date information about testing activity at sites

• The list has been recently updated with the number of test-takers as well as tests delivered

• On the Performance Summary Tab, click on the number of Test Centers to get a list of all testing activity at each location

21


Corrections Reporting: Separating DOC from Local Jails/Facilities’ Performance• All inmates (DOC, county and local facilities) are grouped together in GED Analytics™

• To determine performance at DOC facilities versus local jails, KS and KY administrators use Test Center Ids in the Test Center filter to identify performance for different types of institutions

22

Department of Corrections County Jails and local facilities


Regional Reports Use a Variety of Filters to Capture Performance Data• Sue Mansfield (VA) has 22 regions made up of a variety of test centers, zip codes and Corrections locations

• VA has a high percentage of Options students which can skew results positively or negatively• Sue uses the Postal Code filter to identify the students that should be counted in a region for performance tracking

• Inmates can be filtered out by selecting ‘false’ for the inmate filter• Each tab on GED Analytics can be saved and downloaded as a report for each region• A region with a high percentage of its students in Options requires a breakdown of performance by Options versus Traditional adult education students

23

Region 12


GED Ready® Practice Test Voucher Use• You can check to see which vouchers purchased have been used by GED Ready® test-takers

• You can also see performance of GED Ready® (zone 1 = Not Likely to Pass;; zone 2 = Too Close to Call;; zone 3 = Likely to Pass)

• Test-takers in zone 1 could be referred to adult education classes

24


Using GED Analytics™ for Special Reporting Needs• Rotary meetings• Decisions to close programs• Out-reach to disengaged students• Legislators and community meetings• Contract negotiations

25


Rotary Clubs Looking for Information About the Typical GED® Test-taker• Valerie Fischer (ND) uses the Demographics Tab to describe the typical North Dakota GED® test-taker

26


Making a Decision to Close a Program

• Valerie Fischer (ND) had to make a decision about whether or not to close a funded program

• In addition to GED Analytics™data, provided in the table below, Valerie uses LACES and NRS data to determine EFL gains

• What would you do, if your data for a program looks like this but students are making EFL gains? What if they are not making EFL gains?

27

Test Center & Adult Ed program “X”

2014 2015 2016

GED.com Accounts 12 14 16

Tests delivered 19 19 72

Test Takers 9 12 26

Passers 2 1 6

Pass Rate 100% 100% 75%


Outreach to Disengaged Students: Use Date of Last Activity to Contact Before 90 Days Goes By • The majority of disengaged GED®candidates do not come back after 90 days of inactivity

• You can intervene if you know what the student’s last activity date is, and follow-up with them on next steps

• The following reports should be reviewed for last activity– Completers: look for test-takers who completed their 4th test but did not pass

– GED.com Accounts: look for test-takers who created an account but have not engaged in other activities

– GED Ready – zone 1 performance: look for test-takers who completed a GED Ready and received a Not Likely to Pass score during the past 90 days

28


Legislative and Community Meetings

• In AR, community groups and legislators have asked the state office to provide insight on the 16 and 17 year olds they are serving in adult education classes– Use the age filter to get data on just 16 and 17 year olds

– Use the zip code report to see which legislative districts they reside in

– Use the GED tests taken report to find county information for 16 and 17 year olds

– Use the Test Center list to determine where most 16 and 17 year olds are receiving services

29

Filter by age

Zip Code report

GED Tests Taken Report

Test Center list


Contract Negotiations

• Tobias Wood (KS) has seen a striking difference in student progress between two different agencies providing GED® test prep in Corrections

• Each has sent about the same number of inmates to a Test Center to test

• Which program is producing better results?

• This information is being used in contract negotiations with the service provider with lagging performance

30

GED® Test Prep Provider #1 GED®Test Prep Provider #2


Tips and Tricks from Users- Save your filters/reports

- Notice data anomalies

- Changes in policy can trigger changes in data and performance

31


You Can Save Your Filtered Reports!

• Rae Smith (KY) saves her filtered reports so she doesn’t have to re-enter Test Center IDs or zip codes more than once for a report she will need again in the future

• Once you have created the filters in a report that you want to save, click on Save current view in the drop-down arrow next to Unsaved View

• You will name the report for future reference and click on the green Save button

• Saved reports are not shared, and other users cannot see this view of the report

32


If Something Doesn’t Look Right, it May be How the Information is Being Gathered• Tobias Wood saw some data anomalies in the demographic information for his Corrections population

• Looking into it more closely, he discovered that Test Centers were randomly entering data, and not gathering it from inmates

• A new process is being put into place to get the right demographic data from the inmates to accurately reflect their demographics

33


Watch for Evidence of Policy Changes in Your Data• Because of a change in Kentucky’s compulsory school attendance law, students must now be 18 and over to take the GED® test

• Since June of 2014, demographics shifted from average age of 25 to average age of 28

• Pass rate shifts may take place as the students served in adult education classes are older and have more years without formal education

34

June 2014 June 2016


What’s Coming Next in GED Analytics™?

35


Development Opportunities

• A view of GED Analytics™ can be created so that specific types of users can see only their data– We can make this view available for Test Center users and Corrections users to see only the students they serve and not others in your jurisdiction

• As more students select an Adult Education Program, we will tie students to adult education programs in GED Analytics™

– Development timeline is dependent on critical mass so that data is significant and statistics are meaningful

36


Questions?

37


Thank you!

38

Join the conversation!#GEDTS16 #LearnLeadInspire

[email protected]

[email protected]

952-681-4874

Mining GED Analytics™ for routine reports FINAL

Documents

Transcript of Mining GED Analytics™ for routine reports FINAL