Michigan Early On Part C Data Collection Profile Report

36
Michigan Early On Part C Data Collection Profile Report February 26, 2014 Presented by Allan Knapp, PhD Michigan Part C Data Manager Early On® Training and Technical Assistance

description

Michigan Early On Part C Data Collection Profile Report. February 26, 2014 Presented by Allan Knapp, PhD Michigan Part C Data Manager Early On® Training and Technical Assistance. Today’s Contents. Explanation of terms used in the Data Profiles (e.g. Percent, %Change, Rank) - PowerPoint PPT Presentation

Transcript of Michigan Early On Part C Data Collection Profile Report

Page 1: Michigan Early On Part C Data Collection Profile Report

Michigan Early On Part C Data Collection Profile Report

February 26, 2014

Presented byAllan Knapp, PhD

Michigan Part C Data ManagerEarly On® Training and Technical

Assistance

Page 2: Michigan Early On Part C Data Collection Profile Report

Today’s ContentsExplanation of terms used in the Data Profiles

(e.g. Percent, %Change, Rank)Description of the CALCULATIONS used for the

Data Profiles (update of last August’s webinar at EOTTA site)

Availability of Data Profiles◦See June 2010 through June 2013 NOW at

www.earlyondata.com ◦Fall 2013 should be available in March; we will have a

follow up webinar thenQuestion and Answer interspersed and at the end

2/26/2014 EOTTA Data Profiles Webinar 2

Page 3: Michigan Early On Part C Data Collection Profile Report

Early On Data Group ListservThe listserv uses Yahoo Groups; all you need

to do is check “listserv only”To join, you need to be invited; for an

invitation, send an email to Allan Knapp [email protected] or call ◦ (517) 485-8181

If you received an email from the [email protected] on behalf of Nancy Surbrook on Thursday, Feb 20, then you are effectively on the listserv

2/26/2014 EOTTA Data Profiles Webinar 3

Page 4: Michigan Early On Part C Data Collection Profile Report

Finding MSDS InformationGo to www.michigan.gov/CEPIChoose the CEPI Applications

option on the leftThen choose the Michigan

Student Data System (MSDS) option

OR Go to http://

www.michigan.gov/cepi/0,4546,7-113-986_50502---,00.html

2/26/2014 EOTTA Data Profiles Webinar 4

Page 5: Michigan Early On Part C Data Collection Profile Report

EXPLANATION OF TERMS

2/26/2014 EOTTA Data Profiles Webinar 5

Page 6: Michigan Early On Part C Data Collection Profile Report

Main Page Information - 1H H H B gHChoose between State and Service Area

profiles in left dropdownChoose collections back to June 2010 in right

dropdownCounts come from data provided by Service

AreaCounts of 5 or less (oops) are “masked” with ** Repeated at bottom

2/26/2014 EOTTA Data Profiles Webinar 6

Page 7: Michigan Early On Part C Data Collection Profile Report

Main Page Information - 2HHHBgG

Percent for snapshot, period, Age counts are “percent served” based on MI birth data

Percent for other variables are percent for a specific code within the variable (e.g. see SETTING)

Ranks are done with 1 for LARGEST percent and 56 for smallest. Ties are settled by larger number of children served, then by lowest ISD code.

Print by clicking Print Report in upper left corner2/26/2014 EOTTA Data Profiles Webinar 7

Page 8: Michigan Early On Part C Data Collection Profile Report

State View – Top

2/26/2014 EOTTA Data Profiles Webinar 8

No ranks for State

Ind 6 value

Ind 5 value

Page 9: Michigan Early On Part C Data Collection Profile Report

State View – Middle

2/26/2014 EOTTA Data Profiles Webinar 9

No ranks for State

Ind 6 value

Ind 5 value

Page 10: Michigan Early On Part C Data Collection Profile Report

State View – Bottom

2/26/2014 EOTTA Data Profiles Webinar 10

No ranks for State

Ind 6 value

Ind 5 value

Page 11: Michigan Early On Part C Data Collection Profile Report

Indicators – light yellow highlight, with Target value appendedIndicator 6 – Child Find Birth-3, target 2.70%Indicator 5 – Child Find Birth-1, target 1.24%Indicator 2 – Setting in Natural Environment,

target 93.00%Indicator 1 – Timely Start of Service, Target

100%Indicator 7 – Timely Initial IFSP, Target 100%Indicator 8a – Timely Transition Plan, Target

100%Indicator 8c – Timely Transition Conference,

Target 100%

2/26/2014 EOTTA Data Profiles Webinar 11

Page 12: Michigan Early On Part C Data Collection Profile Report

Indicators – usageIndicators 2, 5, and 6 have been and will

be used for Federal Child Count submissions, APR, and Public Reporting

Indicators 1, 7, 8a, and 8c are reported in the Data Profiles the way the data come through the MSDS data system◦ Indicators 1,7,8a,and 8c are all 100%

required variables◦ If you have 0.0% on any of these, something

is wrong with your SIS1,7,8a,8c from MSDS will be used for

CIMS and Public Reporting eventually

2/26/2014 EOTTA Data Profiles Webinar 12

Page 13: Michigan Early On Part C Data Collection Profile Report

Masking (5 or less, **)Smaller Service Areas have more

masked values. Heading needs to be corrected –

it says less than 5Masking is done for FERPA

reasons

2/26/2014 EOTTA Data Profiles Webinar 13

Page 14: Michigan Early On Part C Data Collection Profile Report

Birth CountsPrior to Fall 2012, birth counts by

County were assigned to counts by ISD by names (e.g. add Marquette and Alger county counts to get Marquette-Alger ISD count)

Starting Fall 2012, using 2010 census County and ISD counts for ratios and “geocoding” to identify the county where each birth mother resides.

Three years’ births for Snapshot denominator; four years for Period

2/26/2014 EOTTA Data Profiles Webinar 14

Page 15: Michigan Early On Part C Data Collection Profile Report

Anachronisms – old ideas in current viewPeriod Change is the count and

percent change in Cumulative Counts between collections.

6mon, 12mon, 18mon was more accurate when collections were Dec 1 and June 1

Value was greater when Period count was part of the Funding Formula Allocation

2/26/2014 EOTTA Data Profiles Webinar 15

Page 16: Michigan Early On Part C Data Collection Profile Report

Percent Change (far right column)The COUNT from this collection is

compared to the count from the immediately prior collection.

The immediately prior collection is named.

If there is no value in either the current or the prior collection, “n/a” is assigned.

Negative change (in red) means the number decreased. Positive change (black) means an increase.

2/26/2014 EOTTA Data Profiles Webinar 16

Page 17: Michigan Early On Part C Data Collection Profile Report

RankingsNo rankings assigned in State Data ProfileRecall ranks are done with 1 for LARGEST

percent and 56 for smallest. Ties are settled by larger number of children served, then by lowest ISD code.

Often a rank <7 or >50 is an “outlier” – it is different from most districts and should be examined

We are working on a new report that will present all 56 Service Areas plus the State, in rank order. This may help you see who is doing well in some area where you need improvement

See next screen for example

2/26/2014 EOTTA Data Profiles Webinar 17

Page 18: Michigan Early On Part C Data Collection Profile Report

Sample Ranking Listisd Total Seelig SeeligPer SeeligRnk23 3 3 100.00 150 820 649 79.15 256 97 69 71.13 338 148 105 70.95 435 23 16 69.57 513 93 62 66.67 641 715 471 65.87 779 47 30 63.83 832 33 20 60.61 934 128 74 57.81 1030 90 50 55.56 1121 80 42 52.50 1259 64 33 51.56 1382 1246 631 50.64 1428 160 78 48.75 1509 91 42 46.15 1603 95 42 44.21 1739 227 100 44.05 1862 46 20 43.48 1963 688 269 39.10 2046 102 38 37.25 2158 124 46 37.10 2273 205 73 35.61 2361 171 60 35.09 2480 144 47 32.64 2583 81 26 32.10 2674 129 41 31.78 2744 72 22 30.56 2815 61 18 29.51 2929 84 24 28.57 3070 396 113 28.54 31

2/26/2014 EOTTA Data Profiles Webinar 18

Page 19: Michigan Early On Part C Data Collection Profile Report

Specific Service Area view - Top

2/26/2014 EOTTA Data Profiles Webinar 19

Page 20: Michigan Early On Part C Data Collection Profile Report

Specific Service Area view - Middle

2/26/2014 EOTTA Data Profiles Webinar 20

Page 21: Michigan Early On Part C Data Collection Profile Report

Specific Service Area view - Bottom

2/26/2014 EOTTA Data Profiles Webinar 21

Page 22: Michigan Early On Part C Data Collection Profile Report

Snapshot CountThe snapshot count will equal

◦Sum of ‘Age<1’ plus ‘Age 1-2’ plus ‘Age 2-3’◦All the ethnic counts◦All the Setting counts◦All the Service Coordinator counts

The snapshot count is the denominator for ◦The Males percent◦The Special Ed Eligible percent◦All the percents in the Ethnic, Setting,

Service Coordinator and Age sections

2/26/2014 EOTTA Data Profiles Webinar 22

Page 23: Michigan Early On Part C Data Collection Profile Report

Period CountThe period count will equal

◦Sum of Snapshot plus TOTAL EXITS◦All the Timely Start of Service counts

2/26/2014 EOTTA Data Profiles Webinar 23

Page 24: Michigan Early On Part C Data Collection Profile Report

Explanation of Calculations

2/26/2014 EOTTA Data Profiles Webinar 24

Page 25: Michigan Early On Part C Data Collection Profile Report

Early On Data Field Flow

2/26/2014 EOTTA Data Profiles Webinar 25

ServiceArea A

ServiceArea B

ServiceArea C

MSDSCollections

(child level)

Early On PlatinumFile(child level)

Federal Tables(state level)

APR(state level)

Public Reports(Service Area Level)

CIMS / Determinations(Service Area Level)

WSU AssessmentAnalysis(Service Area and State Levels)

DEF..

MSDS Rules

Platinum File Rules

ProcessingRules

Data Portraits(Service AreaAnd State Levels)

Page 26: Michigan Early On Part C Data Collection Profile Report

Countability RulesA child is countable on count date

if◦Child’s birth date is prior to the count

date◦Child is less than three years old on

the count date◦CurrentIFSP is on or prior to the count

date◦Current IFSP is within one year of the

count date◦PartCExitDate is blank

2/26/2014 EOTTA Data Profiles Webinar 26

Page 27: Michigan Early On Part C Data Collection Profile Report

Deduplication RulesUIC is the main criterion

◦Only one record per UIC in federal counts◦In State count:

Only one record per UIC in snapshot count Only one record per UIC/Service Area (SA) combo State level cumulative count can have the same

UIC in multiple Service Areas (at most one in snapshot)

What happens when there is more than one allowable, countable record for a UIC?◦ The official rules worked well for Fall 2013:

Most recent CurrentIFSP Special Ed eligibility

2/26/2014 EOTTA Data Profiles Webinar 27

Page 28: Michigan Early On Part C Data Collection Profile Report

Processing Rules DefinitionsValues – lists the possible MSDS

valuesPopulation – describes the

records that will be used in evaluating the given indicator

SIS Responsibility – federal and state expectations for reported values

Calculation – how the indicator value is determined from the data received 2/26/2014 EOTTA Data Profiles Webinar 28

Page 29: Michigan Early On Part C Data Collection Profile Report

Processing Rules – Indicators 2(setting), 5 and 6 (child counts)Values:

◦Ind2: 31 and 41 are good, 38 (other) is badPopulation: subsets of the snapshot count

◦Ind 2: select all snapshot children◦Ind 5: select snapshot children under the age

of one◦Ind 6: select all snapshot children

SIS: accurate birth, setting, IFSP date, ExitInd 2 Calculation: (31’s +41’s) / Snapshot

2/26/2014 EOTTA Data Profiles Webinar 29

Page 30: Michigan Early On Part C Data Collection Profile Report

Processing Rules – Indicators 1, 7, 8

NOTE: The 2012-2013 values for these three indicators will come from Self-Assessments, NOT from MSDS data◦1 – Timely Service Start◦7 – Initial IFSP 45 day timeline◦8a – Transition Plan◦8c – Transition Conference

2/26/2014 EOTTA Data Profiles Webinar 30

Page 31: Michigan Early On Part C Data Collection Profile Report

Processing Rules – Indicator 1(A)Possible Values:

◦01 – Timely new services◦02 – Valid reasons◦03 – Untimely services◦04 – No new services

Population: Cumulative countCalculation: Leave out 04’s

◦(01’s + 02’s) / (01’s + 02’s + 03’s)

2/26/2014 EOTTA Data Profiles Webinar 31

Page 32: Michigan Early On Part C Data Collection Profile Report

Processing Rules – Indicator 1(B)SIS Responsibility

◦Identify all NEW services◦Compare the start date of each new

service against the authorizing IFSP date (timely is within 30 days)

◦Identify if there was a valid reason for a start date > 30 days after the IFSP

◦Untimely Services must be chosen if at least one new service was late without an acceptable reason

2/26/2014 EOTTA Data Profiles Webinar 32

Page 33: Michigan Early On Part C Data Collection Profile Report

Processing Rules – Indicator 7Possible Values:

◦01 – Timely◦02 – Untimely◦03 – Acceptable

Population: Children in the Cumulative count whose Initial IFSP was held within the 12 month period ending on Count Date, formed by joining two collections together

SIS: If InitialIFSPDate > 45 days after ReferralDate, the code should not be Timely

Calculation: (01’s + 03’s) / (01’s+02’s+03’s)

2/26/2014 EOTTA Data Profiles Webinar 33

Page 34: Michigan Early On Part C Data Collection Profile Report

Processing Rules – Indicator 8aPossible Values:

◦01 – Timely◦02 – Untimely◦03 – Untimely for Acceptable Reason

Population: Children from the Cumulative count who were countable when they reached 2 years and 9 months of age. (All these children should have a Transition Plan)

SIS: ◦Transition Plan should occur between age of 2

years 3 months and 2 years 9 monthsCalculation: (01’s + 03’s) / (01’s+02’s+03’s)

2/26/2014 EOTTA Data Profiles Webinar 34

Page 35: Michigan Early On Part C Data Collection Profile Report

Processing Rules – Indicator 8cPossible Values:

◦ 01 – Timely◦ 02 – Untimely◦ 03 – Acceptable

Population: Children from the Cumulative count who were ◦ Countable when they reached 2 years and 9

months of age◦ Special Ed eligible

SIS: ◦ Conference should occur between age of 2 years 3

months and 2 years 9 monthsCalculation: (01’s + 03’s) / (01’s+02’s+03’s)

2/26/2014 EOTTA Data Profiles Webinar 35

Page 36: Michigan Early On Part C Data Collection Profile Report

Question and Answer…If you are cold, why should you

go in the corner?

2/26/2014 EOTTA Data Profiles Webinar 36