Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data...

7
Longitudinal Data Systems: Longitudinal Data Systems: What Can They Do for Me? What Can They Do for Me? Nancy J. Smith, Ph.D. Nancy J. Smith, Ph.D. Deputy Director Deputy Director Data Quality Campaign Data Quality Campaign November 30, 2007 November 30, 2007

Transcript of Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data...

Page 1: Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data Quality Campaign November 30, 2007.

Longitudinal Data Systems:Longitudinal Data Systems:What Can They Do for Me?What Can They Do for Me?

Nancy J. Smith, Ph.D.Nancy J. Smith, Ph.D.

Deputy DirectorDeputy Director

Data Quality CampaignData Quality Campaign

November 30, 2007November 30, 2007

Page 2: Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data Quality Campaign November 30, 2007.

22

Creating a Robust P-12 Creating a Robust P-12 Longitudinal Data SystemLongitudinal Data System

10 Essential Elements:10 Essential Elements:

1.1. Unique statewide student identifier with the ability to connect data across Unique statewide student identifier with the ability to connect data across multiple databases (45)multiple databases (45)

2.2. Student-level enrollment, demographic and program participation Student-level enrollment, demographic and program participation information (49)information (49)

3.3. Ability to match individual students’ test records from year to year to Ability to match individual students’ test records from year to year to measure growth (46)measure growth (46)

4.4. Information on untested students and the reasons why they weren’t tested Information on untested students and the reasons why they weren’t tested (37)(37)

5.5. Teacher identifier system with ability match teachers to students (18)Teacher identifier system with ability match teachers to students (18)6.6. Student-level transcript information, including information on courses Student-level transcript information, including information on courses

completed and grades earned (17)completed and grades earned (17)7.7. Student-level college readiness test scores (14)Student-level college readiness test scores (14)8.8. Student-level graduation and dropout data (49)Student-level graduation and dropout data (49)9.9. Ability to match student records between the PK-12 and post-secondary Ability to match student records between the PK-12 and post-secondary

systems (22)systems (22)10.10. State data audit system assessing data quality, validity, and reliability (42)State data audit system assessing data quality, validity, and reliability (42)

Page 3: Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data Quality Campaign November 30, 2007.

33

Element 9Element 9The ability to match student records between the P–12 and higher The ability to match student records between the P–12 and higher education systemseducation systems

Ability to Match P-12 to Higher Education Data:Ability to Match P-12 to Higher Education Data: Is there a means of matching Is there a means of matching the P-12 records of individual students with each student’s records in your the P-12 records of individual students with each student’s records in your state’s postsecondary system?state’s postsecondary system?

Barriers to Matching:Barriers to Matching: If you are unable to connect student data between the If you are unable to connect student data between the P-12 and postsecondary systems in your state, but are not forbidden by law P-12 and postsecondary systems in your state, but are not forbidden by law to do so, what are the barriers you face?to do so, what are the barriers you face?

Characteristics of Shared Data:Characteristics of Shared Data: Are data shared? If so, how are your P-12 Are data shared? If so, how are your P-12 student-level transcript and/or performance data shared with postsecondary student-level transcript and/or performance data shared with postsecondary education in your state? education in your state?

Match Rate:Match Rate: How often is the match rate between student records in P-12 How often is the match rate between student records in P-12 and postsecondary analyzed?and postsecondary analyzed?

Policy Oversight about Matching P-12 and Postsecondary Data:Policy Oversight about Matching P-12 and Postsecondary Data: Is there a Is there a statewide group/council that meets regularly to discuss policies related to P-statewide group/council that meets regularly to discuss policies related to P-20 longitudinal data systems?20 longitudinal data systems?

Page 4: Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data Quality Campaign November 30, 2007.

44

Sample Policy QuestionsSample Policy QuestionsThe percentage of each district’s high school graduates who enrolled in public higher education institutions within 15 months after graduation

The percentage of last year’s graduates from each high school or school district who needed remediation in college, and how this percentage varied by student poverty status and ethnicity.

The percentage of students who met the proficiency standard on the state high school test and still needed remediation in the same subject in college.

How students’ ability to stay in and complete college is related to their high school courses, grades and test scores.

The percentage of students receiving Special Education services in P-12 who go on to public higher education institutions in the state.

Page 5: Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data Quality Campaign November 30, 2007.

55

Common Challenges to Common Challenges to Forming a PK-16 Data SystemForming a PK-16 Data System

• Perceived barriers due to Family Educational Rights and Privacy Act (FERPA) regulations inhibit data sharing.

• Perceived problems with collection of student Social Security Numbers affects matching data between P-12 and higher education.

• Data system infrastructure at each level

Page 6: Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data Quality Campaign November 30, 2007.

66

Actions to EncourageActions to EncourageP-20 Data SharingP-20 Data Sharing

Foster political buy-in from all levels on-going support to ensure that it remains after personnel and leadership changes.

Designate one or more organizations to act as an authorized evaluator/researcher of student and teacher data for the purpose improving student achievement.

Establish a Memorandum of Understanding (MOU) between P-12 and higher education to share data.

Create a technical subcommittee to P-20 Council.

Create a centralized data system at each level for economies of scale, efficiency and data consistency.

Page 7: Longitudinal Data Systems: What Can They Do for Me? Nancy J. Smith, Ph.D. Deputy Director Data Quality Campaign November 30, 2007.

77

Nancy SmithNancy Smith

[email protected]@DataQualityCampaign.org

512.320.1888512.320.1888