The webinar will begin at 2:00 PM Eastern You are prepared to view the presentation
31
Revised NRS Guidelines Revised NRS Guidelines •The webinar will begin at 2:00 PM Eastern •You are prepared to view the presentation •To listen by phone: •Dial: 1-888-742-8686 •Conference code: 1975567 •Dial *0 for Raindance technical assistance •To maximize view, go to ‘View: Full Screen’ Planning for a Successful Data System A Project of the U.S. Department of Education
-
Upload
leslie-chang -
Category
Documents
-
view
12 -
download
0
description
A Project of the U.S. Department of Education. Planning for a Successful Data System. The webinar will begin at 2:00 PM Eastern You are prepared to view the presentation To listen by phone: Dial: 1-888-742-8686 Conference code: 1975567 Dial *0 for Raindance technical assistance - PowerPoint PPT Presentation
Transcript of The webinar will begin at 2:00 PM Eastern You are prepared to view the presentation
Revised NRS GuidelinesRevised NRS Guidelines
•The webinar will begin at 2:00 PM Eastern
•You are prepared to view the presentation
•To listen by phone:
•Dial: 1-888-742-8686
•Conference code: 1975567
•Dial *0 for Raindance technical assistance
•To maximize view, go to ‘View: Full Screen’
Planning for a Successful Data System
A Project of the U.S. Department of Education
Revised NRS GuidelinesRevised NRS Guidelines2
Webinar OverviewWebinar Overview Introduction
Larry Condelli Planning an NRS Data System
David Hollender Questions and Answers A Longitudinal Data System
Steve Coleman General Discussion
Planning An NRS Data System
March 29, 2006
4
Dave’s “Top 3” Reasons Not To Plan
1. Planning costs too much and takes too long. We can skip it.
2. No need to plan. We’ll ask (fill in name of state) if we can use their data system.
3. Our programmers are really smart. They don’t need a plan.
5
Planning is Essential
Collect All Relevant Information
Meet All State & Local Needs
Assure Expertise & Infrastructure
Implementing an NRS data system without proper planning is like teaching a class without a curriculum.
6
Steps to Success
1. Analyze Requirements
2. Prepare Requirements Document
3. Buy / Build System
4. Test
5. Rollout
Over the years, software engineering practices have developed that assure the success of new systems. These approaches minimize the risk and help to manage the cost of new systems.
7
Analyze Requirements
Functionality
Usability
Technical
8
Analyzing Requirements Functionality
Generate NRS Tables
Day to Day Program Needs
Support Decision Making
Promote Data Quality & Completeness
State Specific Needs
9
Analyzing Requirements
Usability
Who will operate system?
What will they need to do?
What Does “Easy to Use” Mean to them?
10
Analyzing Requirements
Technical
Timeliness
Security
Existing Infrastructure
Interoperability
Special Needs
11
State Director
State Data Manger
State IT Department
Program Staff
Other State Staff
Analyzing Requirements
Who Participates?
12
Prepare Requirements Document
You & Your Team
Vendors/Developers
Review
RFP
Acceptance Testing
For Whom ? For What ?
13
Requirements Document Includes
Data Items
Required Functions
Reports
Technical Needs
14
Buy / Build System
Base RFP on requirements
Evaluate responses
Ask other states
Ask local staff
Base Technical Spec on requirements
Review design
Build toward benchmarks
Buy Build
15
Testing
Prepare Test Plan
Test Functionality
Realistic environment
16
Rollout
Configuration
Data Conversion
More Testing
Training
Technical Support
17
Steps to Success
1. Analyze Requirements
2. Prepare Requirements Document
3. Buy / Build System
4. Test
5. Rollout
Planning for a Successful Data SystemPlanning for a Successful Data System
A Longitudinal Data SystemWhat it can do for you
Stephen ColemanAmerican Institutes for Research
March 29, 2006
Planning for a Successful Data SystemPlanning for a Successful Data System
What is a Longitudinal Data What is a Longitudinal Data System? System? Allows analysis across PYs. Not limited to
a snapshot of adult education students.
Contains individual student records, which allows much more flexibility in analysis and tracking of students over time.
Able to produce reports which meet NRS requirements.
Planning for a Successful Data SystemPlanning for a Successful Data System
Why a Longitudinal Data Why a Longitudinal Data System?System?
Better understand the adult education students in your state and therefore better serve them.
Answer important questions about adult education students in your state.
Planning for a Successful Data SystemPlanning for a Successful Data System
Questions it Can Answer Questions it Can Answer What is the relationship between
intensity of instruction, length of time in adult education, and educational gain?
How many students who withdraw from adult education programs re-enroll and how long is the gap between withdraw and re-enrollment?
Planning for a Successful Data SystemPlanning for a Successful Data System
Questions- Questions- Cont.Cont.
How long do students typically stay in adult education?
What characteristics (e.g., age, EFL at entry, program type) distinguish students who stay 1 year or more from those who stay for shorter periods?
Planning for a Successful Data SystemPlanning for a Successful Data System
BenefitsBenefits
Provides a more accurate and dynamic picture of adult education population.
Highlights changes across years.
Allows much more flexibility in analysis.
Planning for a Successful Data SystemPlanning for a Successful Data System
BenefitsBenefits Cont. Cont. Captures educational gain & other
characteristics regardless of when students enter or leave or their length of stay.
Facilitates exploration of the relationship of instructional variables to educational gain & other outcomes.
Planning for a Successful Data SystemPlanning for a Successful Data System
Creating a Longitudinal Creating a Longitudinal DatabaseDatabase
Create a relational database with a unique ID for every student.
Collect all data you need and anticipate needing.
Include students’ pre‑ and posttest scale scores.
Create mechanisms to export data by a range of dates.
Planning for a Successful Data SystemPlanning for a Successful Data System
Creating a Longitudinal… Creating a Longitudinal… ContCont.. Include dates for time dependent
events, such as entering a program, testing, & goal achievement.
Cleary and completely document the variables in your database.
Clearly distinguish between missing data and a negative response.
Planning for a Successful Data SystemPlanning for a Successful Data System
SummarySummary While may require additional initial
investment, has many benefits.
Provides more dynamic and accurate picture of adult education students in your state.
Compatible with NRS reporting requirements.
Planning for a Successful Data SystemPlanning for a Successful Data System
Additional ResourcesAdditional Resources NRS Tips Longitudinal Data Systems
Data Quality Campaign (http://www.dataqualitycampaign.org)- Creating a Longitudinal Data System and Measuring What Matters: Creating a Longitudinal Data System to Improve Student Achievement.
Planning for a Successful Data SystemPlanning for a Successful Data System
Additional Resources- Additional Resources- Cont.Cont. ECS: A Policymaker’s Guide to the Value of
Longitudinal Student Data (http://www.ecs.org/clearinghouse/40/21/4021.htm).
A Better Student Data System for California
(http://www-stat.stanford.edu/~rag/ed351/better_data.pdf)
Planning for a Successful Data SystemPlanning for a Successful Data System
General DiscussionGeneral Discussion To unmute your phone, dial *7 Say your name and the state you’re
from Ask a question or make a statement Dial *6 to re-mute your phone
Planning for a Successful Data SystemPlanning for a Successful Data System
Webinar EvaluationWebinar Evaluation Your feedback is important. Please
take our short evaluation. Select “File: Leave Meeting” You will be automatically directed to
the evaluation. Thank you!
