Data Analysis and Research

Data Analysis and ResearchNebraskas 2012State Longitudinal Data System Grant Institute of Education SciencesNE Data Analysis and Research1Goal 1Provide a data analysis tool for districts that uses multiple local and state data sources to produce reports for local decision makers.

Deliverable:1.1A Data Analysis and Reporting Tool (DART) Process:Build or buy decision on the data dashboard toolDevelop or customize with several pilot districtsExpand throughout the state

NE Data Analysis and Research2Goal 2Provide a statewide system of professional development training for data analysis that reaches every district.

Deliverables: 2.1Training materials2.2Delivery of training to every district2.3Monitoring and evaluation of training

NE Data Analysis and Research3Goal 2 ProcessTier 1 The Data Analysis Cadre would train the 35-40 professional developers in the data analysis framework and training materials

Tier 2 The Professional Developers and Data Analysis Cadre would train teams of educators from multiple school districts to provide training at their respective schools

Tier 3 The Professional Developers, Data Analysis Cadre and district staff, trained under Tier 2, will facilitate data analysis sessions for staff from entire school buildings and/or districts

Tier 4 The Data Analysis Cadre and Professional Developers will provide ongoing support to schools in the effective use of dataNE Data Analysis and Research4Goal 3Build a research and evaluation operation in NDE collaboratively with the research community.

Deliverables:3.1Training for NDE program staff3.2Disseminating data, research and analysis findings

NE Data Analysis and Research5Goal 4Expand and enhance the SLDS for sustainability.Deliverables:4.1Customer Relationship Management4.2Data Governance Plan Components4.2.1Data dictionary aligned with CEDS4.2.2Data model 4.2.3Metadata4.3Interstate Locator4.4Enrollment data support

NE Data Analysis and Research6Stakeholder InvolvementPolicy Advisory CommitteeSimilar to the previous reporting advisory groupProvide input into the overall implementation of grant activitiesGoal 1 Build or buy decisionDistricts to pilot dashboardsMonitor progress through quarterly meetingsAssist with the evaluation plan

NE Data Analysis and Research7District Data Collections GroupData stewards from across the stateSupport for the technical side of data collectionsConference calls on issuesProvide feedback to changes in NSSRSAdvice on how to assist districtsRequesting volunteers to expand this group

NE Data Analysis and Research8Professional Development GroupESU Data Analysis Cadre6 8 professional development staff from ESU and NDE Research and Evaluation teamDevelop curriculum for data analysis trainingIncorporate work trainers have been doing wherever possibleTrain the ESU professional developers By year 3, provide training to every district

NE Data Analysis and Research9Research and Evaluation TeamNo external stakeholder group identified in the grantResearch and Evaluation team will be an ongoing cross-team groupTrainers (Russ Masco, Ben Baumfalk, Matt Heusman, Rachael LaBounty)NDE staff with experience, expertise or interest in program evaluation and researchResearch Review BoardData Access and Use Policy and Procedures Approve research proposalsNot in grant but a P-20 Data advisory group for postsecondaryNE Data Analysis and Research10Data Governance Plan (Goal 4)Identifies the processes, groups and components involved in data collection and use in NDEIncludesNebraska Student and Staff Record System (NSSRS)Consolidated Data Collection (CDC)Teacher Certification system (TCS)Nutrition Services (Coylar System) Grants Management System (GMS)P-20 postsecondary NE Data Analysis and Research11Components of Data Governance Plan Policy (ultimate authority)Leader of each systemAdvisory GroupsManagement Team and Technical TeamData access policies and proceduresMetadata StandardsReportingData QualitySecurityContingency PlanningNE Data Analysis and Research12Example: NSSRSComponentExisting PolicyLeaderAdvisory GroupData AccessCommissionerDRE Leadership CouncilNSSRS ExecData Access and Use Policy and ProceduresResearch Review BoardAdmin Memo #711New admin memo on data qualityNE Data Analysis and Research13NSSRS continuedComponentExistingMetadata Standards

ReportingData dictionaryBusiness rulesInstructions for reportingProgram guidanceForms review and approval process (Admin Memo 709)

State of the Schools ReportData Reporting SystemNE Data Analysis and Research14NSSRS continuedComponentExistingData Quality

Security

Contingency PlanningNew admin memo that identifies responsibilities for data quality TrainersTools such as verification reports and validations

Levels of AccessFERPA and Privacy Act Backup systemsNE Data Analysis and Research15Goal 4 SustainabilityData Dictionary aligned with CEDS - Common Education Data StandardsData Dictionary is a document identifying every data element collected Characteristics and definitionsNDE had a data dictionary when NSSRS began but it has not been maintained and does not contain information on personally identifiable information (PII) as required for FERPA (Family Education Rights and Privacy Act)

NE Data Analysis and Research16CEDSThe Common Education Data Standards (CEDS) is a specified set of the most commonly used education data elements to support the effective exchange of data within and across states, as students transition between educational sectors and levels, and for federal reporting. The standards are being developed by NCES with the assistance of a CEDS Stakeholder Group SLDS grant uses an external stakeholder group for developing the data dictionary aligned with CEDs

NE Data Analysis and Research17Goal 4 Other activitiesCustomer Relations Management (CRM)Support the Helpdesk with ticket management Create a directory of Agency staff responsible for reporting that could include --SuperintendentsData StewardsHuman Resources directorsSpecial Education directorsDistrict Assessment CoordinatorsProposed software can do much more so still exploring possibilities

NE Data Analysis and Research18Data Model and MetadataIncludes the guidance, instructions, business rules and formulas for using the data Currently some exist but in multiple formats and locationsDoes NOT attempt to put everything into one document but to serve as a resourceAnd to ensure that the components exist NE Data Analysis and Research19Interstate LocatorNebraska and neighboring states (Iowa, Kansas and Missouri) all use eScholars templates for student dataInterstate locator would enable Nebraska districts to check a central location to determine if a student that left a district in one state (without forwarding district information), could be found in one of the other statesNDE was involved in original proposal and has been working with the other states to develop an MOU that would allow thisFunds were approved but still want this to be reviewed by the Policy Advisory CommitteeNE Data Analysis and Research20Enrollment Data SupportGrant provides additional Data Analyst to supportNDE Student IDResolve duplication issues, assist public and nonpublic staff with assigning IDs, etc.Student and staff data Cohort Graduation DataNE Data Analysis and Research21Data Dashboards Goal 1Dashboards Compile key metrics in a simple and easy to interpret interface Present data so one can quickly and visually see status or progress, etc. Combine data from various streams, including state and local, to present a clear and comprehensive picture

NE Data Analysis and Research22Description in Approved GrantConnects data from multiple sources including state (NSSRS), assessment vendors, and local student information systems, etc.;

Stores the local data in a holding box at the NDE that is separated from all other NDE data;

Allows districts to upload and download data to and from the holding box as often as desired;

Displays in a dashboard the most commonly used analysis in response to questions about factors affecting student performance;

Is IT neutral, that is a non-technical person can use the system with little difficulty; and

Has secure access down to the teacher level.NE Data Analysis and Research23Data Reporting SystemNDEs DRS is a dashboardMultiple programsStudent and staff dataProgram informationState data Aggregated (privacy protected)Only data NDE collectsAllows analysis and comparisons at the state and district levelsNE Data Analysis and Research24

NE Data Analysis and Research25

NE Data Analysis and Research26

NE Data Analysis and Research27Other ExamplesU. S. Department of Educationwww.dashboard.ed.gov/dashboard.aspx

Stateswww.doe.K12.de.us

Districtswww.data-dashboard.birmingham.k12.mi.us

NE Data Analysis and Research28Evaluation Plan for GrantMonthly calls to monitor implementation progressEvaluation PlanMeasure degree of implementationEffectiveness of planImpact whenever possiblePolicy Advisory Committee will have input into the Evaluation PlanNE Data Analysis and Research29FundingAbout 4.4 million dollars over three years for -- Additional staff to support goals and activitiesEquipment and software Contracts with vendors for Customer Relations Management and Interstate LocatorContracts with pilot districts for dashboardSupport for ESU and district training for professional developmentNE Data Analysis and Research30