Work Session 1Locating Baseline DataOffice of Research, Evaluation and Policy StudiesXimena D. Burgin, Ed.D.November 30th, 2010
Databases
Restricted Databases Public Databases Commercial Databases Your Own
Restricted Databases: Institute of Education Sciences (IES):
Assessments Early Childhood Elementary / Secondary International Library Postsecondary
Public Databases: Illinois Interactive Report Card (IIRC):
Commercial Databases:Survey of Enacted Curriculum
Commercial Databases:California Critical Thinking Skills Survey
Your own:Alcohol, Tobacco, and Other Drug (ATOD)
Data Collection
Techniques to collect data Observations Interviews Questionnaires (open-
ended questions) Documents Audiovisual materials
Qualitative Exploration of
the unknown. Understanding
of a central phenomena.
Quantitative Trends or
explanation of relationships among variables.
Data Analysis
Textual analysis (Qualitative) Perform preliminary exploratory analysis Code the data Create themes Summarize findings (choose narrative discussion)
Statistical analysis (Quantitative) Descriptive statistics Inferential statistics
Sample of ATOD Survey Questions
Validity
“Whether an instrument measures what it is suppose to measure”
Appropriateness, correctness, meaningfulness, and usefulness of the specific inferences made from data
Reliability
Consistency of scores obtained from individuals
Are results repeatable from one administration of instrument to another?
Validity and reliability
Assessing reliability
Test-retest reliability Alternate (Parallel) forms reliability Alternate (Parallel) forms & test-retest
reliability Internal consistency reliability Inter-Rater or Inter-Observer reliability
Internal consistency reliability
Inferential statistics
Generalizing from samples to populations
Top Related