MassCUE Evaluators

Data CollectionCreating Questions Mapped to

Indicators

Evidence/Data Collection

Quantitative and qualitative dataClassroom observation, interviews, and work-

product reviewFocus groups and surveysStudent assessment dataData sources for secondary analysisTriangulation among data sources

Writing Good Questions

“Yes/No” questionsLeading questionsOpen-ended questionsMultiple choice/controlled vocabulary

questionsLikert scale issues

Surveys

Creating good surveys Length Differentiation (teachers, staff, parents,

community, etc..) Quantitative data Attitudinal data Timing/response rates (getting returns!)

www.sun-associates.com/masscue/othertools.html

Focus Groups/Interviews

Focus Groups/Interviews Teachers Parents Students Administrators Other stakeholders

www.sun-associates.com/masscue/samplequestions.html

Classroom Observations

Using an observation template www.sun-associates.com/masscue/sampletm

plt.pdf

Setting up the observationProviding opportunity for short interviews

Data Collection Issues

SamplingConfidentialityObjectivity

Secondary Analysis

Utilizing existing assessments Cross-year comparisons MCAS item analysis

Remember, any data you use needs to be mapped to your indicators!

Other Data?

Artifact analysis A rubric for analyzing teacher and student work? www.sun-associates.com/masscue/samplelprubric.doc

Other types of rubrics www.sun-associates.com/masscue/EssenCondRubric.pdf

Solicitation of teacher/parent/student stories This is a way to gather truly qualitative data What does the community say about the use and impact

of technology? Student Drawings

Student Drawing Example 1

Student Drawing Example 2

Student Drawing Example 3

Writing Good Questions

“Yes/No” questionsLeading questionsOpen-ended questionsMultiple choice/controlled vocabulary

questionsLikert scale issues

Next Steps,Your Work

Work on the matrix todayThere will be sharing later this afternoonComplete the matrix and send it to us

before Day 3 (we’ll set that date by the end of this month)

Jeff and Jeanne will provide feedback to each team