DataData

Comprehend

Data

Training

(Level 1)

Using Data to Guide Instruction

DataData

Introduction of Trainer

DataData

• Administrators

• Teachers

• Elementary, Middle School, High School

• Other

Introduction of TraineesWho are you?

DataData

L11 Data – Acquire

Level 1 – EXPLORE the data and IDENTIFY

foundational knowledge concerning data

•ENGAGE prior knowledge to INTEGRATE

standard data vocabulary. (5 minute break)

Training Agenda (3 Hours)

DataData

• CONDUCT standardized, guided PRACTICE

on basic workflows. (10 minute break)

• DEMONSTRATE the use of standard

practices and vocabulary. (The End)

Training Agenda (3 Hours)

DataData

• A non-profit education association

• Formed in 1997 from a $5M USDE Title IID

Technology in Education Challenge Grant

• Serves K-12 Education, Oklahoma Career

Tech and Higher Education

What is ALCA?Aurora Learning Community Association

DataData

Listen to Educators

•Identify Problems – Look for Solutions

•“Wouldn’t it be nice if...?”

ALCA MISSION(Commitment)

DataData

ALCA Districts

DataData

• Online Professional Learning Communities

Connecting Learners

DataData

Continuously seek and

share learning…

Professional Learning Communities (PLCs)

DataData

Increase their effectiveness for

student learning…

Professional Learning Communities (PLCs)

DataData

Act on what they learn.

Professional Learning Communities (PLCs)

DataData

Develop a common vocabulary, common

purpose, common vision to communicate

and collaborate efficiently and effectively as

highly functioning, state- and district-wide

teams

Goal for the PLC

DataData

Training Group: We are all at different levels

Learning Bell Curve

DataData

http://www.learning-styles-online.com/overview/

The Seven Learning Styles

•Visual (spatial):You prefer using pictures, images, and spatial understanding.

•Verbal (linguistic): You prefer using words, both in speech and writing.

•Physical (kinesthetic): You prefer using your body, hands and sense of touch.

Learning Styles

DataData

• Logical (mathematical): You prefer using logic, reasoning and systems.

• Aural (auditory-musical): You prefer using sound and music.

Learning Styles

DataData

• Social (interpersonal): You prefer to learn in groups or with other people.

• Solitary (intrapersonal): You prefer to work alone and use self-study.

Activity (icon maybe???):

Take a Stand: Personal Assessment of Learning Styles

Learning Styles

DataData

• Training activities that focus on all learning

styles have been incorporated into training

• Provide resources to go back and review

and rethink…offering the way that you

prefer to learn

Differentiation

DataData

www.alcaweb.org

•Quickstart Guide

•Quickstart Video

Logging into Your ALCA Community: Arch Platform

DataData

• Timer for logged in user

• Utility Bar Definitions

• Available resources located on the page

Welcome to Arch

DataData

• Click Rooms on the Utility Bar

• Room Definition: A Room is a place members

come together to address a common set of

tasks.

“A Place to Work on a Focus Topic”

Eg. Chemistry II Course; 3rd Grade Math

Utility Bar: Rooms

DataData

• Enter Access Key:

123456

• Click Enroll

• Verify “PLC Training Room” is now listed

Enroll using an Access Key

DataData

• Click “PLC Training Room”

• Click Data Resources

• Click L1 Data – Acquire

Room Resources Identified

DataData

• Quickstart Guide

• Quickstart Video

• Level 1: Comprehend Training PowerPoint

• Surveys and other resources

Room Resources Identified

DataData

• Click on the Resource

“L1 Comprehend Data Training Pre-Survey”

Activity (icon): Take approximately 5

minutes to complete the online form

Comfort Survey

DataData

http://www2.ed.gov/policy/gen/guid/fpco/ferpa/index.html

•Family Educational Rights and Privacy Act

•An example FERPA Statement provided in

room as a resource

•Sign FERPA Statement and return to trainer

FERPA

DataData

http://www.alcaweb.org/arch.php/resource/view/50596

•Cut-scores:

Divide students into

performance level

Basic Data Analysis Vocabulary

DataData

• Oklahoma Modified Alternative Assessment

Program (OMAAP): A two percent cap exists for

reporting the percentage of students counted as

proficient on AYP. The cap does not limit the

number of students who may participate in

OMAAP.

Basic Data Analysis Vocabulary

DataData

• SOPI: Standard/Objective Performance Index –

also referred to as Item Analysis.  SOPI scores

are given for individual student performance

and group (grade and subject) performance.

Vocabulary provided as a resource in the room -

UPDATE

Basic Data Analysis Vocabulary

DataData

What the research says about data…

Level 1: How did I do?

Level 2: How are the students that are coming to

me do?

Level 3: Have the practices we embedded been

sustained

Why are we getting into data?

DataData

• ALCA provides demo data for all users

• Logout of Arch to re-enter under the demo

account as we begin to explore data

Demo vs Live Data

DataData

• Steps will be delivered live via the

computer

• Quickstart Guide provides pictures to

help you find “clicks” in the Arch platform

Quickstart Guide

DataData

1: Click Login at the top right of the web page

2: Enter your Username and your Password.

Then click the Login button.

Username: demo@compdemo

Password: 123pass

Arch Platform: Logging In

DataData

• EPAS (Explore, Plan)

• OCCT (State Testing Grade/Subject)

• Other Tests (Dibels, WIDA, Study Island,

NWEA, etc.)

Data Sets

DataData

• Basic Overview

• Step-by-step assistance

• NOW…LIVE step-by-step introduction

by trainer

Quickstart Guide

DataData

• Reference the Quickstart and Videos for

ongoing assistance as they use the

system

• LOGOUT: Time to reflect on “Your Data”

Quickstart Summary

DataData

• Please stay in the training room but feel

free to stand and stretch your legs and

visit with your neighbor

http://cd.justinjc.com/5m (insert clock

image)

5 Minute Break

DataData

• Login with your personal Username and

Password

• Click Comprehend in the utility bar

Personal Login Information

DataData

• Exploring OCCT Data Set

• Exploring your own data and analysis of

student learning

Q: How did “we” do as a system?

DataData

1. Select Data Set – OCCT

2. Select Grade and Subject

• 5th Math for Demo Data

3. Filter Data

• Summative: Review last year’s data

Beginning Data Analysis

DataData

• Blue Bar represents data set

Comprehend: Blue Bar

DataData

• Gray Bar: What did I filter for?

• Ability to search for a student by Last

Name

Comprehend: Gray Bar

DataData

• Green Bar: How many records and the

proficiency level of displayed records

• Change the number of records displayed

Comprehend: Green Bar

DataData

• Remove (hide) the “First Name” column

Exploring the Data TableBasic Functions

DataData

• Return the

“First Name” column

Data Table: Basic Functions

DataData

• Check Boxes: Only used to

make student groups

Data Table: Basic Functions

DataData

• Green Rows (Eg. Row #3 and #6): Provide

visual stability while reviewing online data

Data Table: Basic Functions

DataData

• Curser Marker: Orange row (Eg. #8)

reflects data where the curser currently

resides

Data Table: Basic Functions

DataData

• Sort Student Last Names: Ascending

• Sort OPI Score: Ascending

• OMAAP Discussion: Anything below 400

designates an OMAAP student

• Cut-scores

Data Exercise

DataData

http://www.alcaweb.org/arch.php/resource/view/50596

•Cut-scores:

Divide students into

performance levels

Basic Data Analysis Vocabulary

DataData

Data Table: OMAAP Scores

DataData

• Sort OPI Score: Descending

• Look at Quartile

• What is a Quartile? The distribution of

student achievement within a

performance level

Data Exercise

DataData

Quartile Example

DataData

Click Student Name

•General Information

•Blueprint

•Standards & Objectives

(SOPI) Scores: Blue Bars are a mathematical

average for each standard

-> Drop-down: View Other Student Records

Student Individual Test Record

DataData

• Click Data Table to return from the

individual student test record

Return to Data Table

DataData

• Take 10 minutes to explore the data

within the Data Table

• Questions?

Exploring the Data

DataData

• Please stay in the training room but feel

free to stand and stretch your legs and

visit with your neighbor

http://cd.justinjc.com/5m (insert clock

image)

10 Minute Break

DataData

• Reviewing summative data by looking at

student groups of last year’s students

Q: How did “I” do?

DataData

1. Performance Level Report

2. Quartile Report

3. OPI Score Report

4. SOPI% Correct Report

5. 2011-2012 by Objectives (not on QS Guide)

Comprehend: Top 5 Reports

DataData

1. Select Data Set: Click OCCT Data Set

2. Filter Data: Click Test Year filter

Now…learn to Generate Reports

Running Top 5 Reports

DataData

Median: The middle score in a set of ordered

scores

•The median is a better measure of central

tendency than the mean (average) because

it is not affected by extreme scores

Median vs Average

DataData

Average: The number that is found by

dividing the sum of data by the number of

items in the data set

Median vs Average

DataData

Page 5: Report Quickstart Guide

1. Click 3) Generate Reports

2. Click Performance Breakdowns

3. Click Test Year

Performance Breakdowns ReportTest Year (Most Recent)

DataData

Performance Breakdowns Report

DataData

• Click Show Record Count to identify

the number of student per proficiency

level

Show Student Count

DataData

Page 6: Report Quickstart Guide

1. Click 3) Generate Reports

2. Click Special Reports

3. Click Quartile Reports

Quartile Report

DataData

Quartile Report

DataData

Page 7: Report Quickstart Guide

1. Click 3) Generate Reports

2. Click Aggregate OPI Score

3. Click All

OPI Score Report

DataData

OPI Score Report

DataData

Mapping the test blue print to the data

Test Blueprints reflects the degree to

which each standard and objective is

represented on the test.

Activity Icon: Link to Blueprints in ALCA

What is a Blue Print?

DataData

Page 8: Report Quickstart Guide

1. Click 3) Generate Reports

2. Click SOPI % Correct

3. Click All Standards and Objectives

SOPI% Correct Report

DataData

SOPI% Correct Report

DataData

• Notice: Median score is the “middle” score

• Click Show an Average

• Reflection: What is the difference between

Median and Average when I look at the data?

Identify two standards.

Median vs Average Activity

DataData

1. Click 3) Generate Reports

2. Click 2011-2012 by Objectives

3. Click Objectives by Year

2011-2012 by Objectives

DataData

2011-2012 by Objectives: Median

DataData

2011-2012 by Objectives:

Average

DataData

• Notice: Median score is the “middle” score

• Click Show an Average

• Reflection: What is the difference between

Median and Average when I look at the data?

Identify two objectives.

Median vs Average Activity

DataData

• Identify your two highest standards and

highest objectives

• Discuss why these are the highest?

• What causes the difference between the

highest standards and objectives and the

lowest?

Elbow Partner Activity

DataData

• Click Rooms in the utility bar

• Click “PLC Training Room”

Comprehend Data Training Resources

DataData

• Click “PLC Training Room”

• Click Data Resources

• Click L1 Data – Acquire

Room Resources Identified

DataData

• Comprehend Level 1: Training PowerPoint

• Quickstart Guide

• Comprehend Quickstart Video

• Comprehend Report Quickstart

• Formative and Summative Assessment

• Activities

PLC Training Room Resources

DataData

• Click on the Resource

“L1 Comprehend Data Training Post-Survey”

Activity (icon): Take approximately 5

minutes to complete the online form

Comfort Survey - Revisited

DataData

Online evaluation form

ALCA Evaluation