1

Framework for Teaching Proficiency System (FFTPS)also known as

FOCUS

Arkansas TESS Administrator Training

A Complete Solution for Evaluators

2

Framework for Teaching Observer Training Increase the reliability and accuracy of observersDeepen observer knowledge of the components and performance levels in the Framework for TeachingPromote bias awareness

Framework for Teaching Scoring Practice Provide observers with opportunities to practice before live observationsDeliver feedback to observers including answer key and evidence rationale

Framework for Teaching Proficiency Assessment Train observers to deliver valid, reliable judgments based on teaching evidenceIncrease defensibility of the district’s evaluation system

FOCUS: Home Page

3

Traing

4

Evaluator Training: Overview • ~20 hours of video and training content provided

o Self paced - total training time may vary

• 11 online learning modules for observerso Orientation to observer trainingo Minimizing biaso 9 modules on Framework for Teaching

o Overviewo Framework for Teaching Components in Domain 2 and

Domain 3 detailed rater training on each component and performance level

• Over 100+ master scored videos

Best Practices for Evaluators to Pass Assessment

5

1. Conduct a system check every time you use the FFTPS

• Contact IT department if you fail system check• Wired internet connection better than wireless

2. Spend enough time training

• 15- 20 hours of training• Train even if you have previous FFT knowledge

The training content supports latest version of FFT and is aligned with the assessment

Training and practicing also gets you familiar with the software used during the assessment.

Many users who considered themselves FFT experts took the assessment without training failed on their first attempt.

3. Practice scoring early and often

• Recommend 2+ hours of practice (e.g., score the entire set of practice videos 2-3 times)

4. Allocate enough time to take the tests

• Each test will take ~3-4 hours. Make sure your schedule is clear and avoid interruptions

5. Study hard but be confident!

• Thousands have passed.

Evaluator Training: Home Page

6

Evaluator Training: Overview Page

7

Evaluator Training: Master Scored Videos

8

Evaluator Training: Exercise Example

9

Scoring Practice: Description

10

Provides opportunities for evaluators to practice:

• Identifying and recording instructional evidence• Aligning the evidence to a specific component of

the Framework for Teaching• Scoring classroom practice based on the

evidence• Receiving feedback on the score versus expert-

assigned rubric and rationale

Scoring Practice: Evidence and Scoring

11

Scoring Practice: Feedback Page

12

Proficiency Assessment: Overview• Two stages. Recommend time to take each stage ~3-3.5 hrs

Stage 1: multiple choice and videos. Stage 2: videos (selected based on user’s grade span) Passing score based on total score of both stages: Stage 1+ Stage 2 Each stage takes ~3-3.5 hours (user has up to 6 hours to take a stage). If a user passes each stage on their first attempt, the total testing time will take 6-7 hours Users should only takes one test attempt per day so test usually takes at least 2 days to complete

• 2 chances to pass each stage of assessment (see next page for visual examples) Must pass Stage 1 before moving to Stage 2 If the user passes both Stage 1 and Stage 2 they are considered “proficient” If user fails a stage twice, they are deemed not proficient and are eligible for “retest”

• If a user fails an assessment, they must wait a period of time before their next attempt Fail one attempt: 24 hour lockout period before next attempt at stage Fail on second attempt: 21 day lockout period before next attempt Fail overall assessment (i.e., fail a stage twice): lockout period TBD (several weeks) before

“retest”• “Retest’ follows the same exact process as the “initial test”

Two stages User starts at Stage 1 Two attempts to pass each stage If the user is not proficient (fails a stage twice) after retest, there are no additional testing rounds

Pass/Fail Paths – Initial Testing RoundStage 1 Stage 2

Pass Pass

Outcome for initial test

Pass1st attempt

Fail1st attempt

Pass Pass Pass2nd attempt

1st attempt

1st attempt

Fail1st attempt

Pass FailPass

2nd attempt 1st attemptPass2nd attempt

Pass Fail

Pass

1st attempt 1st attempt

Pass2nd attempt

Fail1st attempt

Fail Fail (can “retest”)2nd attempt

Fail1st attempt

Pass Fail2nd attempt 1st attempt

Fail2nd attempt Fail (can “retest”)

Pass Fail1st attempt 1st attempt

Fail2nd attempt Fail (can “retest”)

Overview of System Requirements

16

Network access

• Local district IT administrator will need to update network settings to allow users to access Teachscape related websites from their school computers and school network

Internet connectivity

• At least 1-2 Mbps download speed• Highly recommend using a wired connection while taking the proficiency

assessment to ensure a consistent connection• Users need to avoid peak network usage times at school when average

bandwidth may drop below minimum requirements

Hardware and software

• Can use PCs or Macs that meet minimum requirements for hardware, software, and monitor resolution

• Users can not use tablet devices (e.g., iPad) with FOCUS

Documents with details

• List of Teachscape Domain Names & IP Addresses.pdf• Teachscape-system-requirements.pdf• FOCUS user start-up guide.pdf

FOCUS training, practice, and proficiency assessment rely heavily on videos. Users systems must be optimized to view videos.

System Check Tool: The user’s and IT staff’s best friend

17

Where to access the “System Check” tool from Help page

System Check Tool: Screenshot

18

• In seconds, automatically detects if user meets system requirements foro Hardwareo Browsero Monitoro JavasScript, Cookies, Pop Ups

• Allows user to check if internet connection meets requirements (“speedtest.net”)

• Allows user to watch a video and listen to audio as a final system test

Additional Support Resources

19

Local Support

20

Co-op/school district cadre of facilitators for administrative support of content

Webinar for Co-op Tech Coordinators

Webinar for Local Tech Coordinators

Arkansas Teachscape Implementation Managers can be reached at:

ade.artess.teachscape@arkansas.gov

21

Customer Support: Role of Local IT and Teachscape

Local district IT staff

• Enable users to access Teachscape related domains and sites

• Allow Teachscape to use support tool (e.g., Teamviewer) on users hardware if required to resolve a support issue

• Be the point of contact for users to address any issues identified by the system check tool

• Contact Teachscape if user continues to experience system problems after local hardware, software, or connectivity issues have been addressed

– 1-888-479-7600– support@teachscape.com

Teachscape

• Be the point of contact for users when they experience problems while taking a proficiency assessment

• Work with local IT team to resolve issues that cannot be fixed at local level

GETTING STARTED IN TEACHSCAPE

• Emails were sent on January 7 with user names and temporary passwords.

• Grade spans were chosen when registering accounts (Has already been entered for you).

• Grade spans: K-5, K-8, 6-8, 9-12, and K-12• These grade spans determine the videos you will watch for

practice scoring and the assessment.• If you need to change grade span, contact Teachscape

Tech Support.• You will change your password upon first log-in.• Make sure you read system requirements and run system

check.

TIPS: Proficiency Test• Set a goal for yourself.• Using Mozilla Firefox helps with technical issues. • Log out before you exit Teachscape.• Work through training modules regardless of your

familiarity with Danielson Framework. DO NOT SKIP!!• View and score practice videos with colleagues using

the 2011 edition of FFTPS/FOCUS.• Review and discuss with colleagues the rationale

behind the scoring.• Proficiency Test has to be taken independently.

More Tips: Proficiency Test• Take certification test outside school day due to

bandwidth issues.• Set aside an uninterrupted time period (3-4

hours) for each stage of the test.• You can pause videos without penalty. • Record evidence on paper or directly into

Teachscape.• If you record evidence on paper, put “see notes”

in the evidence box and code that to all components.

And More Tips: Proficiency Test

• Remember you are not tested only on scoring the videos, but also on bias, interpretation, and applying the framework.

• After passing Stage 1, it is recommended to wait at least one day before beginning Stage 2.

• If you are unsuccessful, review your score report and determine a plan of action.

• During the training process, each co-op/district has facilitators available to assist you.

Even More Tips: Proficiency Test• Using a larger monitor aids in seeing more

of what is happening in each video• Use of an Ethernet connection instead of

wireless in highly recommended since Ethernet connections are generally more stable than wireless connections

• Use of a headset can help users filter out other sounds and distractions in their training and testing situation.

Teachscape Demo Site for FFTES

Site can be accessed at http://www.teachscape.com

User name: arkansas.demo

Password: teach

• To access the FFTES, click on Framework for Teaching Effectiveness Series

• Teachers may access the site NOW!• A QuickStart Guide has been developed to assist

demo users in navigating the site.