Tips to Scoring the ELA Smarter Balanced Interim Assessments

COMPREHENSIVE AND BLOCK

Office of Superintendent of Public Instruction

Navigating Interim Support – WCAP Portal The Washington Comprehensive Assessment

Program (WCAP) portal houses the: Interim assessments Teacher Hand Scoring System (THSS) Online Reporting System (ORS) Administration Manual Online - Interim

http://wa.portal.airast.org/

Start Here

http://wa.portal.airast.org/

Hand Scoring

Reports

Interim Tests

Manuals ELA hand scoring

training documents are

also located here.

Classroom Activities for

Interim

Administrator Roles within WCAP PortalDepending on your district size and configuration, these roles may be somewhat varied.

District Coordinator Confirm that student

information has been rolled over into TIDE

Assign educator roles

Classroom Teacher

Decide which interim assessment to use

Via the Test Administration Tab, select the test and activate the session

Approve students so they may begin Once all students are finished, stop

session

Interim Assessments

Interim AssessmentICA and IAB Options

Overview of Interim Process

Decide which assessment your students should take Interim Comprehensive Assessment (ICA) Interim Assessment Block (IAB)

Check to be sure student rosters are loaded in TIDE Set up the test using the Test Administration tab Administer the test with students

Administration Characteristics

ICAs and IABs can be administered multiple times during the year

Tests draw from the same interim pool.

Students may encounter some of the same items on the ICA as they will on the IAB.

Decisions about test choice and frequency of use are determined by district or school plans.

Currently both are fixed-form, online tests. Both will become adaptive over time as item bank allows.

Interim Assessment Similarities

Both ICA and IAB options are: Available at grades 3, 4, 5, 6, 7, 8, and high school Administered at teacher’s discretion, including using off grade-level Teacher Scored Constructed Response

Majority of items are automatically scoredShort-Text, brief writes, and full writes are hand-scored by

teachers; requires scoring training using a rubric through provided materials

Interim Comprehensive Assessment (ICA)

Same design as summative assessment

Assess the same claims and standards

Reports give the overall scale score, performance level designation, and claim score information

Timing of administration to mirror summative Approximately 4 hours + 30 minute classroom activity Is arranged in two sections

Computer Adaptive Test (CAT) Performance Task (PT)

Teachers will need to hand-score short texts, brief writes and a full write Once teachers submit the hand scores, reports are available Reports provides teachers with information on a student’s

General areas of strength or need Readiness for the end-of-year summative assessment

A Closer Look at the ICA

Computer Adaptive Test (CAT)* Reading Brief Writes Listening Research

Performance Task (PT)Classroom Activity

Located in TIDEAdministered prior to

students accessing the PT

Part 1: Access Sources and answer Research questions

Part 2: Full Write*Currently this portion of the assessment is non-adaptive, but it is equivalent to the CAT portion on the summative assessment

ICA Estimated TimeContent Number of Items Response Type Estimated Time*

**Computer Adaptive Test (CAT)

Reading Lit 13–15Mostly machine scored, a few hand scored

45 min–1 hour

Reading Info 14–16Mostly machine scored, a few hand scored

45 min–1 hour

Brief Write 6 brief writing tasks All hand scored45 min–1 hour

Edit/Revise 13–16 All machine scored30 min

Listening 14–16 All machine scored30 min

Research 17–18 All machine scored30 min

Performance Task (PT)

***Classroom Activity 030 min

Part 1: Research 2–3 All machine scored 30 min

Part 2: Full Write 1 Hand scored 11/2 –2 hours

*Estimated time is based on 1–2 minutes to answer a MC question and up to 5 minutes to answer a constructed response. Plus time to read stimulus/sources.

**Currently this portion of the assessment is non-adaptive, but it is equivalent to the CAT portion on the summative assessment

***Located in TIDE- Administered prior to students taking the PT

Interim Assessment Blocks (IAB)

Short, focused sets or “blocks” of items that measure similar content 6-8 blocks per grade level, including ELA Performance Task blocks Offers a smaller set of targets and more flexibility for administration

Reports state “Below Standard, “At/Near Standard,” and “Above Standard”

Provides teacher with Information about a student’s strengths or needs More detailed content information for instructional purposes

Teacher hand scoring, dependent on the block See next slide

ELA Blocks- Estimated timeELA Block Number of Items Response Type Estimated Time*

Reading Lit 13–15Mostly machine scored, a few hand scored

45 min–1 hour

Reading Info 14–16Mostly machine scored, a few hand scored

45 min–1 hour

Brief Write 6 brief writing tasks All hand scored 45 min–1 hour

Edit/Revise 13–16 All machine scored 30 min

Listening 14–16 All machine scored 30 min

Research 17–18 All machine scored 30 min

All Performance Tasks2–3 research items and 1 full write

Mostly hand-scored1–2 hours, including 30 minutes for the classroom activity.

*Estimated time is based on 1–2 minutes to answer a MC question and up to 5 to answer a constructed response. Plus time to read stimulus/sources.

English Language Arts Blocks: Grades 3–5

English Language Arts Blocks: Grades 6–8

* Not available in 2014–15

English Language Arts Blocks: High School

* Not available in 2014–15

Scoring the Assessments

Accessing hand-scoring training

materials.

Prior to testing, log in to TIDE and select the Download Forms tab which houses PDFs of each scoring set for every hand-scored item. These same scoring sets are also located in the THSS but cannot be accessed there until students are done testing and teachers actively start scoring.

Download Forms

Within TIDE, the ELA scoring materials are located in the Download Forms tab.

Teacher Hand Scoring System (THSS)► Read and score student responses

► Access, download/print the Training Guide and Exemplar Sets to train on scoring as you are scoring*

► Access scores in the ORS

► ELA IABs for Edit/Revise, Listening and Research do not require hand scoring.

* To access materials prior to testing, log in to TIDE and select the Download Forms tab. These are the same scoring materials located in the THSS but can be accessed in TIDE prior to students testing.

Where are the constructed response items?

ICAICA or IABNumber of Hand

Scored ItemsResponse Type

Estimated Teacher Training

Time*

Reading Lit 1–2 Short-text 45 min–1 hour

Reading Info 1–2 Short-text 45 min–1 hour

Brief Write 6 Brief write tasks 45 min–1 hour

All Performance Tasks2–4 research items and 1 full write

2-3 short-text and 1 full-write essay

1–2 hours

*Estimated time is based on teachers reading through the materials, practicing scoring the Prep set, and scoring the Check set on their own. This can be done in a PLC or individually.

Scoring Overview: Things to Consider

Interim assessments have the same item types as the summative assessment Most items are machine scored Short-text, Brief Writes, and Full Write are hand scored locally for

interimsEducators use the Teacher Hand Scoring System (THSS) to score student

responses

The THSS cannot be accessed until testing is complete ELA Rubrics and training materials are provided within TIDE and THSS

After hand-scoring is complete, student scores will be available in the Online Reporting System (ORS)

After students have completed the assigned test, you are ready to begin scoring.

Each constructed response item has its own set of scoring materials.

Reminder: materials can be found in TIDE prior to testing, or in the Exemplar and Training Guide tabs in the Teacher Hand Scoring System as tests are being scored.

When you log in to the THSS, you will be taken to the Student Response List page (see next slide)

Locate the student and the item you want to score. Click the Score tab

Student Response Page Each student’s response is on its own page (see next slide). Information on the page includes

A rubric A Training Guide tab An Exemplar Set tab A place to enter the score The question or task The student’s response

Student Response Page Exemplar and Training Guide

Tabs

Rubric

Student’s Response

What will I find in the ELA Training and Exemplar Tabs?

Training Guide Instructions

Stimulus

Item stem

Rubric

Condition Codes

Claim and Target Sheet

Exemplars Prep Set

Sample student responses with scores

Scoring comments

Train using the rubric

Check Set

Sample student responses without scores

Scores and comments located on a key

Practice scoring using the rubric

Reporting Results

Online Reporting System

Online Reporting System - ORS

ICA One overall ELA score Claim information also reported Both CAT and PT portions must be completed by student and all

hand-scoring completed by teacher/proctor IAB

Scores generated per block If the block includes constructed response items, hand-scoring

must be completed to generate a score

Home Example State Bay View School District Bay View Central High Grade 11

ICA Score Report

IAB Score Report

Final Thoughts

The interim assessments are a valuable tool to: Prepare teachers and students for successful

testing.Guide instruction aligned to standards based on

student needs.