Avant STAMP Benchmarks & Rubric Guide

Avant STAMP 4Se Docs

Overview

Test takers receive a score, or benchmark level, for each section of the test. The Reading and Listening scores are scored automatically by the computer. The Writing and Speaking items are scored by Avant’s certified raters who use a scoring rubric, (a scoring tool that lists the criteria for meeting Benchmark Levels).

The rubric outlines in detail what expectations are placed upon the test takers for performance at any given level. Test takers who hope to score at a specific level know the characteristics of the work they must produce to achieve that level.

Benchmark Scale

Scoring is done using benchmark levels 1-6+ for reading and listening and benchmark levels 1-7 for writing and speaking. The levels are associated with benchmark categories of novice, intermediate and advanced as shown in the level keys below. Similar to ACTFL's low, mid and high designations, these designations will assist in seeing a further breakdown of the test taker’s ability. Because it takes a great deal of time and practice for students to acquire the skills necessary to move from novice to intermediate, student growth can be tracked using the numeric levels within the categories. This benchmark scale relates to the ACTFL scale as shown below.

Writing and Speaking Level Key Reading and Listening Level Key
Novice Intermediate Advanced Novice Intermediate
Novice-Low - 1
Novice-Mid - 2
Novice-High - 3
Intermediate-Low - 4
Intermediate-Mid - 5
Intermediate-High - 6
Advanced - 7 Novice-Low - 1
Novice-Mid - 2
Novice-High - 3
Intermediate-Low - 4
Intermediate-Mid - 5
Intermediate-High - 6
Intermediate-High - 6+

Reading and Listening Benchmarks

Each Reading and Listening test item has an associated level. Because the Reading and Listening sections are computer-adaptive, the test taker experiences questions at various levels. The algorithm used to determine the test taker’s scores for Reading and Listening looks at the number of questions that were answered correctly at each test item level.

The chart on the next page shows topics typically associated with the Benchmark Levels for Reading and Listening test items. It also shows the Reading and Listening characteristics associated with the levels.

Keep in mind that topic is not the only criteria for determining the level for Avant STAMP 4Se test items. A Novice-level test taker is likely to know learned phrases and basic vocabulary about topics that may be listed under Intermediate or Advanced.

Also, test items may have elements of multiple topics. For example, a Novice-level question about Calendar/Time might reference Holidays/Celebrations.

The topics may be used as a guide for instruction, but are not a complete scope and sequence.

Benchmark Levels

The Avant STAMP 4Se Scoring Process for Writing and Speaking Items

Scoring for the Avant STAMP 4Se Writing and Speaking responses is done using the following three-step process and associated rubric.

STEP 1

Overall evaluation of the response to assess for Ratability — is the response on topic and appropriate for the given prompt/ task? If the response is off topic, contains any profanity or includes any menacing or threatening language, the response will be treated as unresponsive or non-ratable and the test taker will receive a “0” score for that task.

STEP 2

Evaluation of each ratable response to determine a Benchmark Level based upon the Text-Type characteristics, followed by rating of Language Control factors (see next page).

STEP 3

The system will then post ratings for each response, which are used to calculate the final score for the domain.

Note: 20% of all test taker scores are rated by a second rater to assist in tracking rater accuracy and reliability.

The same rubric is used for all Speaking and Writing items. Once rated, the average ratings across all Speaking and Writing items will appear on the summary report page and scores for each sample will appear on the detailed score page.

The Avant STAMP 4Se Scoring Rubric

Benchmark Level Text Type Characteristics Language Control
LEVEL 1
Novice-Low
Produces words in target language with no connection. Does not have enough vocabulary or the ability necessary to formulate even simple phrases to address the prompt. Limited language control. Inability to create more than individual words. L1 (first language) influence may be strong. Errors are expected at this level, but the student must be able to produce at least two comprehensible words.
LEVEL 2
Novice-Mid
Language production is beyond individual words but clearly shows the lack of ability to construct more than phrases. May include one simple sentence, but incapable of showing more. May make frequent errors, but usually comprehensible to a sympathetic reader/listener. L1 (first language) influence may be present.
LEVEL 3
Novice-High
Short, common expressions or memorized statements that may be combined together. Able to create at least 2 different simple sentences. Good accuracy for high frequency expressions. Usually comprehensible to a sympathetic reader/listener. Grammatical (syntax, spelling, conjugation) errors are expected at this level but sentences must make sense to be acceptable.
LEVEL 4
Intermediate-Low
Variety of sentences that utilize different verbs to create independent thoughts, mostly composed of a recombination of learned simple sentences with added detail in the form or prepositional phrases and verbal phrases. Good accuracy with formulaic sentences with some added detail. Errors may occur as student attempts higher level skills. Good Language Control is expected with the majority of the response.
LEVEL 5
Intermediate-Mid
Logical organization of ideas and flow of sentences or statements. Contains at least 2 unique and non-formulaic sentences intermixed with a variety of sentences creating ‘groupings of sentences showing connectedness. Good accuracy evident with possible errors that don’t affect the overall meaning. Delivery may be somewhat choppy. May have repetitive use of concrete vocabulary with occasional use of expanding terms. Accuracy for complex sentences is emerging.
LEVEL 6
Intermediate-High
Able to demonstrate an Intermediate-High control of the language. Complexity is evident. Transition words and connectors are used correctly and efficiently a majority of the time to create a flow within the response. Groups of sentences focus on different aspects of the prompt and include transition words or phrases to introduce next concept. Does not have Advanced vocabulary or language to move into the Advanced level. Response is well written and constructed. Intermediate-High sentence structures can be found throughout response. Demonstrates beginning ability to create a coherent response with increased use of complexity as well as transition words and phrases. No evidence of advanced vocabulary.

Updated July 2016

Need Help

Stay Up To Date

Sign up to receive our monthly newsletter.