FAQ: MAP Growth student test engagement features for July 2019

Document created by Community User on Oct 16, 2018Last modified by Community User on May 15, 2019
Version 66Show Document
  • View in full screen mode
Introduction
Answers to frequently asked questions on the expanded student test engagement capability in MAP Growth launching in July 2019 for fall testing. This new capability helps ensure educators get the best data available to make critical decisions that impact student learning.

Information

How will the student test engagement capability be expanded in July 2019?

Beginning in July 2019, MAP Growth will include new features to help students make their best effort, mitigate rapid-guessing behavior, and streamline the process for optionally retesting students who rapid-guessed excessively.

Features include:
  • In-product guidance for students encourages them to try their best and take their time
  • Auto-pause mitigates rapid-guessing behavior and supports proctor intervention to reengage the student
  • A new report shows only students who met the 30 percent threshold for excessive rapid guessing
  • Test History Search and new download allow proctors to easily identify and then batch-assign students who rapid-guessed excessively to a new test
  • New configuration option ensures that district retesting rules for students who rapid-guess excessively are supported within the MAP Growth system

For more information, click the features & benefits link on the Student Test Engagement resource page.

 
Will tests be invalidated due to rapid-guessing?

No, tests will not be invalidated due to rapid-guessing, but we recommend that students be retested if they reach the 30 percent threshold for excessive rapid-guessing to ensure the data reflects what a student truly knows before being used to inform decisions.

 
Why is student test engagement important? 

You rely on assessment data to make critical decisions, and that data should be an accurate reflection of what students truly know. When students disengage from a test by rapid-guessing excessively, their performance can be misrepresented, potentially resulting in instructional and placement decisions that are not aligned with students’ true abilities. This is especially worth considering in the context of achievement gaps because NWEA research shows that students from underrepresented backgrounds are more likely to rapidly guess on test questions. That’s why we have expanded the student test engagement capabilities in MAP Growth to ensure students show what they really know, and you have accurate data to confidently make decisions at the individual student level and the systems level.

Learn more about our research on the impacts of rapid-guessing at the Student Test Engagement resource page.

 
How can we prepare? 

In advance of July 2019, districts should consider impacts on their training, policies, and MAP Growth configuration.
  1. Integrate the student test engagement capability into your fall 2019 MAP Growth training plan, so proctors are prepared to interact with the new auto-pause functionality and know how to easily identify and optionally retest students who rapid-guessed excessively.
  2. Assess your district’s retesting policy to determine if you need to make any changes to allow retesting of students who rapid-guessed excessively, in alignment with NWEA’s recommendation.
  3. Ensure your test restrictions in MAP Growth reflect your retesting policy – if your district does not allow retesting of students who rapid-guessed excessively, the system administrator or district assessment coordinator must contact NWEA Partner Support on or after July 2019 to request the default setting that allows retesting be turned off. 

For more information, see the Test Preparation & Policy Guidance document on the Student Test Engagement resource page.

 
How does the auto-pause feature work? 

Auto-pause is a unique feature that allows proctors to mitigate rapid-guessing behavior in real-time to prevent students from rapid-guessing excessively, which compromises assessment results. The test will pause when a student has rapid-guessed on multiple questions, notifying both the student and proctor that the student is going too quickly. It will pause two to three times during a student’s test session (depending on the test). With each pause, the proctor can reengage the student and resume the test. Alternatively, the proctor may choose to suspend the test so the student can continue it later, or terminate the test so the student can restart it later. Note that some district testing policies do not permit test termination. Check your district’s policy to be sure.

For more information, see the features & benefits grid on the Student Test Engagement resource page.

 
Is the auto-pause feature available on every MAP Growth test?

The auto-pause feature is available on MAP Growth Screening tests and MAP Growth tests for Math, Reading, Language Usage, and Science for grades K-12. It is not available on MAP Growth Skills Checklists or MAP Spanish.

 
How many times will the test pause?

On Screening tests, it will pause up to two times. On MAP Growth tests assessing subject and instructional areas, it will pause up to three times.

 
How will the auto-pause feature be effective if many students are rapid-guessing simultaneously?

If multiple tests are auto-paused at the same time, proctors have two options for resuming a test.
  • Resume an individual test from the student screen using their proctor pin
  • Resume one or more students from the proctor console

 
Based on interviews about the auto-pause functionality, proctors expressed interest in having the ability to resume individual student tests while away from the proctor console and the ability to resume multiple student tests simultaneously. This is all possible with the new auto-pause functionality.

 
What is the rapid-guessing threshold?

Our research shows that when students rapid-guess on 30 percent or more of the total number of questions on a test, their results may not accurately reflect their performance and we recommend that these students be retested.

 
What happens after the student has rapid-guessed excessively (reached the 30 percent rapid-guessing threshold)? 

The test will continue and the student can complete the test. NWEA recommends retesting students who have reached the rapid-guessing threshold, if district testing policy permits. This is because excessive rapid guessing compromises test results. Proctors can allow the student to finish the test and retest him or her at a later time.

Alternatively, proctors can suspend or terminate the test and have the student restart it (retest) at a later time. If considering suspending or terminating and restarting later, proctors should ensure that the district's testing policies permit these actions and be aware these tests will not appear in the new excessive rapid-guessing report or the Grade Breakdown report, though they will appear in the new test session details download available in the proctor console and in the new “excessive rapid guessing” filter in Test History Search in the “Find Students to Test” section.

 
Can the new test session details download be run after the session is closed?

No, the new test session details download must be downloaded as a PDF or data file before the proctor ends the test session.

 
Will rapid-guessing information display on reports?

Yes. Rapid-guessing information will be available in 3 reports:

New report available July 2019
A new report accessible to the Administrator, District Assessment Coordinator, and School Assessment Coordinator available in July 2019 will show students with completed test events that reached or exceeded the 30 percent threshold for excessive rapid guessing.

Note that if the proctor has suspended and restarted or terminated a student’s test due to excessive rapid guessing (versus allowing the student to finish the test), the student will not appear in this new report. However, the student can be easily identified as one who rapid-guessed excessively in the new test session details download (accessible in the proctor console before a test session has ended) and in the new “excessive rapid guessing” filter in Test History Search in the “Find Students to Test” section.

Student Profile report
The Student Profile Report will continue to display Rapid-Guessing % and Est. Impact of Rapid-Guessing % on RIT:
Screen shot of the Student Profile Report Reading score summary tab showing values for Rapid Guessing % and Estimated Impact Rapid Guessing % on RIT.

Grade Breakdown Report
The Grade Breakdown Report will continue to display the Rapid-Guessing % for each student who completed a test: 
Screen shot of columns I through L of a Grade Breakdown report showing column K as Rapid Guessing %

Note that if the proctor has suspended and restarted or terminated a student’s test due to excessive rapid guessing (versus allowing the student to finish the test), the student will not appear in the Grade Breakdown Report. However, the student can be easily identified as one who rapid-guessed excessively in the new test session details download (accessible in the proctor console before a test session has ended) and in the new “excessive rapid guessing” filter in Test History Search in the “Find Students to Test” section.

 
Where can I go for more information?

Additional information and resources are on the Student Test Engagement resource page.

Article Number
3688

Attachments

    Outcomes