Script Author: Katja Borchert, Ph.D. (katjab@millisecond.com), Millisecond
Created: January 29, 2019
Last Modified: January 17, 2025 by K. Borchert (katjab@millisecond.com), Millisecond
Script Copyright © Millisecond Software, LLC
This script implements the Operation Span test subtest of the Adaptive Composite Complex Span Test (ACCES); an adaptive test of working memory with visuospatial ("symmetry span test"), mathematical ("operation span test") and verbal subtests ("reading span test") for children ages 8-13.
The ACCES was developed by Gonthier et al (2018). According to the authors "the test presents a fixed number of trials to all participants, allows for partial credit scoring, and can be used with children regardless of ability level. The ACCES demonstrated satisfying psychometric properties in a sample of 268 children aged 8┌13 years." (p.910)
All materials for the ACCES ┌ including the stimuli, an open source implementation of the task script under PsychoPy (Peirce, 2007), and all validation data ┌ can be accessed via the Open Science Framework platform at https://osf.io/bk7pm/.
Norms in this script (based on grade level) use the data provided by Gonthier et al (2018) collected with a sample of French students.
Gonthier, C., Thomassin, N., & Roulin, J.-L. (2016). The Composite Complex Span: French validation of a short working memory task. Behavior Research Methods, 48(1), 233-242. doi:10.?3758/?s13428-015-0566-3
Gonthier C, Aubry A, Bourdin B. (2018). Measuring working memory capacity in children using adaptive tasks: Example validation of an adaptive complex span. Behav Res Methods. Jun;50(3):910-921. doi: 10.3758/s13428-017-0916-4. PMID: 28643158.
9 minutes
Participants work on 6 operation span test trials. Levels for each trial (after the first) are adapted based on performance.
Operation Span Test: a dual task involving the evaluation of simple math problems (e.g. '2 + 2 = 5') while also studying letters for a later recall test: Evaluation of Math Problem -> Letter Learning -> Evaluation of Math Problem -> Letter Learning.....-> Letter Recall
The number of 'Math-evaluations/Letter learning' combos depends on the level of difficulty (=span size) of the current test trial. All participants start at level 4. Depending on performance they move up, stay on the same level, or go down a level. The lowest level tested is level 2; the highest level tested is level 8.
The task provides 3 practice session before the actual 6 test trials are run: Practice 1: training of the letter recall task Practice 2: training of the math evaluation task Practice 3: dual training of the combined task
level = span size
4 phases:
PHASE 1: Practice 1 -Letter Recall Training ("Memory Task")
Participants work on 2 trials (level 2, followed by level 3) with a fixed set of stimuli for each round.
During this phase, they only work on the letter recall task (no math problems are presented)
Trial Sequence:
blank (700ms)->Start Fixation Cross (presented for 1200ms) -> blank (for 500ms) ->
Letter (800ms) -> Blank (800ms) -> Letter (800ms) -> Blank (800ms) -> .......-> Blank (700ms)
-> Recall Screen (as long as needed, corrections possible)
-> Feedback (3000ms)
At the end of Practice1, recall performance is analyzed and the practice block is repeated
IF mean recall performance is under 70% correct.
(recall performance: the number of letters correctly recalled in the exact position of presentation)
PHASE 2: Practice 2 - Math Statement Evaluation Training ("Processing Task")
Participants work on 10 math statements (e.g. "2 + 2 = 6") and evaluate them to be 'true' or 'false'.
The math statements are the same for each participant and are presented in fixed order.
No letter recall task is run.
Trial Sequence:
blank (700ms)->Start Fixation Cross (presented for 1200ms) -> blank (for 500ms) ->
Math Statement (max. 8000ms) -> Feedback (3000ms) -> Blank (150ms) -> Math Statement (max. 8000ms) -> Feedback (3000ms)....
At the end of this practice round, evaluation performance is analyzed and the practice block is repeated
if the proportion correctly evaluated math statements is under 70% correct.
Furthermore, the duration of the math problem presentation for the test trials is calculated:
median time (in ms) the problems were answered + 2.5 x Median Absolute Deviation (MAD).
(Range: 2000ms - 8000ms)
PHASE 3: Practice 3 - Dual Task Training
Participants work on 2 combined trials (level 2, level 3). The stimuli are the same for all participants
and are presented in fixed order.
Trial Sequence:
blank (700ms)->Start Fixation Cross (presented for 1200ms) -> blank (for 500ms) ->
Math Statement (calculated presentation time during practice 2) -> Blank (150ms) ->
Letter (800ms) -> Blank (800ms) ->
Math Statement (calculated presentation time during practice 2) -> Blank (150ms) ->
Letter (800ms) -> Blank (800ms) -> .....
Letter (800ms) -> Blank (700ms) -> Recall Screen -> Summary Feedback (3000ms)
PHASE 4: Test (Dual Task)
Participants work on 6 combined trials (starting level = 4; levels are adjusted based on performance
thereafter). Each trial (1-6) presents the stimuli from the same stimuli lists in the same order
(though not all participants will work on all the possible stimuli of a particular trial as this is
level dependent). No more feedback is provided.
Trial Sequence:
blank (700ms)->Start Fixation Cross (presented for 1200ms) -> blank (for 500ms) ->
Math Statement (calculated presentation time during practice 2) -> Blank (150ms) ->
Letter (800ms) -> Blank (800ms) ->
Math Statement (calculated presentation time during practice 2) -> Blank (150ms) ->
Letter (800ms) -> Blank (800ms) -> .....
Letter (800ms) -> Blank (700ms) -> Recall Screen
During each round, the computer calculates
a. processing task performance (here: math performance)
b. recall performance
- the number of correctly recalled letters
- the total number of correctly recalled letters
At the end of each round, the next level is determined based on recall performance:
1. levels goes down by 1 for recall performance less than 60%
2. levels stay the same for 60% <= recall performance < 100%
3. levels go up by 1 for perfect recall performance (100% correct)
All stimuli are provided by Gonthier et al (2018)
All materials for the ACCES, including the stimuli, an open source implementation
of the task script under PsychoPy (Peirce, 2007), and all validation data can be accessed via the Open Science
Framework platform at https://osf.io/bk7pm/.
Instructions are modelled after the ones used in the e-prime script provided
by Gonthier et al (2018).
The instructions in this script are provided by as htm/html pages and can be edited by changing the
provided htm/html files. To edit htm/html-files: open the respective documents in simple Text Editors
such as TextEdit (Mac) or Notepad (Windows).
See script acces_ospan_instructions_inc.iqjs
File Name: acces_OSPAN_summary*.iqdat
| Name | Description |
|---|---|
| inquisit.version | Inquisit version number |
| computer.platform | Device platform: win | mac |ios | android |
| computer.touch | 0 = device has no touchscreen capabilities; 1 = device has touchscreen capabilities |
| computer.hasKeyboard | 0 = no external keyboard detected; 1 = external keyboard detected |
| startDate | Date the session was run |
| startTime | Time the session was run |
| subjectId | Participant ID |
| groupId | Group number |
| sessionId | Session number |
| elapsedTime | Session duration in ms |
| completed | 0 = Test was not completed 1 = Test was completed |
| age | The entered age of the participant |
| gradeLevel | The entered grade level of the participant |
| gender | The entered gender of the participant |
| osDurationS | The OSPAN task duration in seconds |
| osTotalStimsRecalled | The total number of matrix positions recalled across all 6 OSPAN test rounds |
| osZScore | The calculated z-score of the total number of recalled matrix positions across all 6 OSPAN test rounds |
| osPercentile | The calculated percentile of the z-score of the total number of recalled matrix positions across all 6 OSPAN test trials mean and standard deviation used to calculate z-scorespercentile ranks are based on published data by Gonthier et al (2018) using a sample of French students. For more detail see Gonthier et al (2018). |
| list.osProcessingAccOverall.mean | The mean proportion correct Processing Task ('math problems') performance across all 6 OSPAN test rounds |
| osProcessingTaskFlag | 1 = the mean proportion correct OSPAN Processing Task ('math problems') performance is below 70% correct (OSPAN performance is flagged) 0 = otherwise (OSPAN performance is not flagged) list.osProcessingRTOverall.mean: mean correct processing response time (in ms) |
| list.osCurrentLevels.mean | The average OSPAN span size worked on |
| list.osCurrentLevels.minimum | The minimum OSPAN span size worked on (lowest possible span size tested: 2) |
| list.osCurrentLevels.maximum | The maximum OSPAN span size worked on (highest possible span size tested: 8) |
| osLevel2Count | Number of times span size 2 was run during the OSPAN |
| osLevel3Count | Number of times span size 3 was run during the OSPAN |
| osLevel4Count | Number of times span size 4 was run during the OSPAN |
| osLevel5Count | Number of times span size 5 was run during the OSPAN |
| osLevel6Count | Number of times span size 6 was run during the OSPAN |
| osLevel7Count | Number of times span size 7 was run during the OSPAN |
| osLevel8Count | Number of times span size 8 was run during the OSPAN |
| osLevelRound1 | OSPAN span size tested during Round 1 (by default: 4) |
| osProblemCumAccRound1 | Number of correctly answered OSPAN Processing Task ('math evaluation task') problems during Round 1 |
| osProcessingAccRound1 | Proportion correct OSPAN Processing Task ('math evaluation task') performance during Round 1 |
| osStimsRound1 | The presented OSPAN recall stims ('matrix positions') during Round 1 (in the order presented) |
| osRecallResponseRound1 | The recalled OSPAN stims ('matrix positions') during Round 1 (in the order selected) |
| osNumberStimsRecalledRound1 | The number of correctly recalled OSPAN stims ('matrix positions') during Round 1 |
| osProcessingRTRound1 | Mean correct processing task response time (in ms) in Round 1 |
| osLevelRound2 | OSPAN span size tested during Round 2 |
| osProblemCumAccRound2 | Number of correctly answered OSPAN Processing Task ('math evaluation task') problems during Round 2 |
| osProcessingAccRound2 | Proportion correct OSPAN Processing Task ('math evaluation task') performance during Round 2 |
| osStimsRound2 | The presented OSPAN recall stims ('matrix positions') during Round 2 (in the order presented) |
| osRecallResponseRound2 | The recalled OSPAN stims ('matrix positions') during Round 2 (in the order selected) |
| osNumberStimsRecalledRound2 | The number of correctly recalled OSPAN stims ('matrix positions') during Round 2 |
| osProcessingRTRound2 | Mean correct processing task response time (in ms) in Round 2 |
| osLevelRound3 | OSPAN span size tested during Round 3 |
| osProblemCumAccRound3 | Number of correctly answered OSPAN Processing Task ('math evaluation task') problems during Round 3 |
| osProcessingAccRound3 | Proportion correct OSPAN Processing Task ('math evaluation task') performance during Round 3 |
| osStimsRound3 | The presented OSPAN recall stims ('matrix positions') during Round 3 (in the order presented) |
| osRecallResponseRound3 | The recalled OSPAN stims ('matrix positions') during Round 3 (in the order selected) |
| osNumberStimsRecalledRound3 | The number of correctly recalled OSPAN stims ('matrix positions') during Round 3 |
| osProcessingRTRound3 | Mean correct processing task response time (in ms) in Round 3 |
| osLevelRound4 | OSPAN span size tested during Round 4 |
| osProblemCumAccRound4 | Number of correctly answered OSPAN Processing Task ('math evaluation task') problems during Round 4 |
| osProcessingAccRound4 | Proportion correct OSPAN Processing Task ('math evaluation task') performance during Round 4 |
| osStimsRound4 | The presented OSPAN recall stims ('matrix positions') during Round 4 (in the order presented) |
| osRecallResponseRound4 | The recalled OSPAN stims ('matrix positions') during Round 4 (in the order selected) |
| osNumberStimsRecalledRound4 | The number of correctly recalled OSPAN stims ('matrix positions') during Round 4 |
| osProcessingRTRound4 | Mean correct processing task response time (in ms) in Round 4 |
| osLevelRound5 | OSPAN span size tested during Round 5 |
| osProblemCumAccRound5 | Number of correctly answered OSPAN Processing Task ('math evaluation task') problems during Round 5 |
| osProcessingAccRound5 | Proportion correct OSPAN Processing Task ('math evaluation task') performance during Round 5 |
| osStimsRound5 | The presented OSPAN recall stims ('matrix positions') during Round 5 (in the order presented) |
| osRecallResponseRound5 | The recalled OSPAN stims ('matrix positions') during Round 5 (in the order selected) |
| osNumberStimsRecalledRound5 | The number of correctly recalled OSPAN stims ('matrix positions') during Round 5 |
| osProcessingRTRound5 | Mean correct processing task response time (in ms) in Round 5 |
| osLevelRound6 | OSPAN span size tested during Round 6 |
| osProblemCumAccRound6 | Number of correctly answered OSPAN Processing Task ('math evaluation task') problems during Round 6 |
| osProcessingAccRound6 | Proportion correct OSPAN Processing Task ('math evaluation task') performance during Round 6 |
| osStimsRound6 | The presented OSPAN recall stims ('matrix positions') during Round 6 (in the order presented) |
| osRecallResponseRound6 | The recalled OSPAN stims ('matrix positions') during Round 6 (in the order selected) |
| osNumberStimsRecalledRound6 | The number of correctly recalled OSPAN stims ('matrix positions') during Round 6 |
| osProcessingRTRound6 | Mean correct processing task response time (in ms) in Round 6 |
| sOSPANTaskTrainingCount | The number of times the OSPAN span task training was run (OSPAN practice 1) |
| osProcessingTaskTrainingCount | The number of times the OSPAN processing task training was run (OSPAN practice 2) |
| osDualTaskTrainingCount | The number of times the OSPAN span task training was run (OSPAN practice 3) |
| osProcessingTaskMaxDuration | The maximum duration (in ms) that OSPAN processing Task problems ('math problems') are presented during the Dual Task Training block (=practice3) and the actual Test rounds. This duration was calculated based on the Median Processing Task Duration during the Processing Task Training (=practice2) 'os ProcessingTask medianRT' + 2.5 x 'os Processing Task MAD RT' |
| osProcessingRTMeanPr2 | The mean response latency answering OSPAN processing task problems ('math problems') during practice2 |
| osProcessingRTMedianPr2 | The median response latency answering OSPAN processing task problems ('math problems') during practice2 |
| osProcessingRTMAD | Median Absolute Deviation (MAD) of response latencies answering OSPAN processing task problems during practice2 |
File Name: acces_ospan_raw*.iqdat
| Name | Description |
|---|---|
| build | Inquisit version number |
| computer.platform | Device platform: win | mac |ios | android |
| computer.touch | 0 = device has no touchscreen capabilities; 1 = device has touchscreen capabilities |
| computer.hasKeyboard | 0 = no external keyboard detected; 1 = external keyboard detected |
| date | Date the session was run |
| time | Time the session was run |
| subject | Participant ID |
| group | Group number |
| session | Session number |
| blockcode | The name the current block (built-in Inquisit variable) |
| blocknum | The number of the current block (built-in Inquisit variable) |
| trialcode | The name of the currently recorded trial (built-in Inquisit variable) |
| trialnum | The number of the currently recorded trial (built-in Inquisit variable) trialnum is a built-in Inquisit variable; it counts all trials run even those that do not store data to the data file. |
| age | The entered age of the participant |
| gradeLevel | The entered grade level of the participant |
| gender | The entered gender of the participant |
| phase | Stores the name of the current task phase |
| roundCount | Counts the rounds ("trials") run in the current phase |
| currentLevel | Stores the levelspansize tested in the current round |
| processingTaskProblem | Stores the current processing task problem (e.g. math problem) presented (PROCESSING TASK) |
| correctResponse | Stores the correct response to the current processing task problem (TRUE vs. FALSE) (PROCESSING TASK) |
| processingTaskResponse | Stores the given response to the current processing task problem (TRUE vs. FALSE) (PROCESSING TASK) |
| processingTaskAcc | Stores the accuracy of the processing task response (PROCESSING TASK) 1 = correct 0 = error |
| processingTaskCumAcc | Stores the number of correct processing task responses (PROCESSING TASK) |
| stim | Stores the current recall stim (e.g. letter) presented (MEMORY TASK) |
| currentStims | Stores the collected recall stims of the current round in the order presented (MEMORY TASK) |
| recallResponse | Stores the recall stims of the current round in the order selected on the recall matrix (MEMORY TASK) |
| numberStimsRecalled | Stores the number of correctly recalled stims of the current round (MEMORY TASK) |
| totalStimsRecalled | Stores the total number of correctly recalled stims during the current task (MEMORY TASK) |
| stimulusItem | The presented stimuli in order of trial presentation of the currently recorded trial |
| response | The participant's response of the currently recorded trial |
| correct | Accuracy of response: 1 = correct response; 0 = otherwise of the currently recorded trial |
| latency | The response latency (in ms) of the current trial |
The procedure can be adjusted by setting the following parameters.
| Name | Description | Default |
|---|---|---|
User Interface Sizing Parameters |
||
| osFixationCrossHeight | Sets the size of the fixation cross (presented during practice blocks) relative to canvas height | 30% |
| osMatrixSize | Sets the size of the recall matrix relative to the canvas | 65% |
| osProblemHeight | Sets the height of the presented equations relative to canvas height | 10% |
| osStimHeight | Sets the height of the letters (to be recalled) relative to canvas height | 20% |
Duration Parameters |
||
| osPreFixationDuration | Sets the duration (in ms) of the blank space that precedes the fixation cross at the beginning of each trial | 700 |
| osFixationDuration | Sets the duration (in ms) of the fixation cross presented on screen | 1200 |
| osFixationStimISI | Sets the duration (in ms) of the blank space that follows the fixation cross before the first letter is presented | 500 |
| osProcessingProblemMaxDuration | Sets the max duration (in ms) that an equation is presented on screen (used during practice 2) | 8000 |
| osProcessingProblemMinDuration | Sets the minimum duration (in ms) that an equation is presented on screen | 2000 |
| osProcessingResponseISI | Sets the duration (in ms) of the blank space that follows a response to the equation problem before the next letter is presented | 150 |
| osStimPresentationDuration | Sets the duration (in ms) that each letter is presented on screen | 800 |
| osIsi | Sets the duration (in ms) of the blank space that follows the presentation of a letter before the next letter/next equation is presented | 800 |
| osRecallDelay | Sets the duration (in ms) of the blank space that follows the last letter before the recall matrix is presented | 700 |
Procedure Parameters |
||
| osSingleTaskFeedbackDuration | Sets the duration (in ms) of the final performance feedback text presented during the single task practice sessions (practice1/practice2) | 3000 |
| osProcessingTaskImmediateFeedbackDuration | Sets the duration (in ms) of the intermittend feedback presented during the processing Task Training | 3000 |
| osDualTaskFeedbackDuration | Sets the duration (in ms) of the performance feedback text presented for the dual task training performance (practice3) | 3000 |
| osStartLevel | Sets the start level for the ospan test, should not be changed unless the necessary stimuli are provided | 4 |
| osPracticeMinAcc | Defines the lowest proportion correct that needs to be achieved during practice1&2 to move on to the next phase | 0.7 |
| osLevelDecrease | Performance under 60% correct results in decreasing the level for the next round | 0.6 |
| osLevelIncrease | Performance at 100% results in increasing the level for the next round | 1 |
Debug |
||
| osDebugmode | Debug Stimuli: should be set to 0 for the actual test (if set to 1 the correct letters show up on the recall screen) | 0 |