___________________________________________________________________________________________________________________ LISTENING SPAN TEST WITH WORD RECALL (written input) ___________________________________________________________________________________________________________________ Script Author: Katja Borchert, Ph.D. (katjab@millisecond.com) for Millisecond Software, LLC Date: 11-02-2016 last updated: 05-24-2022 by K. Borchert (katjab@millisecond.com) for Millisecond Software, LLC Script Copyright © 05-24-2022 Millisecond Software ___________________________________________________________________________________________________________________ BACKGROUND INFO ___________________________________________________________________________________________________________________ This script implements a Listening Span Test with word recall based on: Cai et al. (2015). Factors contributing to individual differences in the development of consecutive interpreting competence for beginner student interpreters. The Interpreter and Translator Trainer, 9(1), 104-120. Sentences used in this script are not original to Cai et al. They are taken from the Inquisit automatedlspan.iqx script and can easily exchanged. ___________________________________________________________________________________________________________________ TASK DESCRIPTION ___________________________________________________________________________________________________________________ Participants hear a set of 2-6 sentences (that are either semantically correct or not) and are asked to evaluate each sentence to make sense (press 'e') or to be nonsensical (press 'i') while trying to retain the last word of each sentence for a later recall test. After the last sentence of the current set, participants are asked to enter all the last words (2-6) into a provided textbox. The computer automatically scores the response and provides feedback to the participant. At this point, participants can request a manual rescoring for a particular response - e.g. if they made a spelling error. The data file will flag those responses with values.rescoreRequest = 1. ___________________________________________________________________________________________________________________ DURATION ___________________________________________________________________________________________________________________ the default set-up of the script takes appr. 15 minutes to complete __________________________________________________________________________________________________________________ DATA FILE INFORMATION ___________________________________________________________________________________________________________________ The default data stored in the data files are: (1) Raw data file: 'listeninspantask_wordrecall_raw*.iqdat' (a separate file for each participant)* build: The specific Inquisit version used (the 'build') that was run computer.platform: the platform the script was run on (win/mac/ios/android) date, time: date and time script was run subject, group: with the current subject/groupnumber session: with the current session id blockcode, blocknum: the name and number of the current block (built-in Inquisit variable) trialcode, trialnum: the name and number of the currently recorded trial (built-in Inquisit variable) Note: trialnum is a built-in Inquisit variable; it counts all trials run; even those that do not store data to the data file such as feedback trials. Thus, trialnum may not reflect the number of main trials run per block. practice: 1 = practice; 0 = test setSize: number of sentences presented (2-6) phase: 1 = Sentence Evaluations; 2 = Last Word Recall stimulusitem: the presented stimuli in order of trial presentation sentenceItemNumber: the itemNumber of the currently presented sentence sense: True (the sentence makes sense) vs. False (the sentence does not make sense) response: the participant's response input: stores the words entered by participant Recall: the cleaned-up input correctResponse: stores the last words of the presented sentences (Note: compound words such as 'good-bye' or 'backyard' have been shortened to the last word such as 'bye' and 'yard') correct: the correctness of the response (1 = correct; 0 = incorrect) latency: the response latency (in ms) countCorrect: stores the number of correctly recalled words for the current set size RecallWordEstimate: stores an estimate of the number of words recalled intrusionWords: stores all the words that were not recognized as 'last' words from the participant's input ListeningSpanScore: overall number of correctly recalled words up this point rescoreRequest: 1 = participant requests a manual rescoring of her response (potential spelling errors etc not considered by automatic scoring) 0 = otherwise (2) Summary data file: 'listeninspantask_wordrecall_summary*.iqdat' (a separate file for each participant)* inquisit.version: Inquisit version run computer.platform: the platform the script was run on (win/mac/ios/android) startDate: date script was run startTime: time script was started subjectid: assigned subject id number groupid: assigned group id number sessionid: assigned session id number elapsedTime: time it took to run script (in ms); measured from onset to offset of script completed: 0 = script was not completed (prematurely aborted); 1 = script was completed (all conditions run) Rescoring: number of times participant has requested a manual rescoring propCorrect_overall: proportion of correctly judged sentences across all levels propCorrect_level2: proportion of correctly judged sentences in level2 propCorrect_Level3: proportion of correctly judged sentences in level3 propCorrect_Level4: proportion of correctly judged sentences in level4 propCorrect_Level5: proportion of correctly judged sentences in level5 propCorrect_Level6: proportion of correctly judged sentences in level6 ListeningSpanScore: overall number of correctly recalled words (Max = 60) * separate data files: to change to one data file for all participants (on Inquisit Lab only), go to section "DATA" and follow further instructions ___________________________________________________________________________________________________________________ EXPERIMENTAL SET-UP ___________________________________________________________________________________________________________________ tests 5 setsizes (2-6), within subjects 1. Practiceblock: 2 trials (setsize2, setsize3 => 5 practice sentences, 3 make sense, 2 do not) (no practice information in Cai et al, 2015) 2. Testblock: 15 trials (setsize2-6 => 60 test sentences, each set size presented 3 times; order is randomly determined; half the sentences make sense, the other do not) Scoring: The ListeningSpanScore in this script is the overall number of correctly recalled (last) words (see Cai et al, 2015) with a Max Score = 60. This measure is calculated independently of sentence evaluation accuracy. The computer automatically scores the participant's input and compares it to the correct input for the current set of sentences. Specifically, the computer checks for each last word if it is contained in the participant's input. Automatic scoring works only if no spelling mistakes are made (Note: all input is converted to lower case letters automatically). Participants receive performance feedback after each trial sequence and can request a manual re-scoring. ___________________________________________________________________________________________________________________ STIMULI ___________________________________________________________________________________________________________________ Sentences used in this script are not original to Cai et al. They are taken from the Inquisit automatedlspan.iqx script and are provided as demonstration examples only. The sentences are read by a native speaker of American English. You can exchange the stimuli for your own under section Editable Stimuli. ___________________________________________________________________________________________________________________ INSTRUCTIONS ___________________________________________________________________________________________________________________ Instructions are not original to Cai et al. They are provided by Millisecond Software and can be edited under section Editable Instructions. ___________________________________________________________________________________________________________________ EDITABLE CODE ___________________________________________________________________________________________________________________ check below for (relatively) easily editable parameters, stimuli, instructions etc. Keep in mind that you can use this script as a template and therefore always "mess" with the entire code to further customize your experiment. The parameters you can change are: Responsekeys: Tools-> KeyboardScancodes /senseKey: the 'makes sense' key (default: 'E'); the left response button /nonsenseKey: the 'does not make sense' key (default: 'I'); the right response button