___________________________________________________________________________________________________________________ Matrix Reasoning Task - Version1 ___________________________________________________________________________________________________________________ Script Author: Katja Borchert, Ph.D. (katjab@millisecond.com) for Millisecond Software, LLC Date: 07-08-2022 last updated: 05-17-2023 by K. Borchert (katjab@millisecond.com) for Millisecond Software, LLC Script Copyright © 05-17-2023 Millisecond Software ___________________________________________________________________________________________________________________ BACKGROUND INFO ___________________________________________________________________________________________________________________ This script implements Millisecond Software's computerized version of a matrix reasoning task inspired by the Raven Matrix Reasoning Test of non-verbal intelligence and reasoning skills. Matrices are taken from the published matrices of Matzen et al (2010). The published software by Matzen et al (2010) can be further used to generate new and unique matrices. This script runs version1 of 5 alternate versions (Note: the five versions provided should theoretically be of similar difficulties but that has not been empiricially validated yet) Reference: Matzen, L. E., Benz, Z. O., Dixon, K. R., Posey, J., Kroger, J. K., & Speed, A. E. (2010). Recreating Raven’s: Software for systematically generating large numbers of Raven-like matrix problems with normed properties. Behavior research methods, 42(2), 525-541. https://doi.org/10.3758/BRM.42.2.525 matrices downloaded from: https://github.com/LauraMatzen/Matrices ___________________________________________________________________________________________________________________ TASK DESCRIPTION ___________________________________________________________________________________________________________________ Participants are given twelve 3x3 matrices. Each matrix is missing its last piece. Below the matrix are eight alternative pieces to complete the figure, only one of which is correct. Each matrix involves a different set of transformations or rule for obtaining the missing piece. The matrices are roughly arranged in increasing order of difficulty. The test is self-paced with a time limit of 2 hours (editable). The matrices run by this script are pre-selected for version1. ___________________________________________________________________________________________________________________ DURATION ___________________________________________________________________________________________________________________ the default set-up of the script takes appr. 20 minutes to complete (Note: time limit can be implemented) ___________________________________________________________________________________________________________________ DATA FILE INFORMATION ___________________________________________________________________________________________________________________ The default data stored in the data files are: (1) Raw data file: 'matrixreasoning_version1_raw*.iqdat' (a separate file for each participant) build: The specific Inquisit version used (the 'build') that was run computer.platform: the platform the script was run on (win/mac/ios/android) date, time: date and time script was run subject: with the current subject id group: with the current group id session: with the current session id blockcode, blocknum: the name and number of the current block (built-in Inquisit variable) trialcode, trialnum: the name and number of the currently recorded trial (built-in Inquisit variable) Note: trialnum is a built-in Inquisit variable; it counts all trials run; even those that do not store data to the data file. version: the version run (here: version1) matrixCount: a counter tracks the number of matrices run level: the level of the current matrix (1, 2, 3, 4 = logic problems) matrix: the itemnumber of the current matrix matrixImage: the image file of the current matrix correctanswer: stores the correct answer for the current matrix (1-8) number from left to right, top to bottom currentanswer: the currently selected answer problemRT: the time (in ms) it took to work on the problem response: the response of participant Note: once response = 'submit', accuracy and final problemRT are calculated correct: correctness of response (1 = correct, 0 = otherwise) Note: accuracy is established once the submit button is pressed (aka participants commits to an answer) latency: response latency (in ms) of the current trial; measured from: onset of trial /////debugging: debugmode: for testing sessions, this parameter should be 0 (see editable parameter settings) (2) Summary data file: 'matrixreasoning_version1_summary*.iqdat' (a separate file for each participant) inquisit.version: Inquisit version run computer.platform: the platform the script was run on (win/mac/ios/android) startDate: date script was run startTime: time script was started subjectid: assigned subject id number groupid: assigned group id number sessionid: assigned session id number elapsedTime: time it took to run script (in ms); measured from onset to offset of script completed: 0 = script was not completed (prematurely aborted); 1 = script was completed (all conditions run) matrixCount: the number of matrix problems run propCorrect_overall: proportion correct across all matrices meanRT_overall: mean problem RT (across correct and incorrect solutions) across all matrices meanCorrRT_overall: mean correct problem RT across all correctly solved items /////////by Level: ///level1-3 = transformation problems ///level4 = logic problems countLevel1: the number of level1 problems run propCorrect_level1: proportion correct across all 3 level1 items meanRT_level1: mean problem RT (across correct and incorrect solutions) across all level1 items meanCorrRT_level1: mean correct problem RT across all correctly solved level1 items countLevel2: the number of level2 problems run propCorrect_level2: proportion correct across all 3 level2 items meanRT_level2: mean problem RT (across correct and incorrect solutions) across all level2 items meanCorrRT_level2: mean correct problem RT across all correctly solved level2 items countLevel3: the number of level3 problems run propCorrect_level3: proportion correct across all 3 level3 items meanRT_level3: mean problem RT (across correct and incorrect solutions) across all level3 items meanCorrRT_level3: mean correct problem RT across all correctly solved level3 items countLevel4: the number of level4 problems run propCorrect_level4: proportion correct across all 3 level4 items meanRT_level4: mean problem RT (across correct and incorrect solutions) across all 3 level4 items meanCorrRT_level4: mean correct problem RT across all correctly solved level4 items ___________________________________________________________________________________________________________________ EXPERIMENTAL SET-UP ___________________________________________________________________________________________________________________ By default, this script run 12 matrices that roughly increase in difficulty (see list.matrices for option to change to a random presentation of the matrizes). Each matrix provides 8 answer choices to choose from. Participants can change their selection until they press the 'Submit' button. The test is self-paced. By default, the time limit of the test is "none" which gives participants 2hours by design. Please note that the assignment of 'difficulty' in this script is based on results and discussion of Matzen et al (2010). See further notes below. The selection has not been empirically validated. Transformation Problems: //"1_1" => level1, difficulty1 (simple transformation) //"1_2" => level1, difficulty2 (diagonal transformation) //"1_3" => level3, difficulty3 (outward transformation) //"2_1" => level2, difficulty1 (2 simple transformations) //"2_2" => level2, difficulty2 (2 diagonal transformations) //"2_3" => level2, difficulty3 (1 diagonal transformation + 1 outward transformation) //"3_1" => level3, difficulty1 (2 simple transformations + 1 diagonal transformation) //"3_2" => level3, difficulty2 (1 simple transformation + 2 diagonal transformations) //"3_3" => level3, difficulty3 (2 diagonal transformations + 1 outward transformation) Logic Problems: //"4_1" => level4, difficulty1 (disjunction logic problem) //"4_2" => level4, difficulty2 (conjunction logic problem) //"4_3" => level4, difficulty3 (exclusive disjunction logic problem) The problems in this script are randomly selected from their respective problem pools. For example: list.level1_1 contains the itemnumber of all problems that can be selected for level1, difficulty1 problems The problem pool lists can be customized to run fixed lists instead. ///////Additional Comments: Difficulty Assignment/////// The assignment of 'difficulty' is based on results and discussion of Matzen et al (2010) Basic Progression of Difficulty: (1) Transformational Matrices a) Simple transformations (vertical and horizontal), b) Diagonal transformations c) Outward transformation Notes: Matzen et al (2010) report the general finding that the more transformations of each kind a problem contains the harder it gets. However, some restrictions apply: - For example, for level1 problems, diagonal problems were not statistically more difficult than simple transformations (2) Logic Matrices a) disjunction b) conjuction c) exclusive disjunction Notes: While Matzen et al (2010) report that the disjunction problems were easier than conjunction or exlusive disjunction problems, the difference was not statistically significant ___________________________________________________________________________________________________________________ STIMULI ___________________________________________________________________________________________________________________ matrices downloaded from: https://github.com/LauraMatzen/Matrices This script only uses the matrices that can be assigned to the level-difficulty categories defined in this script. Twelve of these items were selected to run version1 of the Inquisit Matrix Reasoning Script. ///////////////////////////////////////// ////Running your own matrix problems///// ///////////////////////////////////////// By replacing the images used in this script with your own (images should conform to the layout of matrix images and images of answer choices) under item.matrices/item.matrices_answers/item.matrices_correctanswers you could run your own matrix problems with this script. ___________________________________________________________________________________________________________________ INSTRUCTIONS ___________________________________________________________________________________________________________________ provided by Millisecond Software - can be edited under section 'Editable Instructions' ___________________________________________________________________________________________________________________ EDITABLE CODE ___________________________________________________________________________________________________________________ check below for (relatively) easily editable parameters, stimuli, instructions etc. Keep in mind that you can use this script as a template and therefore always "mess" with the entire code to further customize your experiment. The parameters you can change are: