Belief Updating Task

Technical Manual

Script Author: Katja Borchert, Ph.D. (katjab@millisecond.com), Millisecond

Credits:
Millisecond Software thanks C. Hobbs for sharing the script with the library1

Created: January 15, 2021

Last Modified: January 01, 2025 by K. Borchert (katjab@millisecond.com), Millisecond

Script Copyright © Millisecond Software, LLC

Background

This script implements a custom Belief Updating Procedure (Hobbs et al, 2022) used to study people's tendency to update their current beliefs based on provided information .

References

Hobbs, C., Vozarova, P., Sabharwal, A., Shah, P., & Button, K. (2022). Is depression associated with reduced optimistic belief updating? Royal Society Open Science, 9(2), 190814–190814. https://doi.org/10.1098/rsos.190814

Duration

60 minutes

Description

Participants are given positive and negative life events and are asked to provide probability estimate that these events might be happening (not happening) to them throughout their lives. In-between an initial estimate and a re-estimate of the probebility, they are given the actual probability of the event happening (not happening) to someone like them. Later, their memory for these actual probabilities. The script further collects ratings for each life event on 7 scales ("vividness", "familiarity", "prior experience", "emotional arousal", "negativity", "positivity", "controllability").

Procedure

(I) 8 counterbalanced groups (every combination of values.valenceOrder/values.listOrder/values.happeningOrder):

Group1: Neg Before Pos, N Before Nh, List1 Before List2
Group2: Neg Before Pos, Nh Before H, List2 Before List1
Group3: Neg Before Pos, H Before Nh, List2 Before List1
Group4: Neg Before Pos, Nh Before H, List1 Before List2
Group5: Pos Before Neg, N Before Nh, List1 Before List2
Group6: Pos Before Neg, Nh Before H, List2 Before List1
Group7: Pos Before Neg, H Before Nh, List2 Before List1
Group8: Pos Before Neg, Nh Before H, List1 Before List2

Assignment is done by groupnumber selection

(II) Each group runs the following phases:

(A) PRACTICE: 2 estimate trainings

(B) Test:
(1) Estimate1/2: for all 20 items of list1 negative items (OR: list2 negative items/list1 positive items/ list2 positive items)
(a) presentation of life event (4s), initial probability estimate for event happening(not happening), isi (1200ms),
presentation (3s) of actual probability of life event happening (not happening), isi (1200ms),
(b) presentation of same life event (4s), re-estimate probability for event happening(not happening), isi (1200ms),

(2) Estimate1/2: for all 20 items of list2 negative items (list1 negative items/list1 positive items/ list2 positive items)
(a) presentation of life event (4s), initial probability estimate for event NOT happening(happening), isi (1200ms),
presentation (3s) of actual probability of life event NOT happening (happening), isi (1200ms),
(b) presentation of same life event (4s), re-estimate probability for event NOT happening(happening), isi (1200ms),

• (1) and (2) counterbalance 'list' (list1 vs. list2) and 'happening/not happening'
• order of life events random

(3) Recall of actual life event probabilities introduced in (1) - 20 trials (order of life events random)
(4) Recall of actual life event probabilities introduced in (2) - 20 trials (order of life events random)

(5) Ratings: for all 40 life events introduced in 1-2 (life events random)
- ratings on 7 scales ("vividness", "familiarity", "prior experience", "emotional arousal", "negativity", "positivity", "controllability")
- currently the scale order is randomized

(6)-(10): repeat of 1-5 with life events of opposite valence


ATTENTION CHECKS:
This script runs random attention Checks throughout the task.
By default, 8 attention checks (2 different kind of trials) are run.

Attention Check Algorithm:
- parameters.numberAttentionCheckTrials sets the number of attention checks to run (default: 8)

- there are 1280 trials during the task that could randomly be followed by an attentioncheck
=> each of those trials update 'values.trialCounter'
=> the script randomly selects 8 of those trials (and sorts them in ascending sequence):
=> each trial checks at the end whether values.trialCounter matches the next 'check trialnumber'
=> if so: an attention check trial is run (currently there are two types that can be selected. Selection is
done randomly without replacement)
=> Details under section 'Attention Check Code'

Stimuli

provided by Katie Hobbs, see section Editable Stimuli

Task stimuli for the test consist of short descriptions of 40 negative and 40 positive life events and the
average probability of someone in the same environment as the participant experiencing these events in
their lifetime.

In keeping with previous research very common (greater than 70%) and very rare (less than 10%) events
will not be included. This will allow for change between initial and re-estimates.
To allow for variability in ratings for high and low probability life events,
participants are told that event probabilities fell within 3% and 77%.

Of the 72 negative life events used by Korn et al, 42 (2 for practice, 40 for test) of the
same negative life events are used, although new estimates were estimated to account for
possible changes in available statistics for probabilities following the publication of Korn et al (2014).

In addition, estimates for 42 positive life events (2 for practice, 40 for test).
Estimates were derived from reputable resources including peer reviewed academic journal articles,
governmental resources (e.g. the Office for National Statistics),
non-governmental organisation resources, and marketing and consumer data companies.

the default stimuli might be cultural-specific

Instructions

provided by Katie Hobbs

Summary Data

File Name: beliefupdating_summary*.iqdat

Data Fields

NameDescription
inquisit.version Inquisit version number
computer.platform Device platform: win | mac |ios | android
computer.touch 0 = device has no touchscreen capabilities; 1 = device has touchscreen capabilities
computer.hasKeyboard 0 = no external keyboard detected; 1 = external keyboard detected
startDate Date the session was run
startTime Time the session was run
subjectId Participant ID
groupId Group number
sessionId Session number
elapsedTime Session duration in ms
completed 0 = Test was not completed
1 = Test was completed
Attention Checks
propCorrectAttentionChecks Proportion correct Attention Check responses
numberCorrectAttentionChecks The absolute number of Correct Attention Check responses

Raw Data

File Name: beliefupdating_raw*.iqdat

Data Fields

NameDescription
build Inquisit version number
computer.platform Device platform: win | mac |ios | android
computer.touch 0 = device has no touchscreen capabilities; 1 = device has touchscreen capabilities
computer.hasKeyboard 0 = no external keyboard detected; 1 = external keyboard detected
date Date the session was run
time Time the session was run
subject Participant ID
group Group number
session Session number
blockcode The name the current block (built-in Inquisit variable)
blocknum The number of the current block (built-in Inquisit variable)
trialcode The name of the currently recorded trial (built-in Inquisit variable)
trialnum The number of the currently recorded trial (built-in Inquisit variable)
trialnum is a built-in Inquisit variable; it counts all trials run
even those that do not store data to the data file.
valenceOrder 1 = Neg -> Pos; 2 = Pos -> Neg
listOrder 1 = list1 -> list2; 2 = list2->list1
happeningOrder 1 = H -> NH; 2 = NH -> H
trialCounter Counts all relevant test trials across all phases (used to sprinkle in attention questions)
there are a total of 1280 trials counted
phase "practice", "estimate", "recall", "ratings"
trialCounterPerPhase Counts the number of trials per phase
Estimate Phase: 8 trials per life event (20 life events x 8 = 160 trials)
Recall Phase: 1 trial per life event (20 life events x 1 = 20 trials)
Ratings Phase: 7 ratings per life event (40 life events x 7 = 280 trials)
valence "positive" vs. "negative"
list 1 vs. 2
happenCondition 1 = H; 2 = NH
ratingCategory For rating trials: stores the current rating Category (familiarity....vividness)
index The itemumber of the currently presented life event
lifeEvent The currently presented life event
pH Probability(life event happening)
pNH Probability(life event NOT happening)
pTarget The relevant probability (depending on values.happenCondition)
Dvs
pEstimate The current probability estimate entered by the participant
pEstimate1 The probability estimate entered by the participant for the INITIAL estimate
pEstimate2 The probability estimate entered by the participant for the RE-ESTIMATE estimate
rTEstimate1 The response time (in ms) for making INITIAL probability estimate
rTEstimate2 The response time (in ms) for making RE-ESTIMATE probability estimate
pRecall Probability of life event as recalled by participant
accRecall 1 = the entered probability recalled is correct; 0 = otherwise
rtRecall The response time (in ms) for recall
ratingControllability The entered number (1-6) for the controllability scale for the current life event
ratingEmotionalArousal The entered number (1-6) for the emotional arousal scale for the current life event
ratingFamiliarity The entered number (1-6) for the familiarity scale for the current life event
ratingNegativity The entered number (1-6) for the negativity scale for the current life event
ratingPositivity The entered number (1-6) for the positivity scale for the current life event
ratingPriorExperience The entered number (1-6) for the prior experience scale for the current life event
ratingVividness The entered number (1-6) for the vividness scale for the current life event
rtControllability The response time (in ms) of submitting controllability rating
rtEmotionalArousal The response time (in ms) of submitting emotional arousal rating
rtFamiliarity The response time (in ms) of submitting familiarity rating
rtNegativity The response time (in ms) of submitting negativity rating
rtPositivity The response time (in ms) of submitting positivity rating
rtPriorExperience The response time (in ms) of submitting prior experience rating
rtVividness The response time (in ms) of submitting vividness rating
stimulusItem The presented stimuli in order of trial presentation
response The participant's response (scancode of response buttons)
correct Accuracy of response: 1 = correct response; 0 = otherwise (particularly relevant for attention check trials)
latency The response latency (in ms) measured for the current data-recording trial
Attention Checks
propCorrectAttentionChecks Proportion correct Attention Check responses
numberCorrectAttentionChecks The absolute number of Correct Attention Check responses

Parameters

The procedure can be adjusted by setting the following parameters.

NameDescriptionDefault
Trial Durations
isiEstimate The interstimulus intervals (in ms) during the estimation phase 1200
lifeEventDurationEstimate The duration (in ms) of the life event presentation 4000
responseTimeoutEstimate The duration (in ms) of the response Timeout for probability-estimates 10000
probabilityDurationEstimate The duration (in ms) of the actual probability presentation of the life event 3000
itiRating The duration (in ms) in between the ratings trials of different life events1200
attentionCheckDuration The max. duration (in ms) of the attentionCheck questions5000
numberAttentionCheckTrials The number of random attention Checks run throughout the task8