Inquisit online - Missing datafiles


Author
Message
Lizzy
Lizzy
Esteemed Member (1.6K reputation)Esteemed Member (1.6K reputation)Esteemed Member (1.6K reputation)Esteemed Member (1.6K reputation)Esteemed Member (1.6K reputation)Esteemed Member (1.6K reputation)Esteemed Member (1.6K reputation)Esteemed Member (1.6K reputation)Esteemed Member (1.6K reputation)
Group: Forum Members
Posts: 20, Visits: 95

Hi,


I'm collaborating with a research management company to collect data using an online study. I have two experiments registered online, and want to run 75 participants through each. I included a wrap-up link at the end of the online experiments that refers participants back to a webpage of the research management company so thy can check how many participants have finished the study.


The problem now is that their numbers and my numbers don't match. According to their data (which I can also download), 150 participants have already reached the wrap-up link. However, when I look at my datafiles, I only have datafiles for about 100 participants. 


We tried to figure out what this discrepancy could be due to, but we have no idea. For existing half-way the experiment doesn't bring people to the wrap-up links. I made sure that in the last section of my experiment, participants have to click a button on the screen to continue, so even if they do not enter any other responses, this button click is recorded.


I was hoping you could offer some suggestions as to what might cause the discrepancy in numbers.



All best


Lizzy


Dave
Dave
Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)
Group: Administrators
Posts: 10K, Visits: 59K

The problem now is that their numbers and my numbers don't match. According to their data (which I can also download), 150 participants have already reached the wrap-up link. However, when I look at my datafiles, I only have datafiles for about 100 participants.


I would first ask said company how exactly they determine that number. For example, their page hits may be inflated by search engine bots / web crawlers.


kent62
kent62
Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)
Group: Forum Members
Posts: 7, Visits: 25
Hi I am having this issue too, I am getting my participants to complete training online.  I am using a batch function, they have to fill out an initial form, and then complete a training task.  I am getting more initial tasks than training data, though they are saying they have completed the whole exercise. Did you ever find out what was happening?  

Kind Regards
Dave
Dave
Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)
Group: Administrators
Posts: 10K, Visits: 59K
The discrepancy may be due to this
https://www.millisecond.com/forums/FindPost14889.aspx (symptom)
https://www.millisecond.com/forums/FindPost14905.aspx (reason)

The solution would be to have participants ensure that TLS 1.0 is enabled on their systems (cf. http://blogs.msdn.com/b/kaushal/archive/2011/10/02/support-for-ssl-tls-protocols-on-windows.aspx ).

The above, of course, only applies if your "initial task" (for which you report to receive more data) takes place outside of Inquisit (e.g. on some survey platform). It's not quite clear from your description. If *both* "inital" and "training" tasks are run via Inquisit, something else is amiss. In particular, this would suggest an issue with / mistake in the "training" script (the fact that data is available for the "inital" task inidcates that (a) scripts run fine and (b) data uploading works okay in principle).

Edited 6 Years Ago by Dave
kent62
kent62
Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)
Group: Forum Members
Posts: 7, Visits: 25
Hi Dave,

the initial one is also in Inquisit, the two are linked using a batch file.  Surely if this of a script error I would see this in all of my participants all of the time, rather than just a few, randomly? And only in one script, instead of 3 separate ones (all of which I took from the task library and only modified the instructions minority)?  I am missing about 3-6 data files in each of my 3 conditions, but none of the initial tasks (a survey on which they confirm their mobiles are off).

All the Best
kent62
kent62
Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)
Group: Forum Members
Posts: 7, Visits: 25
A student has also just messaged me that her computer froze on the final page, could that affect the upload?  
Dave
Dave
Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)
Group: Administrators
Posts: 10K, Visits: 59K
If the program for some reason (seemingly) freezes and someone force-quits it as a consequence, yes, that could affect the upload. The fact that this only happens with 1 of your 3 scripts does suggest some sort of systematic issue to me (not necessarily a technical one). Which script exactly is that? For example, it might be that your script's "final page" expects some input from participants that they are not aware of (e.g. pressing a certain key or keys to move past) and they're under the impression that the program froze. Then they force-quit.

kent62
kent62
Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)
Group: Forum Members
Posts: 7, Visits: 25
I have actually just found a couple in one of my other scripts.  It is happening in both my dual and single n back tasks (both adaptive from Jaeggi, 2010).  While some report freezing others have reported that they had no issues and successfully reached the inquisit web thank you page.  They have noticed nothing unusual.  I have sent out emails to all of them asking for computer and browser information to see if there are any trends.  So far I have identified 9 participants whose data is unaccounted for (so far 3 have confirmed that they noticed nothing strange).
kent62
kent62
Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)Expert (1.3K reputation)
Group: Forum Members
Posts: 7, Visits: 25

This just came in from one of my participants, she is not the first one to mention Chrome. Also, I don't think that it should be asking her to save the data?

"The only thing I noticed in today's test that was different to yesterday's was that it asked me to save the results after i was done. I did this just incase it was needed and the the usual 'Thank you for completing the task' page came up afterwards.


I used the Internet explorer browser but the 'thank you' page came up in google chrome which I don't think it did when I completed it yesterday."



Dave
Dave
Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)Supreme Being (853K reputation)
Group: Administrators
Posts: 10K, Visits: 59K
If Inquisit Web -- for whatever reason -- is unable to contact the server at the end of the experiment and upload the data (e.g. because the participant's internet connection broke down) it will prompt the participant to save the data locally and contact the researcher in charge.

GO

Merge Selected

Merge into selected topic...



Merge into merge target...



Merge into a specific topic ID...




Reading This Topic

Explore
Messages
Mentions
Search