Web Research, Subject ID, Ip address tracking, http-referer, dropout


Author
Message
Erik
Erik
Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)
Group: Forum Members
Posts: 13, Visits: 5

Hello Inquisit,



I have a few questions regarding web research and dropout information :



1) In order to achieve equal distribution for 12 conditions I chose
sequential subject number generation. When I analyze my data, I have 23
subjects who completed the experiment, and 39 subjects who began and
then canceled. The subject numbers range from  34 - 282. I tested the
experiment online until about subject number 30 and then deleted the web
data. Does this mean that about 250 person visited the launch page, but
only 39 of them started the experiment?

That would be a return rate of about 9,2 % :-((



2) the variable computer.ipaddress.1 is in about 50% 0.0.0.0 in my data ,
while in the other 50% it is an ordinary ip address like
192.168.178.23. Why is that?



3) Is it possible to track the participants referrer in the data with a
http-referer? This would allow me to monitor the success of online
akquisition strategies...



4) I included also a stat counter on the ending page. Unfortunately it
shows, that  31 people "completed" the experiment, but in fact only 23
completed. Why is that?



Thanks a lot for your help!



Erik


Dave
Dave
Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)
Group: Administrators
Posts: 10K, Visits: 57K

Does this mean that about 250 person visited the launch page, but
only 39 of them started the experiment?


Not necessarily. It might be that search robots crawling your launch page increased the subject count. Where did you host your experiment and how did you advertise it?


2) the variable computer.ipaddress.1 is in about 50% 0.0.0.0 in my data ,
while in the other 50% it is an ordinary ip address like
192.168.178.23. Why is that?


Today's computers have multiple network interfaces (LAN, W-LAN, etc.). 0.0.0.0 indicates that the first interface (computer.ipaddress.1) on a given computer (e.g. LAN card) was not assigned an IP address. computer.ipaddress.2 might have returned something else.


3) Is it possible to track the participants referrer in the data with a
http-referer? This would allow me to monitor the success of online
akquisition strategies...


Not directly. You would have to apply much of the same strategies as in https://www.millisecond.com/support/docs/v3/html/howto/interopsurveys.htm, i.e., use query parameters.


4) I included also a stat counter on the ending page. Unfortunately it
shows, that  31 people "completed" the experiment, but in fact only 23
completed. Why is that?


Not sure, but might be related to (1). Also not sure what exactly you consider the "ending page".


Regards,


~Dave


Erik
Erik
Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)
Group: Forum Members
Posts: 13, Visits: 5

Hi Dave,



thank you for the fast reply!



I hosted the experiment on http://research.millisecond.com/aowbonn/handball.web
and advertised in forums and facebook groups/walls that contain my population of interest. I started advertising on tuesday.

But is it right, that when a person visits the launch page and does not
start the experiment, the subject count is increased by one?

Are search robots crawling http://research.millisecond.com/aowbonn/handball.web ?



Sorry for being unprecise, I specified a custom finish page with a
counter using the webscript registration wizard. As I informed my
participants that they can cancel the experiment with strg + q, I think
this increased also my stat counter...



Regards,

Erik


Dave
Dave
Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)
Group: Administrators
Posts: 10K, Visits: 57K

I hosted the experiment on http://research.millisecond.com/aowbonn/handball.web
and advertised in forums and facebook groups/walls that contain my population of interest. I started advertising on tuesday.


Might be that a bunch of people clicked the link to your launch page, gave it a quick look and then dismissed participation for whatever reason (see below). Perhaps there's a better way to acquire participants / increase return ratio than Facebook?


But is it right, that when a person visits the launch page and does not
start the experiment, the subject count is increased by one?


Yes, as subject numbers are generated on the server side. You can test this for yourself by visiting your launch page, locating the subject number in its source code, reloading the launch page and locating the (new) subject number.



It would seem so. Just google "site:research.millisecond.com" (no quotes). However, I'm not entirely sure if this will do anything to the subject count.


As I informed my
participants that they can cancel the experiment with strg + q, I think
this increased also my stat counter.


Yes. Aborting the experiment via CTRL+Q will invoke the finish page, thus increasing the stat counter.


Regards,


~Dave


Erik
Erik
Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)
Group: Forum Members
Posts: 13, Visits: 5

thanks again!


I think it might be the necessity to download a ".exe" for the experiment that potentially scares many wary participants.


Do you have any reommendations for designing the starting page in order to emphasize the trusthfulness of the download/ experiment?


Regards,


Erik


Dave
Dave
Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)
Group: Administrators
Posts: 10K, Visits: 57K

I think it might be the necessity to download a ".exe" for the experiment that potentially scares many wary participants.


Well, unfortunately the magic pieces of code that make up Inquisit have to be delivered to the client computers somehow...:-)


Do you have any reommendations for designing the starting page in order to emphasize the trusthfulness of the download/ experiment?


For starters include your / your advisor's contact info, institutional affiliation, etc. for your potential participants so they can visit your site, email questions, learn more about the research before taking part, etc. Note that there is a growing body of literature dealing with both theoretical and practical aspects (such as maximizing participation / minimizing dropouts) of online research. You might start with "Dimensions of Internet Science" by Reips & Bosnjak (2001).


Regards,


~Dave


Erik
Erik
Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)
Group: Forum Members
Posts: 13, Visits: 5

thanks for the advice!


i just tried to incorporate computer.ipaddress.2, but get an error message  "/columns: 'computer.ipaddress.2' is not a valid setting."


<data >
 / columns = [date, time, computer.ipaddress.1,subject, blocknum, trialnum, blockcode, trialcode, pretrialpause, posttrialpause, windowcenter,
 trialduration, trialtimeout, blocktimeout, response, correct, latency, inwindow, stimulusnumber, stimulusitem, stimulusvpos, stimulushpos, stimulusonset,
 stimulusnumber, stimulusitem, computer.availablememory, computer.cpuspeed, display.width, display.height, build, computer.ipaddress.2 ]
</data>


Do you have any suggestions?


Regards,


Erik



Dave
Dave
Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)
Group: Administrators
Posts: 10K, Visits: 57K

i just tried to incorporate computer.ipaddress.2, but get an error message  "/columns: 'computer.ipaddress.2' is not a valid setting."


Apparently Inquisit will throw this error when the computer does not actually have a second device which could have an IP address assigned to it. Hmm, my personal opinion is that the script should run regardless and just record nothing for the non-existent interface. I'll file a bug for this.


~Dave


Erik
Erik
Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)Esteemed Member (1.8K reputation)
Group: Forum Members
Posts: 13, Visits: 5

Hi Dave,


in the actual Inquisit version 4.0.3 this error still occurs:


'computer.ipaddress.2' is not a valid setting.


Is there any solution possible?


Thanks!


Erik


Dave
Dave
Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)Supreme Being (829K reputation)
Group: Administrators
Posts: 10K, Visits: 57K

Erik,


computer.ipaddress.2 will only ever be valid *if* there is a 2nd active NIC device that has an IP address assigned.


GO

Merge Selected

Merge into selected topic...



Merge into merge target...



Merge into a specific topic ID...




Reading This Topic

Explore
Messages
Mentions
Search