JATOS & Mturk: A problem occurred: JATOS isn't allowed to run a study with the study result ID
in JATOS
Hi, all,
Here is my question. When i click the link on Mturk worker sandbox to the experiment hosted on JATOS, this warning message appears:
A problem occurred:
JATOS isn't allowed to run a study with the study result ID ****
I designed this experiment on OpenSesame and uploaded it to JATOS server, then I connect this experiment with Mturk requester sandbox. This experiment works fine in JATOS. This experiment is a segment-by-segment sentence reading experiment.
Can you help me understand what might go wrong? Is there a way to fix it?
Thank you!
Felix
Comments
Hi Felix,
We already answered the question on the google group. Did enabling the worker type help?
Other than that, I had another thought:
Where exactly are you clicking the button on the worker sandbox? This is confusing in MTurk, but you can't actually follow the link that you see on the preview. In order to actually test the HIT and study that you created on the *Requester* sandbox, you'll have to create an additional Worker sandbox on MTurk, look for your study in the table (you can search for a keyword) and run it as if you were a participant.
Elisa
Hi, Elisa,
Thank you for you reply.
I did what you described in your reply. I posted the study containing the link to the experiment (hosted on JATOS) on the requester sandbox. Then I retrieved this study in the Worker sandbox after logging in as worker. I clicked the link, then the warning message appeared. Also, I did enable Mturk worker as the worker type for my study on JATOS.
Hope this clarifies my question. Thank you!
Felix
Hi Felix,
That's strange. Are you running your experiment on experiments.jatos.org? If yes, can you please add me as a user of your study (only if there are no sensitive data already collected)? Then I can have a look and try it out myself with MTurk.
Best,
Kristian
Hi, Kristian,
Thank you!
Sure, that will be great. I am using the experiments.jatos.org for my experiment. Could you please let me know how to add you as a user? Do I send you a link?
BTW, the experiment is the one that I use for testing purposes, so the content may not make sense.
Best,
Felix
Ah, sorry, my user is lange.kristian@gmail.com :)
... and to add a user to an experiment you have to do: go to your study's page -> More -> Change Users -> add lange.kristian@gmail.com into the field 'Add user by username'.
Hi, Kristian,
I have just added you as the user for my experiment.
Thank you.
Felix
Hi Felix,
I just tried it out with MTurk Sandbox and it worked. Try it yourself: https://workersandbox.mturk.com/?filters%5Bsearch_term%5D=kristian&page_size=20&page_number=1&sort=num_hits_desc&filters%5Bmin_reward%5D=0
I did nothing extraordinary just created a new Survey in MTurk and copy/paste the source code like it is described in http://www.jatos.org/Connect-to-Mechanical-Turk.html.
Best,
Kristian
Hi, Kristian,
Thank you!
I tried it out by clicking the link you provided. The same message appears again. I am getting really confused now. Is it because I log in the Worker sandbox with the same email as the Requester sandbox? So the Mturk does not recognize me as a worker in the Worker sandbox?
Best,
Felix
Hi Felix,
That is strange indeed. I just tried too, like you said, same email for Worker Sandbox and Requester Sandbox, and it worked fine like before. You can try it too: https://workersandbox.mturk.com/requesters/A3ER60IEU77H9M/projects?ref=w_pl_prvw. I had to use a different study because your had no more components.
Also this error is strange 'JATOS isn't allowed to run a study with the study result ID ****'. It has nothing to do with how JATOS handles MTurk workers. This is an JATOS error message that happens when someone or something alters the study result ID so that JATOS can't find it in its database anymore. The study result ID is passed on from component to the next by the 'srid' parameter at the end of URLs, e.g. in https://experiments.jatos.org/publix/1/1/start?srid=12345 the study result ID is 12345. Do you have an idea what might alter the 'srid' parameter?
Best,
Kristian
Hi, Kristian,
A piece of good news! The study on Mturk works fine this time after I switched from Safari to Chrome. No more error message. Does it mean my study doesn't work on Safari browsers? If I post this study to the Workers, will those using the Safari browser be able to accept the HIT and do the study?
Is there anything that I can do?
Thank you!
Felix
Interesting. It would be strange that Safari somehow alters the URL query parameters. But I'll test it: I do not have a Safari browser at hand right now but I'll test it this evening on another laptop at home and come back to you.
Kristian
Hi Felix,
I checked with Safari and had the same error as you: JATOS isn't allowed to run a study with the study result ID ****. Then I tested it on Chrome and Firefox and it worked. Then I tested with different worker types, Personal Multiple and General Single with Safari and it worked. So this error only happens with workers from MTurk and Safari. This is strange and I have no explanation for it right now. I expect that all browsers send the same HTTP requests, but somehow there must be a difference in the one Safari sends that lets JATOS throw this error. I have to do some debugging. In the meantime you can try to exclude MTurk workers that use Safari.
Best,
Kristian
Hi, Kristian,
Thank you very much! It is good that we get to know more about this problem. Could you point out what I should do to exclude Mturk workers that use Safari? Do I specify this in the instructions? or does this need to be configured on the JATOS?
Best,
Felix
You would have to specify this in the instructions, there is no way to configure this in JATOS. And it's better to put this in the early instructions in MTurk that appear before the worker accepts the HIT.
Hi, Kristian,
Thank you very much!
Best,
Felix
Wrote an issue: https://github.com/JATOS/JATOS/issues/208
Hi Felix!
I fixed the issue. More about the reason you can find in the Github issue: https://github.com/JATOS/JATOS/issues/208.
The new version (v3.5.8) is still in pre-release but I installed it already on cortex.jatos.org for you to try out. I tried with MTurk and Safari and it worked for me, but I would appreciate it if you could test it too.
Best,
Kristian
Hi, Kristian,
Sorry for the late reply. Just came back from holiday.
Thank you for this great news! I just tried it and it worked great. Are you also going to update this on the experiment server soon? Looking forward to it.
Best,
Felix
Nice to hear it works now. I intend to update experiments.jatos.org soon, just waiting for some quiet time when nobody's using the server, probably this weekend is a good point.
Best,
Kristian