Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

Jatos, experiment won't reload because of "finished study", data not saved

Hi there,

I'm new to Jatos and I have a problem with an experiment I hope you can help me with. The experiment in question is a remote follow-up to a in-person experiment. After participants are done with the in-person experiment, I send a "general multiple, open directly" link to their e-mails. I picked that type of link out of a mix of habit (the platform I used before, cognition.run, only had the option of a general link for everyone) and laziness (I didn't want to generate and send a different link and code to every participant). However, a couple of issues have emerged which I can't figure out.

The first is that sometimes the experiment won't reload because "the study is finished". Specifically, the message is "It's not allowed to reload this component (ID: 21961). Study (ID: 14167) is finished." Note that the two IDs are always the same (even when using different browsers, computers, and networks). However, the person getting this message hasn't actually finished the study. Also, I don't get why the problem then seems to go away by itself (e.g., if I try again at a later time, the study loads with no issues).

The second problem is that for one of my participants, the data were not saved, i.e., in Jatos' results page, there is no finished study for her. That would not be a problem by itself (I know that is a possibility because of network issues) but a few things seem off: First, I'm positive that the participant completed the study as she screenshotted the end of study page. Therefore, her network must have been able to redirect her to that page, but shouldn't Jatos save the data before doing that? Second, for her as well, I have that weird not-reloading issue in the Jatos results, i.e., her study is marked as FAIL with that "study finished" message. But how could she finish the study if she got that message? Finally, for her (as well as for other participants), I have a number of Result IDs instead of just one, as if she reloaded the page a few times before getting started. Not impossible that she did do that, but I thought I should mention it.


What am I missing? I'm getting the sense that I'd be better off using personal and/or single links rather than general multiple links, however, I'd like to understand what's happening here in case it's something else. I'm using Jatos 3.8.5 and jspsych 7.3.4, i.e., the latest versions. Let me know if you need further information. Thank you in advance for your help.


Best,

Giacomo

Comments

  • krikri
    edited May 16

    Hi Giacomo,

    I took some time to answer your long question :)

    Maybe there is a general misunderstanding of how JATOS handles study runs: First you have a study link (e.g. https://example.com/publix/OZTF4BqnlWd), in your case it is of type general multiple and that means you can use this link as often as you want. Then, each time you use this link, JATOS starts a new study run (with a new study result: each line in your result page represents a study result) and redirects the participants to a different type of URL (they are much longer, e.g. https://example.com/publix/4c93ba3f-eda7-45e7-9db0-200e370dc196/15287b49-d9e1-4d20-85c8-a412c9ac2075/start). Often a JATOS study consists of multiple components - then each component has its own component run URL. Those study run URLs are not "general multiple" any more, that means, they have the normal constraints of a study run, like the other study link types (personal single, personal multiple, ...). E.g. if your component is not allowed to reload, a reload in the browser will cause JATOS to end the study with a state FAIL. Or if your study is linear, you cannot loop back to a previous component.

    In your case you seem to have forbidden the reloading of a component (which is often what you want) and your participant reloaded the page (for whatever reason, e.g. errors in the experiment, network problems). Then the study run got finished with a FAIL. Each consecutive reload just returned an error page from JATOS. Then your participant used the original study link again (a general multiple) and started a new study run with a new study result. That worked.

    And to answer some of your questions:

    The first is that sometimes the experiment won't reload because "the study is finished". Specifically, the message is "It's not allowed to reload this component (ID: 21961). Study (ID: 14167) is finished."

    Your component is not allowed to be reloaded. Once it does, it ends with FAIL.

    Note that the two IDs are always the same (even when using different browsers, computers, and networks).

    The IDs belong to the general multiple study link.

    Also, I don't get why the problem then seems to go away by itself (e.g., if I try again at a later time, the study loads with no issues).

    I'm sure the person, at a later time, uses the original general multiple study link again - while before it just pressed reload in the browser.

    I'm not sure I actually helped you with your issues, but I hope I could help you understanding it.

    Best,

    Kristian


    Edit: Spelling

  • Hi Kristian,

    thank you very much for your reply. You did help, thank you, and I am now beginning to see what might have happened. All in all, I think it would be safer to use personal, single-use links in order to have a bit more control on what the participant does. There's still the question of why the data for the run the participant did finish were lost even if the participant reached the end of study component. More specifically, I'd like to understand if there's something I can do to moving forward to prevent that from happening again (it's hard to get participants for this study and I wouldn't want to lose too much data). Thanks again for your help!


    Best,

    Giacomo

  • There's still the question of why the data for the run the participant did finish were lost even if the participant reached the end of study component. More specifically, I'd like to understand if there's something I can do to moving forward to prevent that from happening again (it's hard to get participants for this study and I wouldn't want to lose too much data).

    First, JATOS goes to quite some length to ensure that the sent result data reach the JATOS server. Importantly, it has a background worker (called httpLoop) running in the browser of your participants that handles all sending of result data (and other stuff) to the JATOS server. This httpLoop ensures that the order of the result data is kept (in case you sent data several times: 1 - 2 - 3 stays 1 - 2 - 3), then it automatically retries the sending if, for whatever reason, it failed (it retries up to 5 times). And finally it ensures that the study only ends or goes to the next component when all data are sent. So, it should never happen if you use JATOS (and jatos.js) correctly and there is no Internet issue that a study FINISHED and data get lost. That said, people can use jatos.js' control flow functions or functions to send data/files wrong. Can you post here the part of your code where you send your data and finish your study / go the next component? I can have a look.

    Best,

    K.

  • Hi again Kristian,

    sorry for the hiatus and thanks again for your help. I honestly didn't look at those pages because I just used, with minimal customization, the code reported on this page for integrating jspsych and jatos. Specifically, in the <head> element I included the following:

    <script src="jatos.js"></script>

    Then at the very beginning of the script element, the following:

    var jsPsych = initJsPsych({

       use_webaudio: false,

       on_finish: () => jatos.endStudy(jsPsych.data.get().json())

      });

    And finally at the very end of the script element (after all of the jspsych timeline variable has been defined), the following:

      jatos.onLoad(() => {

       jsPsych.run(timeline);

      });

    What do you think? Thanks!


    Best,

    Giacomo

  • Hi Giacomo,

    Sorry, for taking some time to answer. Your code looks good. It's the standard jatos-wrapping around a jsPsych experiment.

    Another thing that comes to my mind: what is the size of your result data? There is a quota of 5 MB per result data sending and if you exceed this the JATOS server will not store the data in its database.

    Best,

    Kristian

  • Hi Kristian,

    you mean the text file (the one you get from data only, plain text)? That's around 120 KB per participant.


    Best,

    Giacomo

  • 120kB is far from problematic. So, I am out of ideas, apart from problems with the participant's network or computer, or your study's code.

    K.

  • Hi Kristian,

    that's OK, thanks for all the help!


    Best,

    Giacomo

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games