Transferring data from a participant to JATOS server
I have a question about JATOS and data transferring. I might have missed the information somewhere else, but I am not really sure what I’m looking at. I am currently planning to run a self-paced reading experiment using the script from the end of this thread (https://forum.cogsci.nl/discussion/1235/solved-self-paced-reading-task). Due to the nature of the task, the size of the dataset per participant is quite large (about 9.2 MB in JSON format). I have managed to figure out the 5 MB restriction on data per one study run and have increased it (by following these instructions https://forum.cogsci.nl/discussion/6390/file-sizes-too-large).
However, the data transfer is still unusually long for 10 MB. I have tested the data transfer on multiple upload speeds (4 Mbps – 68 s, 19 Mbps – 32 s, 93 Mbps – 21 s). Of course, the speed varied, but for practical reasons, 20 seconds on a high-speed connection is not ideal, since I assume most of my participants are more likely closer to internet speeds that require up to a minute for data transfer. In that case, I cannot rely on them to leave the window open and wait for the end of the transfer. Additionally, it leaves a larger risk of interrupting the connection and data being lost. I am running this on Digital Ocean droplet (8 GB / 4 AMD CPUs; 160 GB NVMe SSDs; 5 TB transfer).
Finally, my question is: is the slow data transfer due to some other restriction on JATOS I can’t manage to detect, or is it simply due to the connection and the size of the data? Do you have some advice on how to handle this issue? I am attaching the OS study files and some of the JSON data I obtained during this testing through this link: https://drive.google.com/drive/folders/1gITLlTmEEIavSgJ_b8Ya9jxUYB4CG_dE?usp=sharing
Thanks in advance!