Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

[solved] Huge Size of the Log File

edited December 2020 in OSWeb

Hello everyone,

I am currently running an experiment on JATOS (which was built on OSWeb) and I didn't write any JATOS command in the experiment to change the data transfer like jatos.appendResults or similar. Size of the experiment is around 6 mb and no file is attached to the results. When I download the log files in .txt format, they are around 26 mb each. However, it becomes 6 mb when I convert them by using OSWeb GUI. Do you have any idea why it is so large? I couldn't be sure if I did something wrong.

Best,

Jonah

Comments

  • Hi Jonah,

    By default, all variables are logged on each trial (or on each call to the logger item, strictly speaking), and that can add up, especially if you have many trials with variables that contain long strings or Array objects. To see what causes the large files in your case specifically you'd have to manually inspect the log files. The reason that the file size decreases when you convert it with the OSWeb GUI is simply that the csv format is more efficient than the original format, which is json .

    But it doesn't sound like you're doing anything wrong, although it might have been better to selectively log a few variables instead of all of them!

    — Sebastiaan

  • Hi @sebastiaan ,

    I was thinking about the same thing, thanks a lot for your answer!

    Best,

    Jonah

Sign In or Register to comment.