Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

[open] test_suite

edited March 2013 in OpenSesame

Greetings.

I have a question regarding the test_suite script. If I understand it correctly, the first and last items test the visual and audio latency. But what exactly does the second item, maximum refresh rate, signal?

We're conducting an experiment where we are using several computers, which we've tested with this script. Most of them scored 250 or 333 hz, but some as low as 120 hz. How does this influence our experiment?

Best regards,

Jákup

Comments

  • edited 10:10AM

    I have a question regarding the test_suite script. (...) what exactly does the second item, maximum refresh rate, signal?

    Monitors have a fixed refresh rate, and you want the software to take this into account. For example, if your refresh rate is 100Hz you can never present more than 100 frames per a second. With some configurations (using the legacy backend mostly) OpenSesame may nevertheless claim to do so and report impossibly high framerates. In this case, higher is not better: It simply means that frames are being skipped. Bottom line: The maximum refresh rate should match the monitors refresh rate.

    For a good explanation, see also

    How does this influence our experiment?

    It does not necessarily mean that the timing of your stimulus presentation is off. It does, however, mean that it will be difficult to verify the timing afterwards, because the timestamps will not be perfectly reliable.

    In general, the test_suite.opensesame script is a bit outdated, and I should probably replace it by something better. This page contains a few newer test scripts that are specific to the new back-ends (the test_suite is from back when only the legacy back-end was available). If you want to test your system, I'd recommend using these scripts over the test_suite.

    Cheers!

  • edited 10:10AM

    Hello.
    Thank you very much for your reply :)

    I found the new timing scripts after the fact :) We'll retest the PCs using those scripts. I was also concerned by the up to 3 ms delay in sketchpad and synth timing, but we are using the legacy backend, so perhaps we can get it down to 1 ms across the board, by using PsychoPy or Expyriment.

    And thanks for the expyriment wiki article. But I'm still a bit confused about the frame rate issue. How important are these max rates, and what could be the influence on our experiment if we use setups with different frame rates?

    Best regards,

    Jákup

  • edited 10:10AM

    I was also concerned by the up to 3 ms delay in (...) synth timing

    The timing of sound is in general much less precise than that of display presentation. Unfortunately, it's also very difficult (impossible maybe) to know the actual timing of the sound playback without doing benchmarks with external hardware. Some guys from Swansea have done great testing on this, which you can read about here:

    How important are these max rates, and what could be the influence on our experiment if we use setups with different frame rates?

    The crucial thing is whether or not the software 'knows' when a display is actually presented on the screen. When you present a display with the legacy back-end, the timestamp that you get is the moment that the canvas.show() function is called. This is inaccurate, because there may be a small delay between the moment that you say show() and the moment that a new display appears, because a new display can only be shown when the monitor starts refreshing from the top (assuming that v-sync is enabled). So the maximum temporal error equals one refresh interval, which is 16.7ms on a typical 60Hz monitor.

    In contrast, psycho and xpyriment use a 'blocking flip'. This means that when you call canvas.show(), the program will block until the monitor starts refreshing from the top, and you get the timestamp of the exact moment at which the display is actually shown. For most purposes (such as games), this blocking is horribly inefficient, but for the purpose of experimenting it's usually what you want.

    Long story short: If OpenSesame reports a frame rate of 1000 fps, then it is clearly not using a blocking flip, because that many frames per second is physically impossible. And therefore, whether the maximum framerate matches the refresh rate is diagnostic for whether a blocking flip is used.

    Does that make sense?

    Practically speaking: The temporal error that we are talking about here does not affect your statistical power in any meaningful way, unless (maybe) you are doing things such as stimulus locked ERPs. So if you're doing a manual RT task, or something along those lines, don't spend too much time worrying about a 10ms jitter if you're using the legacy back-end!

  • edited 10:10AM

    Yeah ours is a regular RT task, using 75 participants in an hour long experiment. So, I guess it will not matter if some of these PCs are off in respects to each other, as the noise will be covered through randomization and statistical power.

    I find that I actually prefer legacy over xpyriment or psycho. It's a lot faster, and doesn't "show at the seems", as it were, in the way the other two do. And as the workstations we're going to use are rather slow and dumb terminals, I think the better running speed of legacy will be preferable to increased temporal measurements.

    Btw. where do I enable v-sync? Is a graphics card or OpenGL settting?

    And, again, thank you very much for your in-depth explanation. This really helped clear up my remaining confusion :)

    Best regards,

    Jákup

  • edited 10:10AM

    Btw. where do I enable v-sync? Is a graphics card or OpenGL settting?

    Some graphics cards have a dedicated configuration panel that allows you to enable/ disable this, but generally speaking v-sync is enabled. You can find out really easily, though. Just present screens of different color in rapid alternation (using a simple experiment) and look for horizontal 'tearing' of the display, i.e. lines that run horizontally through the display more or less at random. If you don't see those, v-sync is enabled.

    Cheers!

  • edited 10:10AM

    Which incidentally is just what the first sequence of the test_suite experiment does :)

    Thanks again man!

    Best regards,

    Jákup

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games