Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

Am I making violations through the use of this test?

It's my first time using JASP as well as Bayesian statistics, so excuse my lack of knowledge. I am trying to figure out whether method A or method B is faster for finding a certain target in a scene. If one of the two methods is indeed faster than the other, I also want to see if this relationship where A is faster than B (or vice-versa) increases as a result of the rarity of target presented (there are 100 possible targets in my data, and each has a different percent chance for showing up in any given scene a person encounters). In other words, figure out whether the methods are different, and whether there is an interaction with target rarity.

There are many limitations in the data I have collected, though. Participants are free to repeat the search task as many times as they want (practice effects are not a concern). Thus, some participants have only a single trial (trial representing a single search for a target in a scene), and others may have hundreds. Participants are also free to use either method A or B as they choose. So some people have data whereby they have only ever used one of the two methods. For those that use both methods, people tend to prefer method B far more often than method A, thus I have different amounts of data for each method. And of course, not every participant has encountered every possible target (as some are very very rare to occur). The one good thing is that I have hundreds of thousands of participants collected for data. Should I be removing participants who have only used one of the two methods, and is it a problem that participants have contributed unequal amounts of data for each method? (Just as an example, participant X may have 20 total trials, 19 of which used method B, and they encountered 10 of the 100 possible targets.) Given all the uncertainty in the data, I was told to try using Bayesian methods.

Can someone point out what analysis I should be using to investigate these issues without falling into traps such as unequal variance and missing data? Is Bayesian Correlation Pairs a statistically sound way to investigate method A vs. method B? And how do I also use JASP to investigate an interaction?

Thanks very much for any help.

Comments

  • Hi Paul,

    This sounds like a fantastic data set. In, say, Bayesian ANOVA it is not an issue if you have more participants in condition A than in condition B, but when we take the mean of the participants then it is an issue that some means are based on more data (and hence are more reliable) than other means. I think this analysis is best done using a Bayesian framework (of course :-)) but it seems to me that a flexible program like JAGS or Stan is more suited to the job. This would probably require you to contact and collaborate with a Bayesian statistician or methodologist. Another piece of advice: do not spoil this data set by looking at it and constructing hypotheses on the basis of all of the data. You have hundreds of thousands of participants, and I urge you to split the data set in two: the first half you just analyze as you would normally, but then you still have the hold-out sample for a confirmatory check.

    Cheers,
    E.J.

  • That does sound pretty awesome. Is this data from Airport Scanner by any chance? I saw a talk about that game a while ago (at VSS maybe, I'm not sure).

    Buy Me A Coffee

  • edited January 2017

    @EJ Thanks for the information! I really should be taking it upon myself to be learning Bayesian statistics in depth it seems. Or find someone who knows more than me who would like to collaborate.

    @sebastiaan Wow, it is actually. Nice guess!

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games