Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

Correction for multiple testing of post hoc Bayesian t-tests

Dear JASPER’s,

I have a question regarding correction for multiple testing of post hoc Bayesian t-tests, e.g., in a Bayesian RM-ANOVA:

The output in JASP provides tables of Post Hoc Tests, including values for the Prior Odds, Posterior Odds, BF10,U, and error%. While the Posterior Odds are corrected for multiple testing (following Westfall et al., 1997), the BF is uncorrected as indicated by U. However, am I right to calculate a corrected BF by dividing the (corrected) Posterior Odds by the Prior odds? For instance, I have a Prior Odd of 0.320, and a Posterior Odd of 368.130 and a BF10,U of 1152.177 provided in JASP; calculating a corrected BF10 (by dividing 368.130/0.320) will result in a BF10 of  1.150,406. The new BF10 is slightly lower, but is that a proper way to correct the BF for multiple testing?

Is that right, and can we say than that the BF10 is corrected for multiple testing?

 

I appreciate any help you can provide.

Best

Nils    

Comments

  • Hi Nils,

    It is conceptually cleaner to say that the BF is just the BF -- for an assessment of the evidence does not matter how many hypotheses you are testing. But if you were testing many hypotheses, in a haphazard fashion, this usually indicates that each test by itself involves a low probability H1. So the Bayesian adjustment for multiple testing is to lower the prior odds. This in turn affects the posterior odds, but the change from prior to posterior odds (i.e., the BF) is independent of the number of other hypotheses that are tested.

    Cheers,

    E.J.

  • Hi E.J.,

    Thanks for your quick reply. Okay, so it is fine to report the provided BF, U in the table of post-hoc t-tests, e.g., to disentangle an interaction effect of a RM-ANOVA with multiple (let's say three) groups?

    Best

    Nils

  • Well, if you would just report BF_U you would ignore the post-hoc character of the test. So I would report the BF_U but also the posterior probabilities (which are corrected for the post-hoc nature of the test)

  • Well, yes, that is also a fine recommendation. Maybe that can be inserted in the preprint of van Doorn et al.The JASP Guidelines for Conducting and Reporting a Bayesian Analysis.

    How would you abbreviate or label the posterior odds in a manuscript (to be readerfriendly 😉)?

    Thanks and best

    Nils

  • Lindley (1985) uses the zero, so "0", but a lower-case "o" seems to be more common (https://en.wikipedia.org/wiki/Odds)

  • Okay, many thanks E.J.!

    Best

    Nils

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games