Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

BF Hypothesis Testing Question

Hi,

I am writing for the first time a paper within the Bayes framework, and I feel rather comfortable now up to the level of Linear Regression. However, i do have a question regarding how to test the following hypothesis, and if i need to rephrase it.

H:  The negative relationship between X and A is stronger than the negative relationship between X and B.

(A, B being two dimensions of the same construct). As of now i have conducted Bayes correlations using JASP and the BF for XA is about 34 and the for BF for XB about 4. Would comparing the BFs suffice? or is there a "difference test" that i need to know about.

Moreover, I am conducting about 20 correlation tests at once (we are dealing with multiple characteristics), Do i have to worry about multiple testing, and should I specify this in the paper?

Greetings, from the Big Bang,

Georges Lemaitre

Comments

  • Hi George,

    1. About multiplicity: yes, I do think a correction is in order, unless you want to go fully subjective Bayes -- with carefully specified prior plausibilities for all hypotheses involved, there is no need for a correction. Some relevant references and remarks here: https://psyarxiv.com/s56mk
    2. If you want to test whether the correlation between X and A is larger then between X and B, you have two complications: (a) X features in both correlations, so they are not independent; (b) in order to address your question you need a test for the difference in correlation -- simply comparing the BFs is not correct, for the same reason that comparing p-values is not correct (http://www.ejwagenmakers.com/2011/NieuwenhuisEtAl2011.pdf)

    Cheers,

    E.J.

  • Hi E.J.,

    Thanks for the input, will do.

    Just another question, and i will go. What are good places to get feedback on our methods section? The issue at hand is that while NHST experts are everywhere (myself included), i am feeling quite uneasy jumping directly into peer-review with interpretations of Bayesian methods that I am only learning.

    Greetz,

    Georges

  • Hi Georges,

    Well you could post it here, or email some people for feedback.

    Cheers,

    E.J.

  • edited December 2019

    Good morning,

    thanks. What I will probably do, is post the preprint on PsyArXiv and link it here for the good people here to look over the methods... It'll take some time though :)

    Have a good day!

    Georges

    PS: Jasp has been godsent for all trying to learn about Bayesian inference. Even old dogs like me. I am very curious however about the reception it will have with the reviewers :) Especially in organizational psych, where bayesian methods are not really present :)


    PSS: having hypothesis stating the H0 is absolutely new and awesome to me ...

  • edited December 2019

    Hello George,

    I think the new R package BFpack can do what you are looking for, see section 2.2 in the preprint https://arxiv.org/abs/1911.07728v1

    If you are into R: I used this code to compare pairs of correlations:

    library(polycor) # install.packages("polycor")
    library(BFpack) # install.packages("BFpack")
    
    # compute some correlations using data from the package:
    cors <- hetcor(memory[memory$Group == "HC", -ncol(memory)])
    
    # check out correlations:
    cors$correlations
    
    # compute Bayes factor to compare two correlations that seem to be rather different
    BF(
     cors,
     hypothesis = "Del_with_Im = Fas_with_Del"
    )
    
    # compute Bayes factor to compare two correlations that are similar
    BF(
      cors,
      hypothesis = "Cat_with_Wmn = Fas_with_Wmn"
    )
    
    

    Note that the BFpack package does not return the Bayes factor, but posterior probabilities (based on prior odds specified using the prior argument; the default is 1:1), which I found quite odd, but well, you can compute the Bayes factor from the posterior probabilities.

    Note that my code does not come with any warranty, however. I checked out the package last week and only now tried to use it to compare correlations. You should definitely verify it; the documentation was not 100% clear to me.

    Cheers

    Martin

  • Hi Papi (lol)

    thank you for the code and insight, will run it the first thing tomorrow! Have a good evening...

    Cheers back!

    Georges

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games