Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

Bayesian one sample t-test versus Wilcoxon signed-rank: completely different result in JASP?

Hello,

I want to compare my data sample to an established value and I've been using a Bayesian one sample t-test in JASP 0.13.1 to do so. However, one of my data samples violates the normality assumption so I switched to the Wilcoxon signed-rank within the same feature in JASP. I noticed that the results are completely different! E.g., one sample has a mean of 63.9 (SE 1.6) and the t-test gives me a BF+0 of 2.9e+6 when comparing this with 50, strongly indicating that my sample deviates from 50. However, switching to the Wilcoxon with the same sample results in a BF+0 of 0.270 indicating no difference from 50 which seems very strange to me.

Could this be a bug? Doing the non Bayesian Wilcoxon also gives me a highly significant difference from 50.

Best,

Max

Comments

  • Hi Max,

    Could you rerun this with the last version of JASP (0.14)? I changed the underlying sampling algorithm, since it had a bug that would sometimes lead to very conservative results, just like you are describing. If you still have this issue please let me know!

    Cheers

    Johnny

  • Hey,

    Thanks for your fast reply! Unfortunately, I still have the same issue after updating.

    Best,

    Max

  • Hi Max,

    I just looked, and the BF's I get for the one-sample Wilcoxon tests seem to be in line with the frequentist and parametric results. Would you comfortable sharing your data set with me? That way I can take a closer look. You can also send it by email to j.b.vandoorn <at> uva.nl

    Kind regards,

    Johnny

  • Sure,

    my minimal example is the attached data set. I have done a Classical as well as Bayesian one sample t-test and Wilcoxon testing a significant larger value than 50. All but the Bayesian Wilcoxon are significant.


  • I think it is because you do the one-sided test, and the sidedness changes from regular t-test to Wilcoxon. You can see this when you do the two-sided test first; for the Wilcoxon, most mass is on the negative values. So you should compute BF-0 for the Wilcoxon. Johnny, this strikes me as suboptimal?

    E.J.

  • Yes, something is wrong, I fixed it now. The test value was not considered correctly for the one sample wilcoxon...

  • Okay, will this then be in another release or should I take the BF-0 like EJ is suggesting?

    Thanks for your help!

  • The next release is a bug-fix release, due out in a few weeks. But if you want to proceed right now you can just take BF-0 for the Wilcoxon: that will give you the right result.

  • Hi Max,

    I fixed it and ran the correct code, see below!


  • I also have other comparisons for which I would like to run the Wilcoxon and the BF-0 still gives me quite different results. Is there a way to get the correctly working version for my PC? My email is 10maxgold (at) gmail.com



  • Reporting BF-0 solved the earlier issue. The new release will fix the labeling error, but you now have a way to get to the right number. If I understand correctly, you now report a new issue, which is that there are still "quite different results". Can you give an example?

  • @EJ we resolved the issue over email, the issue was not the flipping, but that the test value was not taken into account (and just set to 0). The nightlies should already contain the fix, and Joris informed me that the windows nightly will be working from tomorrow on.

  • Ahhh my bad, good to know it's fixed

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games