Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

Meta-analysis output differs in Jasp compared to metafor (R)

Hello

Does anyone know why JASP and R have given me different output for the same meta-analysis?

For context, I attempted a meta-regression in Jasp after completing it in R using the metafor package. I uploaded my file to JASP after calculating effect size using the escalc function in metafor and then I plugged in the ES (yi) and SE (vi) values into the model.

The meta-regression coefficients seem similar, so I am not too worried about this. However, the heterogeneity estimates differ more substantially. Here are some examples:

I^2 in R: 36.82%; I^2 in JASP: 97.052%

Tau squared in R: 0.036; Tau squared in JASP: 0.097

H^2 in R: 1.58; H^2 in JASP: 33.927

I've been trying to find some more information about this online, but I can't seem to get anywhere. Can someone explain these differences? Since JASP is built using the metafor package, I assumed these would be the same.

Thank you in advance for your insights!

Comments

  • Before I bring this to the attention of our meta-analysis expert: have you executed the metafor analysis on the exact same ES and SE that were available to JASP? So if you take the csv that was analyzed by JASP, you read it into R, and you execute the metaphor package, do you still get different results?

    E.J.

  • Hi E.J.

    This is correct. The results differ even though I am using the same CSV file.

    I use the rma function in metafor

    Thank you for looking into this!

    Michelle

  • OK, thanks for looking into this. Strange. I'll contact our meta-analysis expert.

  • Any update on this?

  • Hi Michelle,

    Could it be that you don't convert the sampling variances (vi) into standard errors (SE) by taking a square root? Otherwise, do you have an example JASP file that illustrates the problem?

    Raoul

  • I have seen a similar apparent error in the JASP meta-analysis output. It is most clearly seen in the calculation of I^2.

    I^2 can be calculated simply as 100* ((Q - df)/Q). You can see in the attached screen shot that I^2 appears to be calculated incorrectly. The values shown below for Q (4.309) and df (3) are correct in the upper table (confirmed by manual calculation). Thus, the value of I^2 should be 30.37%, but it is quite different in the lower table (2.421e -4).

    Is this an error in JASP, or have I missed something (more likely...)?

    Thanks.


  • @rick_m Your formula is correct if you use the DerSimonian-Laird estimator (which is *not* the default). See the plot below. I have not checked wether the calculation of I² is correct for the other options, but I have checked whether it is the same output as from the metafor package, and at least for my example that is indeed the case.

    Hope that helps.


  • Raoul,

    Thanks for this helpful explanation!

    Rick

  • Raoul,

    Just to clarify, I had used the default Restricted ML method when I got the results table I posted. Does this mean that when using the Restricted ML method, I² ≠ 100* ((Q - df)/Q)?

    Thanks

  • Rick,

    Indeed it does. I don't know exactly how I² is calculated when REML is used. A good place to find more information is: http://www.metafor-project.org/doku.php

    Raoul

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games