Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

Correction for Dependency - Meta-Analysis

Hey Everyone,


I couldn´t find it, and was thus wondering whether JASP allows me to correct for dependency when conducting a meta-analysis.


Best,


Max

Comments

  • Hi Max,

    I'll direct your question to our meta-analysis expert. Just for my own education: what exactly do you mean with "dependency"?

    Cheers, E.J.

  • Hey E.J.,

    Thank you for your help!

    I think I need to give a bit more concrete background:

    A recent paper found that there are many different techniques for data pre-processing (e.g. trimming/log-transformation) used in my subfield. The authors showed that those different pre-processing techniques had profound influence on whether one sample dataset showed "significant" effects, even when using more complex analyses such as Bayesian analyses or LLMs.

    I planned on re-analysing existing studies using each of those preprocessing techniques and then compare the mean effect sizes of each preprocessing pathway. That means, I have one effect size per pre-processing pathway, each of which is build on the same data (e.g. 4 effect sizes per study). So if I were to run a sub-group meta-analysis with the preprocessing pathway as group-factor, then the effect sizes in the study would not be independent of each other. Simply put, dependency here means that (some of) the effect sizes are based on the same studies.

    Thank you for your time!


    Best,


    Max

  • Hi Max,

    The meta-analysis module in the current version of Jasp does not yet allow for this. The next release probably will allow for what is sometimes called 'multivariate meta-analysis'. If you need to get to it right away, I recommend to have a look at the rma.mv() examples in the metafor package for R.

    Hope that helps!

    Best,

    Raoul

  • Dear Raoul,


    thank you for your response! Unfortunately, I did not work with R yet, but I will see if I have time to look into it. When is the next release scheduled?


    Thank you for your time!


    Best,


    Max

  • The next version is only weeks away

    Cheers,

    E.J.

  • There are several software packages used for clinical meta-analysis, including MetaFOR library for R, JASP, comprehensive meta-analysis, Revman, etc. But, these types of software packages are only adapted to basic science projects. For the analysis of large and complex datasets, these software packages may not be good. Recently, MATLAB R2016b software, introduced by MetaLab, is useful for various statistical analyses in meta-analysis.

  • Hi Nancysara_123,

    Please let us know on our GitHub page what meta-analysis features you'd like JASP to have! We aim to make students and researchers less dependent on commercial software. (for details see https://jasp-stats.org/2018/03/29/request-feature-report-bug-jasp/).

    Cheers,

    E.J.

  • Meta-analysis refers to the statistical synthesis of a variety of studies quantitative findings.  Dependence also occurs commonly when two treatment groups are included in the research design of a study compared with the same control group. Because each treatment / control comparison involves the same control group participants, the resulting effect sizes are statistically dependent. Failure to overcome or model dependency leads to artificially reduced variance estimates which in turn inflates Type I error. Treating dependent effect sizes as if they were independent often gives more weight to studies that have several measures or more than two classes in the meta-analysis. Statistical dependency must be overcome in such a way that modeling computational techniques to control dependency in order to avoid these challenges to the integrity of the meta-analytical findings or each study will contribute to the meta-analysis by a single independent effect size.

  • That's a good suggestion, I'll pass this along.

    Cheers,

    E.J.

  • Hi E.J. & Raoul,

    Can I double check that the current version of JASP includes multivariate meta-analysis rma.mv() from the metafor package?

    Thanks,

    Fotini

  • Hi Fotini,

    The current version does not yet include rma.mv() unfortunately. Hopefully it will in a near future release when time permits.

    Yet, I highly recommend to simply use R and the metafor package to run this more sophisticated analysis (and potentially discover the all the problems that can result fitting a multi-level model that make it harder to handle in a GUI).

    Best,

    Raoul

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games