Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

RM ANOVA - extrem diverging main effects - interpretation of the interaction effect

Hello!
I have a question regarding a conducted repeated measures ANOVA.
My first factor 1 has extrem evidence for H1 (BF10 > 7.000e+19) and my second factor 2 has moderate evidence for H0 (BF10 = 0.147). BFinclusion for the interaction factor1*factor2 = 0.145.
Is the low interaction BF in this case probably misleading because of the high factor1 and the low factor2?
How should I interpret the interaction effect? Is it right when I just say that the interaction effect shows moderate evidence for H0, i.e. that no interaction exists?

Thank you very much!
Best,
Markus

Comments

  • Hi Markus,

    In JASP we use the marginality principle, which means that when an interaction is present, so are the constituent main effects. The most straightforward test is to compare the full model against the model with only the main effects. When one or both main effects do not receive a lot of support, you can wonder whether this is the right comparison, and the inclusion probability may make more sense. In your case, both will probably point to H0, so yeah, I think you have some evidence in favor of H0.

    Cheers,
    E.J.

  • Great, thank you very much E.J.!
    Best,
    Markus

  • Hi,
    I have a problem that I can not handle. I found a significant interaction effect (p < .02) based on classical repeated measures ANOVA analysis but I got a insensitive BFinclusion = 1.6 result based on Bayes analysis. Now my biggest problem is
    how I should handle this in a paper. When I would publish the results without the BFs everything would be fine, but no I have to find the right words when I include the BFs. Because now a reviewer could possible say that my study was not designed well enough to find the effect and rejects the paper.

    Another problem here is that I can not explain what the prior in the repeated measures ANOVA really means (r scale fixed effect of: 0.5; r scale random effects: 1; and r scale covariates: 0.354).

    Thanks for any advice or help!
    Best,
    Markus

  • I was a bit caught up and did not respond too quickly. I have now responded to a similar question you just asked. Sorry about my tardiness. I try to answer quickly but sometimes diapers and deadlines get in the way.
    Cheers,
    E.J.

  • Hi,

    I saw the discussion and I thought to join in.

    I am new to Bayesian analysis and I would like to have a feedback on the Bayesian ANOVA I have just run (see attached image). I am interested in assessing the evidence for the model that includes the interaction term. The model with the interaction Time * Group has a BF10 = 2.120e+7 whereas the model with the two main effects Time + Group has a BF10 = 639811.912. It is my understanding that the comparison of the model with the interaction and the model with the two main effects can be achieved with a simple division (due to transitivity): BF10 Interaction / BF10 main effects (i.e., 2.120e+7/639811.912 = 33). The BF = 33 suggests a strong evidence in favour of the model with interaction. Am I right?

    Thanks in advance for any help.

    Francesco

  • Hi Francesco,
    Completely correct!
    E.J.

  • Hi EJ,

    thanks for the immediate reply.

    We have analysed the performance of two small clinical groups (6 training vs 6 controls) across nine time points. Again, it is my understanding that Bayesian approach is more appropriate with small sample sizes as long as the priors (we used the default in JASP) are reasonable (with large large samples likelihood tends to dominate whereas priors may have a stronger influence with small sample sizes). Now, I am planning to run a series of Bayesian t-tests (still in JASP) in order to obtain a BF for each comparison (training vs. control for each time point). I would also double check the results using the BEST package to obtain a posterior distribution of the difference between groups' means.

    However, the Editor that handles this paper asked us to run a classic mixed ANOVA (Ws:Time; Bs: Group) with bootstrapping along with non-parametric analysis (Mann-Whitney) for the post-hoc comparisons. Is there any motivation to use Bayesian analysis over NHST in case of small sample sizes, or would it be better in this case to not use Bayesian analysis?

    Thanks in advance

    Best wishes

    Francesco

  • Hi Francesco,

    It is always a good idea to use Bayesian inference. But at the very least you can argue that the two paradigms are complementary, and it is counterproductive to ignore the Bayesian outcomes. So my advice is to heed the editor's advice, but report both.

    Cheers,
    E.J.

  • Is the result of Francesco's division (BF10 = 33) strong evidence of a pure interaction effect? It seems to me to state only that a model including the interaction term is more strongly supported than one without it.

  • Hi peterose1,

    JASP does not allow "pure" interaction effects (meaning without the constituent main effects). This is the principle of marginality, discussed in part II available at https://osf.io/ahhdr/

    Cheers,
    E.J.

  • Thank you. I am downloading he paper now. But meanwhile, I conclude my other interpretation is correct: "a model including the interaction term is more strongly supported than one without it." Yes?
    (I am BoomChicago dad.)

  • Yes, that's correct.

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games