Post-hoc corrections in Bayesian RM ANOVA

Comments

• TarandeepKang

  August 25

  Hi @AnnaPsy

  I will preface this by saying I'm not an expert in Bayesian statistics, especially what I would consider complex linear models such as this. However, I do think I can help you with this one so I shall do my best!Scroll down to the post hoc test panel under Bayesian repeated measures ANOVA and open it. Then drag in your variable interest (group?) To the right-hand side. Recall that in the ordinary Frquentist ANOVA the follow-up tests are essentially the required number of t-tests and then we apply some correction, depending on how conservative we are feeling about false-positive rates, taking into consideration power, et cetera.

  
  

  There exists no post hoc test for the Bayesian formulation of the Anova. However what we can do is follow Westfall, P. H. (1997). Multiple testing of general contrasts using logical constraints and correlations. Journal of the American Statistical Association, 92(437), 299–306.) which Is what is suggested in Section 6 of

  van den Bergh, D., van Doorn, J., Marsman, M., Draws, T., van Kesteren, E.-J., Derks, K., Dablander, F., Gronau, Q. F., Kucharský, Š., Gupta, A. R. K. N., Sarafoglou, A., Voelkel, J. G., Stefan, A., Ly, A., Hinne, M., Matzke, D., & Wagenmakers, E.-J. (2020). A tutorial on conducting and interpreting a Bayesian ANOVA in JASP. L'Année Psychologique, 120(1), 73–96. https://doi.org/10.3917/anpsy1.201.0073

  You will then find adjusted posterior odds as described in the tutorial paper. This is the extent of post hoc testing that is currently possible, I think. I think the author team who are also the JASP developers do a good job of laying out the maths there in that section. Regardless, I will be happy to help you further if you need?

  Best,

  Tarandeep

  
  

  NB, I don't know if you have found the analysis help file that is available in the software, you can activate it by clicking the little i? There is some stuff on this topic in there also.