Avatar

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

JohnnyB

About

Username
JohnnyB
Joined
Visits
65
Last Active
Roles
Member
Thanked
12

Comments

  • Hi Cames, For the nonparametric ANOVA, when specifying a grouping factor, it needs to be at least an incomplete balanced design in order to run the Friedman or Durbin test. Such a design has the following properties (see https://en.wikipedia.org/wik…
  • Hi rhlamber, From a quick look at the tables you included in your document, it seems that SPSS is performing fewer post hoc comparisons - it does not compare the different levels of group (sedentary vs exercised), whereas JASP does. This means that …
  • Hi Cesar, The Maxwell reference is central here and can be found at: https://journals.sagepub.com/doi/abs/10.3102/10769986005003269 And the Andy Field reference is his statistics text book "Discovering Statistics using SPSS". If these are …
  • Hi gvleioras, What sort of effect sizes would you like to see? I assume that these are a bit more straightforward to implement than power analysis (which is a bigger project we will probably tackle more generally in the future). Cheers, Johnny
  • Hi Herve, Dunn's post hoc test is still in the ANOVA - see the checkbox under "Post hoc tests" Cheers Johnny
  • Hi Ajestudillo, The BF10/BF01 compares all models to the best performing model (this is a setting you can change to "compare to null model"). This means that the best performing model is at the top of your table - in this case the model wi…
  • Hi Shem, I think this is possible to do with the "compute columns" functionality. There is an informative blogpost here: https://jasp-stats.org/2018/12/18/how-to-compute-columns-in-jasp/ This will probably not correct your p-values for mul…
  • Hi Mark, Yes, the R-code and research are there. I am currently waiting for a rewrite of the analysis, but after that is done, I will implement the analysis! For now there is R-code available at https://osf.io/gny35/ and the paper is available at ht…
  • Hi RBJ, You can try tweaking the number of samples used for MCMC. This option is under the 'advanced' menu. I would suggest using the default setting when you actually want to report your results though, as decreasing the number of samples typically…
  • Hi Elise, The R-code can be found on the OSF page of the corresponding article (under review atm). https://osf.io/ctv8a/ You give it the observations from the two groups (first two arguments of the function), then take the vector of 'deltaSamples' …
  • Hi Majan, What JASP reports for the Mann-Whitney test is the W statistic which is calculated by summing the ranks for one of the groups. In other words, when pooling the observations from both groups, and then assigning ranks, the W statistic is the…
  • Hi Vicente, The Durbin test is only suitable for balanced designs (see Wikipedia https://en.wikipedia.org/wiki/Durbin_test ). I am not entirely sure why this is, but I can sort this out next week if needed. As for the the post-hoc tests, the between…
  • Hi HMSTAT, The p is the p-value for the chi square statistic, whereas the pF is the p-value for the F statistic in the table. Cheers, Johnny
  • Hi Darren, Apologies for the delay in answering. The Bayesian implementation is based on the test statistic (tau) and it's asymptotic distribution. In the article we only speak about the version without ties. However, even with ties present, this me…
  • Hi Dendrite, There will be posthoc tests for interactions in the next JASP release (0.9.3) which will be released in a couple of weeks. The release after that one will have contrasts for interactions. For now, in 0.9.2, contrasts and posthoc tests …
  • Hi HMSTAT, To calculate the p-value, JASP uses the ptukey function from R (see also here: https://rpubs.com/aaronsc32/games-howell-test). It seems that for most groups, the df is very low due to only 2 observations per group, which breaks the ptukey…
  • Hi Dendrite, Yes, this is a known issue and we are working on it - it should be fixed in the next release (0.9.3) Cheers, Johnny
  • Hi Gabriel, We use the approach I outlined in my previous post - you can read more about it here. I am not sure what JAMOVI uses - maybe you can contact them on their github page. One thing that could cause a discrepancy is that different types of…
  • Hi Aaron, A gif to illustrate this procedure can be found here: https://jasp-stats.org/wp-content/uploads/2018/02/assumptionchecks_rep_meas.gif An overview of our tutorials (blog posts, gifs, youtube videos) can be found here: https://jasp-stats.org…
  • Hi mdlee, There are two ways to go about this: In the RM ANOVA menu, you can click on the tab "additional options" and tick the box labeled "Descriptive statistics" - this will give you a table with the means for each cell of eac…
  • Hi Pedro, To follow up on my tweet, here is an excerpt of an article we are currently working on (about the Bayesian version of the various nonparametric t-tests, found here https://arxiv.org/abs/1712.06941): "An often used standardized effect …
  • Hi Peterose1, If you want to conduct the two-sample test, this is readily available in JASP. I am still in the process of implementing the one-sample versions - if you want I can link you some R-code that gives you a Bayes factor and posterior distr…
  • Hi mrvallejo, The normality assumption of the ANOVA concerns the distribution of the residuals, not the raw data itself. Because the residuals are the differences between the observed dependent variable and the predicted dependent variable, we can s…
  • Hi Martin, Due to the Scheffe and Tukey corrections not being suitable for RM factors, we have decided to not display those and clarify this with a footnote in the table. However, I will change the way it is being displayed, since NaN is ususally an…
  • Hi Mat, I just ran the analysis in R to check those results. Here is the code I wrote: myDat <- read.csv("/home/johnny/Downloads/airport.csv") # Take subset for "Near" condition myDat <- subset(myDat, LOCATION == 1) # Turn data frame int…
  • Hi Mark, Thanks for sharing this. The underlying algorithm introduces some degree of variation (there is Gibbs sampling both for dealing with rank data and for sampling from the delta posterior distribution). I have just implemented some more sta…
  • In addition I looked into this discrepancy a bit more, and there just seem to be multiple ways of computing the confidence intervals for cohen's d (differing in their approximations). There's an interesting post and simulation study here. Basicall…
  • Hi Francesco, Thanks for reporting it, it seems that eff.size package has a new version that has a slightly different algorithm from the previous one - I will update the JASP code accordingly so the next version will have the same output again! Ki…
  • Hi Peter, So JASP features multiple p-value corrections (Scheffe/Holm/etc) - these are done with the multcomp package (or sometimes with the p.adjust function). This package is used for the standard post hoc comparisons and it provides us with th…
  • Hi Alebyk, The difference lies in whether a normal approximation is used for the p-value. From the SciPy page: "Because the normal approximation is used for the calculations, the samples used should be large. A typical rule is to require that n >…