Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Supported by

Comparing two tests with JASP

Hi there,

I'm a psychology student and this month I attended a statistics course: the professor asked us to create a 15-items test (5 options Likert-type scale for the answers) on Google Form, distribute it and then gather all the answers.
We imported the .xlsx file to Google Sheets and started calculating stuff such as Cronbach's Alpha, variance, means and so on. We eventually generated a graph but only to discover that the resulting data was not normally distributed: we had to replace 4 items (which were causing this data to be skewed) with 4 better items, re-distribute the test and re-generate a new .xlsx. This time the generated graph showed what looks more like a normal curve.

Old test graph:

New test graph:

Now we have to compare the old test with the new one using JASP. I know that we must use a non-parametric test here because we have a skewed set of data in one hand and a normally distributed data in the other hand, but I got kinda lost during the explaination. I'd go with T-Tests -> Paired Samples T-Test -> Wilcoxon Signed-Rank, but I honestly don't know how to correctly organize and insert the data at this point (should it be the right one) on JASP.

Bonus question: is there a way to know/calculate if a given curve (which looks kinda normal, like the newer one I got) can be considered normal or not?

Thanks in advance! I really appreciate your help.

Dario

Comments

  • Hi Dario,

    Well, first off, data from a Likert scale can never be normal, because the scale is discrete. But sum scores across several items (or average scores across participants, or averaged sum scores across participants) can be approximately normally distributed. There are formal tests but most often people just do a QQ plot.

    Secondly, I am not sure a significance test is what you need. You were unhappy with some items, did some more work, and arrived at a test you believe to be better. Why is it of interest whether the difference is statistically significant?

    Thirdly, I am not 100% sure what aspect of the distribution you would like to compare. The entire distribution? [I think a QQ plot or a KS test are tools for that] Your search for a t-test indicates you would only like to compare the means -- but why exactly is this? Also, you probably distributed the test to new participants, in case you have an unpaired t-test, not a paired t-test...

    Cheers,
    E.J.

  • edited December 2018

    Hi E.J., thanks for your reply.

    Obviously my lack of knowledge of statistics (and english not being my native language) hasn't helped me to be clear. I apologize for this.

    When we were working on the first version of the test we calculated the Pearson correlation coefficient between each item and the whole test (using the =CORREL function between all the scores of a single item and all the total scores of the participants, this done with every item): in this way we recognized the items that needed to be replaced by looking at their low r value (most of the items were over r=0,70, so we replaced 4 items under r=0,30)

    Items got replaced, test got re-distributed, all the new item/test correlations were over r=0,70.

    Now the professor just encouraged us to calculate how much the old version of the test is correlated to the new one, suggesting that a non-parametric test done with JASP could be the best choice (since we have not normally distributed data).

    Even understanding which JASP function is needed in this case, I wouldn't know how to correctly organize the .csv file to import.

    I understand this request can sound kinda vague (I got lost, as a matter of fact), but I was also hoping to learn something more about statistics by understanding how such things can be done with JASP.

    Thanks in advance again!

    Dario

  • Hi Dario,

    "calculate how much the old version of the test is correlated to the new one"
    Since the old and new test share a lot of items, the correlation has to be high. To compute the correlation, ideally you have the same people answer all the items. But what exactly do you want to correlate? The sum score across all the items?

    Cheers,
    E.J.

  • edited December 2018

    Yes, I assume that calculating the correlation between the sum score across all the items of both tests could be a good point, like pairing the scores of the items that both tests have in common but also counting the "effect" of the items that have been removed and replaced. Thanks!

    Dario

Sign In or Register to comment.

agen judi bola , sportbook, casino, togel, number game, singapore, tangkas, basket, slot, poker, dominoqq, agen bola. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 50.000 ,- bonus cashback hingga 10% , diskon togel hingga 66% bisa bermain di android dan IOS kapanpun dan dimana pun. poker , bandarq , aduq, domino qq , dominobet. Semua permainan bisa dimainkan hanya dengan 1 ID. minimal deposit 10.000 ,- bonus turnover 0.5% dan bonus referral 20%. Bonus - bonus yang dihadirkan bisa terbilang cukup tinggi dan memuaskan, anda hanya perlu memasang pada situs yang memberikan bursa pasaran terbaik yaitu http://45.77.173.118/ Bola168. Situs penyedia segala jenis permainan poker online kini semakin banyak ditemukan di Internet, salah satunya TahunQQ merupakan situs Agen Judi Domino66 Dan BandarQ Terpercaya yang mampu memberikan banyak provit bagi bettornya. Permainan Yang Di Sediakan Dewi365 Juga sangat banyak Dan menarik dan Peluang untuk memenangkan Taruhan Judi online ini juga sangat mudah . Mainkan Segera Taruhan Sportbook anda bersama Agen Judi Bola Bersama Dewi365 Kemenangan Anda Berapa pun akan Terbayarkan. Tersedia 9 macam permainan seru yang bisa kamu mainkan hanya di dalam 1 ID saja. Permainan seru yang tersedia seperti Poker, Domino QQ Dan juga BandarQ Online. Semuanya tersedia lengkap hanya di ABGQQ. Situs ABGQQ sangat mudah dimenangkan, kamu juga akan mendapatkan mega bonus dan setiap pemain berhak mendapatkan cashback mingguan. ABGQQ juga telah diakui sebagai Bandar Domino Online yang menjamin sistem FAIR PLAY disetiap permainan yang bisa dimainkan dengan deposit minimal hanya Rp.25.000. DEWI365 adalah Bandar Judi Bola Terpercaya & resmi dan terpercaya di indonesia. Situs judi bola ini menyediakan fasilitas bagi anda untuk dapat bermain memainkan permainan judi bola. Didalam situs ini memiliki berbagai permainan taruhan bola terlengkap seperti Sbobet, yang membuat DEWI365 menjadi situs judi bola terbaik dan terpercaya di Indonesia. Tentunya sebagai situs yang bertugas sebagai Bandar Poker Online pastinya akan berusaha untuk menjaga semua informasi dan keamanan yang terdapat di POKERQQ13. Kotakqq adalah situs Judi Poker Online Terpercayayang menyediakan 9 jenis permainan sakong online, dominoqq, domino99, bandarq, bandar ceme, aduq, poker online, bandar poker, balak66, perang baccarat, dan capsa susun. Dengan minimal deposit withdraw 15.000 Anda sudah bisa memainkan semua permaina pkv games di situs kami. Jackpot besar,Win rate tinggi, Fair play, PKV Games