Omega squared (ω2) is wrong.

General help and assistance with jamovi. Bug reports can be made at our issues page: https://github.com/jamovi/jamovi/issues . (If you're unsure feel free to discuss it here)
Post Reply
Martin
Posts: 2
Joined: Fri May 25, 2018 4:45 pm

Omega squared (ω2) is wrong.

Post by Martin »

Hi,
When I do the exact same analysis, a repeated measures ANOVA in Jamovi and in JASP I get the exact same results in everything except for ω2. Here it is a big difference. Either Jamovi or JASP is wrong, or both.

Thanks for a great program!
Attachments
Omega 2.tif
Omega 2.tif (85.49 KiB) Viewed 4618 times
User avatar
Ravi
Posts: 194
Joined: Sat Jan 28, 2017 11:18 am

Re: Omega squared (ω2) is wrong.

Post by Ravi »

So it looks like we are using the regular calculation of omega squared, while JASP is doing a generalized version of omega squared. I think we should probably use the generalized version as well, because the regular one is not completely appropriate for repeated measures designs. I'll fix this quickly and the change will be added to the next release. Thanks for reporting!
Martin
Posts: 2
Joined: Fri May 25, 2018 4:45 pm

Re: Omega squared (ω2) is wrong.

Post by Martin »

Thanks Ravi for the quick response! Yes that makes sense. See below:

Olejnik, S., & Algina, J. (2003). Generalized Eta and Omega Squared Statistics: Measures of Effect Size for Some Common Research Designs. Psychological Methods, 8, 434-447. http://dx.doi.org/10.1037/1082-989X.8.4.434
gabrielarantest
Posts: 2
Joined: Sat Mar 30, 2019 8:53 pm

Re: Omega squared (ω2) is wrong.

Post by gabrielarantest »

Hi. I have a similar problem with the eta squared when conducting a mixed design ANOVA. When conducting a mixed design ANOVA (2 within and 1 between factors) JASP and JAMOVI give me the same p values and the same partial eta squared. However, JAMOVI and JASP give me different eta squared. While JASP gives me a n² number very close to the np², JAMOVI gives a n² very different from the np². (e.g. np² = .138, JAMOVI gives me n²=.21 while JASP n²=.136).

I know that devs here are not responsible for JASP outputs. But I would like to ask if someone can tell me why these eta squared are so different.

Cheers.
User avatar
Ravi
Posts: 194
Joined: Sat Jan 28, 2017 11:18 am

Re: Omega squared (ω2) is wrong.

Post by Ravi »

So I think this has to do with how JASP calculates the total sum of squares. We used to calculate the total sum of squares in the same way as JASP (i.e., add the SS of all terms belonging to an individual error term together + the SS of the residual), but somebody sent us an email telling us that this was wrong in case of a RM/Mixed model so we corrected it. To calculate the total sum of squares, we now add all the sums of squares together and to get the eta squared you divide the SS of the term by the total SS.
gabrielarantest
Posts: 2
Joined: Sat Mar 30, 2019 8:53 pm

Re: Omega squared (ω2) is wrong.

Post by gabrielarantest »

Thanks for the reply Ravi!

Cheers.
Post Reply