multiple ROC curves, logistic regression

Discuss the jamovi platform, possible improvements, etc.
anagrammarian
Posts: 6
Joined: Tue Sep 27, 2022 4:48 pm

multiple ROC curves, logistic regression

Post by anagrammarian »

Hi,

Is there a way to generate multiple ROC curves on the same plot in the logistic regression module? For e.g. I have two different methods generating volume predictors for Alzheimer's disease and want to characterize each method using AUC for AD prediction as a metric. I can generate an ROC for each method separately (the data is in separate sheets but I can merge them). Alternatively, is there a way to save the data used to generate the curve as pairs so I can use another program to plot multiple curves?

And a related question. Does the logistic regression I used to generate the ROC use an internal test train split or do I have to do that manually? I did not see any documentation on how that is done.

Thanks,

manoj
User avatar
seol
Posts: 174
Joined: Mon Dec 04, 2017 8:40 am
Location: Seoul, Korea
Contact:

Re: multiple ROC curves, logistic regression

Post by seol »

Hi

This is a R programming for multiple ROC curves.
https://github.com/cardiomoon/multipleROC

Hope this helps you

Best Regards
Seol
User avatar
seol
Posts: 174
Joined: Mon Dec 04, 2017 8:40 am
Location: Seoul, Korea
Contact:

Re: multiple ROC curves, logistic regression

Post by seol »

Oh

Have you try to run 'psychoPDA' module for Multiple ROC ?

I think it's possible to draw Multiple ROC with pyschoPDA module.

Best Regards
Seol
anagrammarian
Posts: 6
Joined: Tue Sep 27, 2022 4:48 pm

Re: multiple ROC curves, logistic regression

Post by anagrammarian »

Thanks Seol. I have but I am trying to use the results from jamovi's logistic regression and not able to get the data out to plot. We coded it in R.
User avatar
seol
Posts: 174
Joined: Mon Dec 04, 2017 8:40 am
Location: Seoul, Korea
Contact:

Re: multiple ROC curves, logistic regression

Post by seol »

Hi anagrammarian

I installed Multiple ROC within snowCluster module and pushed it to github yesterday.
It will be available today in jamovi library. I will let you know it's available.

Best Regards
Seol
Attachments
이미지 001.png
이미지 001.png (101.75 KiB) Viewed 1831 times
User avatar
seol
Posts: 174
Joined: Mon Dec 04, 2017 8:40 am
Location: Seoul, Korea
Contact:

Re: multiple ROC curves, logistic regression

Post by seol »

Hi

You can update snowCluster module in jamovi library. You should check the latest version of jamovi(current version).

Best Regards
Seol
Attachments
이미지 009.png
이미지 009.png (18.88 KiB) Viewed 1815 times
anagrammarian
Posts: 6
Joined: Tue Sep 27, 2022 4:48 pm

Re: multiple ROC curves, logistic regression

Post by anagrammarian »

This is great. I will give it a spin and let you know. Thanks much !
anagrammarian
Posts: 6
Joined: Tue Sep 27, 2022 4:48 pm

Re: multiple ROC curves, logistic regression

Post by anagrammarian »

I just tried it (had to redownload jamovi) and seems to work very well. Thank you for adding this so quickly. Some followup qs/comments-
a. The text legends like model, auc overlap on the curve. Maybe it should be printed as text instead of on the image
b. I tried to predict y based on N xs. The multiple ROC curves options plots y vs x1, y vs x2.. and so on. What I had in mind when I said multiple ROIs was multiple *different* models like y based on 2 xs or 3xs or Nxs. This is how the original https://github.com/cardiomoon/multipleROC envisions also. I guess this will be much more complex in jamovi to implement.
c. The last q (and I think I know the answer but wanted to check) is does this do a test train split? I think not but that might be useful.
User avatar
seol
Posts: 174
Joined: Mon Dec 04, 2017 8:40 am
Location: Seoul, Korea
Contact:

Re: multiple ROC curves, logistic regression

Post by seol »

Hi anagrammarian
Thanks for your questions.

a, Try resizing the picture by entering a number in size option.
b. To do it the way you suggest requires some tricks. In this case, it might be more accurate to use the stepwise method in logistic regression rather than ROC analysis.
c. You might be try to run it snowCluster >Machine Learning in jamovi

Best Regards
Seol
anagrammarian
Posts: 6
Joined: Tue Sep 27, 2022 4:48 pm

Re: multiple ROC curves, logistic regression

Post by anagrammarian »

Thanks.

a. I can do that but in general some people may not want to show it in the curve.
b. I am mainly doing it to compare 3 or 4 different methods (which generate different xs) as opposed to different number of xs (which might require stepwise analysis as you suggest. So imagine for the iris case we had 3 different ways of generating petal and sepal lengths and widths. I want to see which measurement method is more accurate (using AUC of iris prediction as a surrogate). Here the xs (i.e. the 4 variables) are the same and y is species. It will be nice to show all 3 ROC curves. But I think jamovi is not the tool for that. I can do this in R (i just need to dust off my manual, haven't done it in a while).
c. I need to generate ROC curves for the test train splits which I have already done so thanks.
Post Reply