Page 1 of 1

memory size in Linear Regression

Posted: Fri Sep 06, 2019 11:27 am
by shabde
Hi,

I have a rather large dataset consisting of ~54 000 observations.
I try to fit a linear model with 1 dependent and 6 predictors (all scale).

It works well with the linear model module and also with Base R.
But when I try the Regression built in jamovi I get the following error:
cannot allocate vector of size 399.3 Mb
I have still 12GB RAM free, so I wonder what seems to be the problem...

Re: memory size in Linear Regression

Posted: Wed Sep 11, 2019 12:54 am
by jonathon
yeah, that is puzzling ... could you attach/send a .omv file of it?

with thanks

Re: memory size in Linear Regression

Posted: Wed Sep 11, 2019 11:19 am
by shabde
Sure, here you go...

(file is simplified, but the problem already arises with 1 predictor)

Re: memory size in Linear Regression

Posted: Fri Sep 13, 2019 12:25 am
by jonathon
hmm, yeah, this is a tricky one. running it here, it does use a surprising amount of RAM (~2 gig).

can you try running the analysis, and watching the memory consumption of the `jamovi-engine` processes (in a task manager/process monitor or some kind)? let us know if it really shoots up, and how high it goes.

this probably going to be a difficult one to resolve, because it will be caused by an R package doing something very inefficiently, and it will involve a) finding out what R package is responsible b) probably a bunch of buck passing between multiple package authors who will ultimately shrug and say "that's just how much memory it uses".

but we never know, we may get lucky.

with thanks

jonathon

Re: memory size in Linear Regression

Posted: Mon Oct 21, 2019 11:24 am
by jonathon
should be fixed in the 1.1.6

thanks for reporting

jonathon