I'm running a dataset of 9k+ images. I don't why m...
# ask-metaflow
h
I'm running a dataset of 9k+ images. I don't why my notebook is crashing. Any help?
1
c
is there an error message?
h
Yes
c
can you paste
h
RAM allocated full
🎯 1
c
Need a higher-RAM machine or you can use a pattern that doesnt require fitting it all in memory at once like chunking the data.
h
20230125_164102.jpg,20230125_164100.jpg,20230125_164059.jpg
Kindly check the images for the errors
It crashed after used all the available RAM
c
free version of colab doesn't give you much RAM for many data science tasks. they have subscriptions where you can pay for more resources, which may be of interest. otherwise you can use colab for testing the workflow on a small slice of the data and move it to more scalable infrastructure once the code works.
h
I think colab is a free tool. I never know one can upgrade it.
Thanks the insight.
c
h
Thanks.
🤗 1