Memory requirements to load the model
#61
by
nroshania
- opened
Hoping to experiment with this model, does anyone know how much RAM and on disk memory is required to load this model? Thanks!
Hi @nroshania , We recommend a 8GB+ RAM on GPU for the 2B checkpoint and 24GB+ RAM on GPU for the 7B checkpoint. Please refer to this Gemma official document for more details in this. Thank you.