pszemraj commited on
Commit
8fba247
1 Parent(s): 4d82a91

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -4,9 +4,12 @@ license: mit
4
 
5
  # ethzanalytics/dolly-v2-7b-sharded-8bit
6
 
7
- For more info on loading 8bit models, refer to the [example repo](https://huggingface.co/ybelkada/bloom-1b7-8bit) and/or the `4.28.0` [release info](https://github.com/huggingface/transformers/releases/tag/v4.28.0).
8
 
9
- - total model size is only ~12.5 GB!
 
 
 
10
  - this enables low-RAM loading, i.e. Colab :)
11
 
12
  ## Basic Usage
 
4
 
5
  # ethzanalytics/dolly-v2-7b-sharded-8bit
6
 
7
+ # dolly-v2-7b: **8-bit** sharded checkpoint
8
 
9
+
10
+ This is a sharded checkpoint (with ~2GB shards) of the `databricks/dolly-v2-7b` model **in 8-bit precision using `bitsandbytes`**. Refer to the [original model](https://huggingface.co/databricks/dolly-v2-7b) for all details. For more info on loading 8bit models, refer to the [example repo](https://huggingface.co/ybelkada/bloom-1b7-8bit) and/or the `4.28.0` [release info](https://github.com/huggingface/transformers/releases/tag/v4.28.0).
11
+
12
+ - total model size is only XX GB!
13
  - this enables low-RAM loading, i.e. Colab :)
14
 
15
  ## Basic Usage