Update README.md
Browse files
README.md
CHANGED
@@ -773,19 +773,25 @@ Think carefully before responding, and be sure to include your reasoning when ap
|
|
773 |
|
774 |
## Renting instances to run the model
|
775 |
|
776 |
-
###
|
777 |
|
778 |
[Massed Compute](https://massedcompute.com/?utm_source=huggingface&utm_creative_format=model_card&utm_content=creator_jon) has created a Virtual Machine (VM) pre-loaded with TGI and Text Generation WebUI.
|
779 |
|
780 |
-
1) For this model
|
781 |
-
2) After you
|
782 |
-
3)
|
783 |
-
|
784 |
-
|
785 |
-
|
786 |
-
|
787 |
-
|
788 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
789 |
|
790 |
Sample command within the VM
|
791 |
```
|
|
|
773 |
|
774 |
## Renting instances to run the model
|
775 |
|
776 |
+
### Massed Compute Virtual Machine
|
777 |
|
778 |
[Massed Compute](https://massedcompute.com/?utm_source=huggingface&utm_creative_format=model_card&utm_content=creator_jon) has created a Virtual Machine (VM) pre-loaded with TGI and Text Generation WebUI.
|
779 |
|
780 |
+
1) For this model, [create an account](https://bit.ly/jon-durbin) in Massed Compute. When renting a Virtual Machine use the code 'JonDurbin' for 50% your rental.
|
781 |
+
2) After you created your account update your billing and navigate to the deploy page.
|
782 |
+
3) Select the following
|
783 |
+
- GPU Type: A6000
|
784 |
+
- GPU Quantity: 1
|
785 |
+
- Category: Creator
|
786 |
+
- Image: Jon Durbin
|
787 |
+
- Coupon Code: JonDurbin
|
788 |
+
4) Deploy the VM!
|
789 |
+
5) Navigate to 'Running Instances' to retrieve instructions to login to the VM
|
790 |
+
6) Once inside the VM, open the terminal and run `volume=$PWD/data`
|
791 |
+
7) Run `model=jondurbin/bagel-dpo-20b-v04`
|
792 |
+
8) `sudo docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model`
|
793 |
+
9) The model will take some time to load...
|
794 |
+
10) Once loaded the model will be available on port 8080
|
795 |
|
796 |
Sample command within the VM
|
797 |
```
|