Update README.md
Browse files
README.md
CHANGED
@@ -35,7 +35,7 @@ This model was trained using [H2O LLM Studio](https://github.com/h2oai/h2o-llmst
|
|
35 |
|
36 |
Trained in 4-Bit with Lora (R=64) for 2 epochs. Perplexity on validation: 1.245
|
37 |
|
38 |
-
Hardware
|
39 |
|
40 |
## Usage
|
41 |
|
@@ -46,6 +46,10 @@ Recommended prompt format:
|
|
46 |
</s><|answer|>
|
47 |
```
|
48 |
|
|
|
|
|
|
|
|
|
49 |
### Code
|
50 |
|
51 |
To use the model with the `transformers` library on a machine with GPUs, first make sure you have the `transformers` library installed.
|
|
|
35 |
|
36 |
Trained in 4-Bit with Lora (R=64) for 2 epochs. Perplexity on validation: 1.245
|
37 |
|
38 |
+
**Hardware**: 1x A100 80GB for 12 hours
|
39 |
|
40 |
## Usage
|
41 |
|
|
|
46 |
</s><|answer|>
|
47 |
```
|
48 |
|
49 |
+
### Inference
|
50 |
+
|
51 |
+
Recommended to use 2-4 beams when generating.
|
52 |
+
|
53 |
### Code
|
54 |
|
55 |
To use the model with the `transformers` library on a machine with GPUs, first make sure you have the `transformers` library installed.
|