Commit
•
8af62ce
1
Parent(s):
4aa7c7d
Update README.md
Browse files
README.md
CHANGED
|
@@ -19,7 +19,6 @@ Trained on 2x4090 using QLoRa and FSDP
|
|
| 19 |
python -m vllm.entrypoints.openai.api_server \
|
| 20 |
--model macadeliccc/Samantha-Qwen2-7B-AWQ \
|
| 21 |
--chat-template ./examples/template_chatml.jinja \
|
| 22 |
-
--quantization awq
|
| 23 |
```
|
| 24 |
|
| 25 |
```python
|
|
|
|
| 19 |
python -m vllm.entrypoints.openai.api_server \
|
| 20 |
--model macadeliccc/Samantha-Qwen2-7B-AWQ \
|
| 21 |
--chat-template ./examples/template_chatml.jinja \
|
|
|
|
| 22 |
```
|
| 23 |
|
| 24 |
```python
|