macadeliccc
commited on
Commit
•
8af62ce
1
Parent(s):
4aa7c7d
Update README.md
Browse files
README.md
CHANGED
@@ -19,7 +19,6 @@ Trained on 2x4090 using QLoRa and FSDP
|
|
19 |
python -m vllm.entrypoints.openai.api_server \
|
20 |
--model macadeliccc/Samantha-Qwen2-7B-AWQ \
|
21 |
--chat-template ./examples/template_chatml.jinja \
|
22 |
-
--quantization awq
|
23 |
```
|
24 |
|
25 |
```python
|
|
|
19 |
python -m vllm.entrypoints.openai.api_server \
|
20 |
--model macadeliccc/Samantha-Qwen2-7B-AWQ \
|
21 |
--chat-template ./examples/template_chatml.jinja \
|
|
|
22 |
```
|
23 |
|
24 |
```python
|