Hugging Face's logo

poisson-fish
/
Marcoroni-70B-v1-AWQ

Text Generation
Transformers
PyTorch
llama
lmdeploy
awq
marcoroni
70b
text-generation-inference
Inference Endpoints
Model card Files Community
poisson-fish commited on
Commit
e74089c
·
1 Parent(s): 70eb057

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -1,3 +1,10 @@
 
 
 
 
 
 
 
1
  This is [AIDC-ai-business/Marcoroni-70B-v1](https://huggingface.co/AIDC-ai-business/Marcoroni-70B-v1) quantized to LMDeploy 4bit AWQ with the following config:
2
  ```bash
3
  python3 -m lmdeploy.lite.apis.auto_awq \
 
1
+ ---
2
+ tags:
3
+ - lmdeploy
4
+ - awq
5
+ - marcoroni
6
+ - 70b
7
+ ---
8
  This is [AIDC-ai-business/Marcoroni-70B-v1](https://huggingface.co/AIDC-ai-business/Marcoroni-70B-v1) quantized to LMDeploy 4bit AWQ with the following config:
9
  ```bash
10
  python3 -m lmdeploy.lite.apis.auto_awq \