Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
Yarn-Mistral-7B-128k-AWQ
like
71
Text Generation
Transformers
Safetensors
emozilla/yarn-train-tokenized-16k-mistral
English
mistral
custom_code
text-generation-inference
4-bit precision
awq
arxiv:
2309.00071
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
dcb46d7
Yarn-Mistral-7B-128k-AWQ
1 contributor
History:
8 commits
TheBloke
Update for Transformers AWQ support
dcb46d7
12 months ago
.gitattributes
Safe
1.52 kB
initial commit
12 months ago
README.md
Safe
15.8 kB
Upload README.md
12 months ago
added_tokens.json
Safe
42 Bytes
AWQ model commit
12 months ago
config.json
Safe
1.15 kB
Update for Transformers AWQ support
12 months ago
configuration_mistral.py
Safe
8.9 kB
AWQ model commit
12 months ago
generation_config.json
Safe
116 Bytes
AWQ model commit
12 months ago
model.safetensors
Safe
4.15 GB
LFS
AWQ model commit
12 months ago
modeling_mistral_yarn.py
Safe
67.3 kB
AWQ model commit
12 months ago
quant_config.json
Safe
90 Bytes
AWQ model commit
12 months ago
special_tokens_map.json
Safe
145 Bytes
AWQ model commit
12 months ago
tokenizer.json
Safe
1.8 MB
AWQ model commit
12 months ago
tokenizer.model
Safe
493 kB
LFS
AWQ model commit
12 months ago
tokenizer_config.json
Safe
953 Bytes
AWQ model commit
12 months ago