Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ProphetOfBostrom
/
BagelMix-8x7B-2b-HQQ
like
0
Text Generation
Transformers
mixtral
Not-For-All-Audiences
nsfw
mergekit
Merge
HQQ
2bit
conversational
text-generation-inference
Inference Endpoints
arxiv:
2311.03099
arxiv:
2306.01708
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
BagelMix-8x7B-2b-HQQ
1 contributor
History:
6 commits
ProphetOfBostrom
utility: maximised.
2b60801
verified
8 months ago
.gitattributes
1.52 kB
initial commit
8 months ago
HQQbagelmix_def.py
1.23 kB
Update HQQbagelmix_def.py
8 months ago
README.md
4.34 kB
utility: maximised.
8 months ago
config.json
774 Bytes
untested vanilla quant of undi95's
8 months ago
qmodel.pt
pickle
Detected Pickle imports (6)
"collections.OrderedDict"
,
"torch.Size"
,
"torch.ByteStorage"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.HalfStorage"
,
"torch._utils._rebuild_parameter"
How to fix it?
18.2 GB
LFS
untested vanilla quant of undi95's
8 months ago
special_tokens_map.json
414 Bytes
untested vanilla quant of undi95's
8 months ago
tokenizer.json
1.8 MB
untested vanilla quant of undi95's
8 months ago
tokenizer.model
493 kB
LFS
untested vanilla quant of undi95's
8 months ago
tokenizer_config.json
1.51 kB
untested vanilla quant of undi95's
8 months ago