Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
PrunaAI
/
vinai-PhoGPT-4B-Chat-bnb-8bit-smashed
like
0
Text Generation
Transformers
Safetensors
mpt
pruna-ai
custom_code
text-generation-inference
Inference Endpoints
8-bit precision
bitsandbytes
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
refs/pr/1
vinai-PhoGPT-4B-Chat-bnb-8bit-smashed
1 contributor
History:
3 commits
sharpenb
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
6cbacb6
verified
4 months ago
.gitattributes
1.52 kB
initial commit
4 months ago
README.md
5.34 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
adapt_tokenizer.py
1.72 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
attention.py
24.6 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
blocks.py
4.04 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
config.json
2.08 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
configuration_mpt.py
16.4 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
custom_embedding.py
292 Bytes
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
fc.py
167 Bytes
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
ffn.py
5.22 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
flash_attn_triton.py
28.2 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
generation_config.json
91 Bytes
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
hf_prefixlm_converter.py
10.5 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
meta_init_context.py
3.96 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
model.safetensors
3.76 GB
LFS
9c965a76594d5463ba3b59af1f4772f775a0a573938dd620b6cf073425af5e71
4 months ago
modeling_mpt.py
32.4 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
norm.py
3.12 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
param_init_fns.py
11.9 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
plots.png
445 kB
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
smash_config.json
905 Bytes
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
warnings.py
894 Bytes
12f7cda603d2d60cc34959145e1ff2e58e8b044be3925bf8be4cd6b5e3d1a887
4 months ago
