Hugging Face's logo

altomek
/
CodeRosa-70B-AB1

Text Generation
Transformers
Safetensors
English
llama
Merge
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
1
altomek commited on
Commit
2ca2901
•
1 Parent(s): da52a7c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -44,6 +44,8 @@ I use max_seq_len 8K with alpha_value 2,65.
44
  ### Quants
45
 
46
  - [3.92bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.92bpw-EXL2) --> 40GB VRAM
 
 
47
  - [measurements](https://huggingface.co/altomek/measurements/resolve/main/CodeRosa-AB1_measurement.json) --> ExLlamav2 measurments
48
 
49
  ### PS
 
44
  ### Quants
45
 
46
  - [3.92bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.92bpw-EXL2) --> 40GB VRAM
47
+ - [3.5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.5bpw-EXL2)
48
+ - [3bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3bpw-EXL2)
49
  - [measurements](https://huggingface.co/altomek/measurements/resolve/main/CodeRosa-AB1_measurement.json) --> ExLlamav2 measurments
50
 
51
  ### PS