Hugging Face's logo

hgloow
/
Merged-AGI-7B-EXL2

Text Generation
Transformers
Safetensors
English
mistral
Math
exl2
text-generation-inference
Inference Endpoints
Model card Files Community
hgloow commited on
Commit
66dbd83
•
1 Parent(s): 33cdd28

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -27,7 +27,7 @@ Zipped Quantization (if you want to download a single file)
27
  - [8.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/8.0bpw-zip)
28
 
29
  ## Memory Usage
30
- Measured using 4096 max_seq_len on [Oobabooga's Text Generation WebUI](https://github.com/oobabooga/text-generation-webui/tree/main).
31
  | Branch | BPW | VRAM Usage |
32
  | ------ | --- | ---------- |
33
  [3.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/3.0bpw)|3.0|3.7 GB
 
27
  - [8.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/8.0bpw-zip)
28
 
29
  ## Memory Usage
30
+ Measured using ExLlamaV2 and 4096 max_seq_len with [Oobabooga's Text Generation WebUI](https://github.com/oobabooga/text-generation-webui/tree/main).
31
  | Branch | BPW | VRAM Usage |
32
  | ------ | --- | ---------- |
33
  [3.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/3.0bpw)|3.0|3.7 GB