Hugging Face's logo

DAMO-NLP-SG
/
CLEX-Mixtral-8x7B-Chat-32K

Text Generation
Transformers
Safetensors
mixtral
conversational
custom_code
Inference Endpoints
text-generation-inference
Model card Files Community
1
lixin4ever commited on
Commit
fd7275d
•
1 Parent(s): e0f398f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -58,7 +58,7 @@ We also evaluate CLEX-Mixtral-8x7B-Chat-32k on [InfiniteBench](https://github.co
58
  | ------------------- | ------ | --------------- | --------- | -------- | -------------------------- | -------------------------- |
59
  | Retrieve.PassKey | 100% | 92.71% | 98.14% | 97.80% | 99.72% | 96.78% |
60
  | **Retrieve.Number** | 100% | 56.61% | 95.42% | 98.14% | 76.10% | 76.61% |
61
- | **Retrieve.KV** | 89.00% | < 5% | 53.60% | 65.40% | <5% | <%5 |
62
  | En.Sum | 14.73% | 9.09% | 17.93% | 14.45% | 15.48% | 14.3% |
63
  | En.QA | 22.22% | 9.55% | 16.52% | 11.97% | 15.52% | 16.81% |
64
  | En.MC | 67.25% | 27.95% | 72.49% | 62.88% | 58.96% | 56.77% |
 
58
  | ------------------- | ------ | --------------- | --------- | -------- | -------------------------- | -------------------------- |
59
  | Retrieve.PassKey | 100% | 92.71% | 98.14% | 97.80% | 99.72% | 96.78% |
60
  | **Retrieve.Number** | 100% | 56.61% | 95.42% | 98.14% | 76.10% | 76.61% |
61
+ | **Retrieve.KV** | 89.00% | < 5% | 53.60% | 65.40% | <5% | <5% |
62
  | En.Sum | 14.73% | 9.09% | 17.93% | 14.45% | 15.48% | 14.3% |
63
  | En.QA | 22.22% | 9.55% | 16.52% | 11.97% | 15.52% | 16.81% |
64
  | En.MC | 67.25% | 27.95% | 72.49% | 62.88% | 58.96% | 56.77% |