Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,103 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: llama3
|
3 |
+
model-index:
|
4 |
+
- name: Rubra-Meta-Llama-3-70B
|
5 |
+
results:
|
6 |
+
- task:
|
7 |
+
type: text-generation
|
8 |
+
dataset:
|
9 |
+
type: MMLU
|
10 |
+
name: MMLU
|
11 |
+
metrics:
|
12 |
+
- type: 5-shot
|
13 |
+
value: 75.9
|
14 |
+
verified: false
|
15 |
+
- task:
|
16 |
+
type: text-generation
|
17 |
+
dataset:
|
18 |
+
type: GPQA
|
19 |
+
name: GPQA
|
20 |
+
metrics:
|
21 |
+
- type: 0-shot
|
22 |
+
value: 33.93
|
23 |
+
verified: false
|
24 |
+
- task:
|
25 |
+
type: text-generation
|
26 |
+
dataset:
|
27 |
+
type: GSM-8K
|
28 |
+
name: GSM-8K
|
29 |
+
metrics:
|
30 |
+
- type: 8-shot, CoT
|
31 |
+
value: 82.26
|
32 |
+
verified: false
|
33 |
+
- task:
|
34 |
+
type: text-generation
|
35 |
+
dataset:
|
36 |
+
type: MATH
|
37 |
+
name: MATH
|
38 |
+
metrics:
|
39 |
+
- type: 4-shot, CoT
|
40 |
+
value: 34.24
|
41 |
+
verified: false
|
42 |
+
- task:
|
43 |
+
type: text-generation
|
44 |
+
dataset:
|
45 |
+
type: MT-bench
|
46 |
+
name: MT-bench
|
47 |
+
metrics:
|
48 |
+
- type: GPT-4 as Judge
|
49 |
+
value: 8.36
|
50 |
+
verified: false
|
51 |
+
tags:
|
52 |
+
- function-calling
|
53 |
+
- tool-calling
|
54 |
+
- agentic
|
55 |
+
- rubra
|
56 |
+
- conversational
|
57 |
+
language:
|
58 |
+
- en
|
59 |
+
---
|
60 |
+
|
61 |
+
# Rubra Llama-3 70B AWQ
|
62 |
+
|
63 |
+
Original model: [rubra-ai/Meta-Llama-3-70B-Instruct](https://huggingface.co/rubra-ai/Meta-Llama-3-70B-Instruct)
|
64 |
+
|
65 |
+
## Model description
|
66 |
+
The model is the result of further post-training [meta-llama/Meta-Llama-3-70B](https://huggingface.co/meta-llama/Meta-Llama-3-70B). This model is designed for high performance in various instruction-following tasks and complex interactions, including multi-turn function calling and detailed conversations.
|
67 |
+
|
68 |
+
## Training Data
|
69 |
+
The model underwent additional training on a proprietary dataset encompassing diverse instruction-following, chat, and function calling data. This post-training process enhances the model's ability to integrate tools and manage complex interaction scenarios effectively.
|
70 |
+
|
71 |
+
## How to use
|
72 |
+
Refer to https://docs.rubra.ai/inference/llamacpp for usage. Feel free to ask/open issues up in our Github repo: https://github.com/rubra-ai/rubra
|
73 |
+
|
74 |
+
## Limitations and Bias
|
75 |
+
|
76 |
+
While the model performs well on a wide range of tasks, it may still produce biased or incorrect outputs. Users should exercise caution and critical judgment when using the model in sensitive or high-stakes applications. The model's outputs are influenced by the data it was trained on, which may contain inherent biases.
|
77 |
+
|
78 |
+
## Ethical Considerations
|
79 |
+
|
80 |
+
Users should ensure that the deployment of this model adheres to ethical guidelines and consider the potential societal impact of the generated text. Misuse of the model for generating harmful or misleading content is strongly discouraged.
|
81 |
+
|
82 |
+
## Acknowledgements
|
83 |
+
|
84 |
+
We would like to thank Meta for the model.
|
85 |
+
|
86 |
+
## Contact Information
|
87 |
+
|
88 |
+
For questions or comments about the model, please reach out to [the rubra team](mailto:rubra@acorn.io).
|
89 |
+
|
90 |
+
## Citation
|
91 |
+
|
92 |
+
If you use this work, please cite it as:
|
93 |
+
|
94 |
+
```
|
95 |
+
@misc {rubra_ai_2024,
|
96 |
+
author = { Sanjay Nadhavajhala and Yingbei Tong },
|
97 |
+
title = { Rubra-Meta-Llama-3-70B-Instruct },
|
98 |
+
year = 2024,
|
99 |
+
url = { https://huggingface.co/rubra-ai/Meta-Llama-3-70B-Instruct },
|
100 |
+
doi = { 10.57967/hf/2643 },
|
101 |
+
publisher = { Hugging Face }
|
102 |
+
}
|
103 |
+
```
|