wmmarcellino
commited on
Commit
•
c0e1461
1
Parent(s):
06b540a
Update README.md
Browse files
README.md
CHANGED
@@ -12,12 +12,20 @@ inference:
|
|
12 |
---
|
13 |
|
14 |
# mistral-7b-v0.1-GreeceRome-v0.1
|
15 |
-
This model
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
Refer to the [original model card](https://huggingface.co/mistralai/Mistral-7B-v0.1) for more details on the model.
|
17 |
## Use with mlx
|
18 |
```bash
|
19 |
pip install mlx
|
20 |
git clone https://github.com/ml-explore/mlx-examples.git
|
21 |
cd mlx-examples/llms/hf_llm
|
22 |
-
python generate.py --model mlx-community/mistral-7b-v0.1-GreeceRome-v0.1 --prompt "
|
23 |
```
|
|
|
12 |
---
|
13 |
|
14 |
# mistral-7b-v0.1-GreeceRome-v0.1
|
15 |
+
This classics model is a fine-tune of Mistral 7b, on 1,640 Q/A pairs on Greek & Roman history, over 3 epochs.
|
16 |
+
The dataset was generated via Mixtral-8x7b Instruct v01, run over 512 token-length chunks of vol's 2&3 of Will Durants' 13 vol **Story of Civilization** (*Life of Greece* and *Caesar & Christ*).
|
17 |
+
|
18 |
+
Training data was formatted with [INST] and [/INST] delimiting instructions:
|
19 |
+
```bash
|
20 |
+
{"text": "Q: \"Why did many Greeks come to resent Rome's 'liberation' and 'peacekeeping' efforts, such as forbidding class war and interfering in disputes, despite Rome having given Greece freedom from previous conflicts?\"\nA: Many Greeks came to resent Rome's \"liberation\" and \"peacekeeping\" efforts due to several reasons. First, after the Romans had given Greece freedom...(blah blah blah)...interfering in their domestic affairs, and ultimately"}
|
21 |
+
```
|
22 |
+
The model was converted to MLX format from [`mistralai/Mistral-7B-v0.1`]().
|
23 |
+
Mistral-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters.
|
24 |
Refer to the [original model card](https://huggingface.co/mistralai/Mistral-7B-v0.1) for more details on the model.
|
25 |
## Use with mlx
|
26 |
```bash
|
27 |
pip install mlx
|
28 |
git clone https://github.com/ml-explore/mlx-examples.git
|
29 |
cd mlx-examples/llms/hf_llm
|
30 |
+
python generate.py --model mlx-community/mistral-7b-v0.1-GreeceRome-v0.1 --prompt "How does Aristotle define the soul?"
|
31 |
```
|