RaphaelMourad
commited on
Commit
•
c8ca6bd
1
Parent(s):
9ee6a7b
Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ tags:
|
|
9 |
# Model Card for Mistral-Chem-v1-134M (Mistral for chemistry)
|
10 |
|
11 |
The Mistral-Chem-v1-134M Large Language Model (LLM) is a pretrained generative chemical molecule model with 134M parameters.
|
12 |
-
It is derived from Mixtral-8x7B-v0.1 model, which was simplified for
|
13 |
The model was pretrained using 10M molecule SMILES strings from the ZINC 15 database.
|
14 |
|
15 |
## Model Architecture
|
|
|
9 |
# Model Card for Mistral-Chem-v1-134M (Mistral for chemistry)
|
10 |
|
11 |
The Mistral-Chem-v1-134M Large Language Model (LLM) is a pretrained generative chemical molecule model with 134M parameters.
|
12 |
+
It is derived from Mixtral-8x7B-v0.1 model, which was simplified for molecules: the number of layers and the hidden size were reduced.
|
13 |
The model was pretrained using 10M molecule SMILES strings from the ZINC 15 database.
|
14 |
|
15 |
## Model Architecture
|