RaphaelMourad commited on
Commit
9ee6a7b
1 Parent(s): ac0b174

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -6,9 +6,9 @@ tags:
6
  - chemistry
7
  ---
8
 
9
- # Model Card for Mistral-Chem-v1-139M (Mistral for chemistry)
10
 
11
- The Mistral-Chem-v1-139M Large Language Model (LLM) is a pretrained generative chemical molecule model with 1.9M parameters x 8 experts = 15.2M parameters.
12
  It is derived from Mixtral-8x7B-v0.1 model, which was simplified for protein: the number of layers and the hidden size were reduced.
13
  The model was pretrained using 10M molecule SMILES strings from the ZINC 15 database.
14
 
@@ -26,8 +26,8 @@ Like Mixtral-8x7B-v0.1, it is a transformer model, with the following architectu
26
  import torch
27
  from transformers import AutoTokenizer, AutoModel
28
 
29
- tokenizer = AutoTokenizer.from_pretrained("RaphaelMourad/Mistral-Chem-v1-139M", trust_remote_code=True)
30
- model = AutoModel.from_pretrained("RaphaelMourad/Mistral-Chem-v1-139M", trust_remote_code=True)
31
  ```
32
 
33
  ## Calculate the embedding of a DNA sequence
@@ -48,7 +48,7 @@ Ensure you are utilizing a stable version of Transformers, 4.34.0 or newer.
48
 
49
  ## Notice
50
 
51
- Mistral-Chem-v1-139M is a pretrained base model for chemistry.
52
 
53
  ## Contact
54
 
 
6
  - chemistry
7
  ---
8
 
9
+ # Model Card for Mistral-Chem-v1-134M (Mistral for chemistry)
10
 
11
+ The Mistral-Chem-v1-134M Large Language Model (LLM) is a pretrained generative chemical molecule model with 134M parameters.
12
  It is derived from Mixtral-8x7B-v0.1 model, which was simplified for protein: the number of layers and the hidden size were reduced.
13
  The model was pretrained using 10M molecule SMILES strings from the ZINC 15 database.
14
 
 
26
  import torch
27
  from transformers import AutoTokenizer, AutoModel
28
 
29
+ tokenizer = AutoTokenizer.from_pretrained("RaphaelMourad/Mistral-Chem-v1-134M", trust_remote_code=True)
30
+ model = AutoModel.from_pretrained("RaphaelMourad/Mistral-Chem-v1-134M", trust_remote_code=True)
31
  ```
32
 
33
  ## Calculate the embedding of a DNA sequence
 
48
 
49
  ## Notice
50
 
51
+ Mistral-Chem-v1-134M is a pretrained base model for chemistry.
52
 
53
  ## Contact
54