Yanqing0327
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,11 @@ datasets:
|
|
15 |
|
16 |
## Model Usage
|
17 |
### With OpenCLIP
|
18 |
-
#### Note:
|
|
|
|
|
|
|
|
|
19 |
```
|
20 |
import torch
|
21 |
import torch.nn.functional as F
|
|
|
15 |
|
16 |
## Model Usage
|
17 |
### With OpenCLIP
|
18 |
+
#### Note:
|
19 |
+
#### 1. We made modifications to the tokenizer implementation in open_clip/tokenizer.py.
|
20 |
+
#### 2. Due to differences in the default epsilon values for LayerNorm initialization between JAX and PyTorch, we adjusted the default epsilon value in open_clip/transformer.py to align the model's behavior.
|
21 |
+
#### For more details, refer to https://github.com/UCSC-VLAA/CLIPS.
|
22 |
+
|
23 |
```
|
24 |
import torch
|
25 |
import torch.nn.functional as F
|