OpenCLIP
Yanqing0327 commited on
Commit
dfd9ec1
·
verified ·
1 Parent(s): a22f97a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -15,7 +15,11 @@ datasets:
15
 
16
  ## Model Usage
17
  ### With OpenCLIP
18
- #### Note: Due to differences in the default epsilon values for LayerNorm initialization between JAX and PyTorch, we made some modifications in open_clip/transformer.py to align the model's behavior. Refer to https://github.com/UCSC-VLAA/CLIPS for more details.
 
 
 
 
19
  ```
20
  import torch
21
  import torch.nn.functional as F
 
15
 
16
  ## Model Usage
17
  ### With OpenCLIP
18
+ #### Note:
19
+ #### 1. We made modifications to the tokenizer implementation in open_clip/tokenizer.py.
20
+ #### 2. Due to differences in the default epsilon values for LayerNorm initialization between JAX and PyTorch, we adjusted the default epsilon value in open_clip/transformer.py to align the model's behavior.
21
+ #### For more details, refer to https://github.com/UCSC-VLAA/CLIPS.
22
+
23
  ```
24
  import torch
25
  import torch.nn.functional as F