OpenCLIP
PyTorch
clip
vaishaal commited on
Commit
523eb04
1 Parent(s): fee33e7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -27
README.md CHANGED
@@ -20,49 +20,50 @@ These weights are directly usable in OpenCLIP (image + text).
20
  - Data Filtering Networks: https://arxiv.org/abs/2309.17425
21
  - **Samples Seen:** 39B (224 x 224) + 5B (384 x 384)
22
  ## Model Metrics
23
-
24
  | dataset | metric |
25
  |:-----------------------|---------:|
26
- | ImageNet 1k | 0.84206 |
27
- | Caltech-101 | 0.951389 |
28
  | CIFAR-10 | 0.9879 |
29
  | CIFAR-100 | 0.9041 |
30
- | CLEVR Counts | 0.3424 |
31
- | CLEVR Distance | 0.214933 |
32
- | Country211 | 0.3591 |
33
- | Describable Textures | 0.707979 |
34
  | EuroSAT | 0.608333 |
35
- | FGVC Aircraft | 0.657362 |
36
- | Food-101 | 0.962099 |
37
- | GTSRB | 0.681077 |
38
- | ImageNet Sketch | 0.72214 |
39
- | ImageNet v2 | 0.7787 |
40
- | ImageNet-A | 0.802 |
41
- | ImageNet-O | 0.3945 |
42
- | ImageNet-R | 0.929 |
43
- | KITTI Vehicle Distance | 0.40225 |
44
  | MNIST | 0.8372 |
45
- | ObjectNet | 0.796867 |
46
- | Oxford Flowers-102 | 0.896257 |
47
- | Oxford-IIIT Pet | 0.968432 |
48
- | Pascal VOC 2007 | 0.7914 |
49
  | PatchCamelyon | 0.695953 |
50
  | Rendered SST2 | 0.566722 |
51
  | RESISC45 | 0.755079 |
52
- | Stanford Cars | 0.95809 |
53
  | STL-10 | 0.991125 |
54
- | SUN397 | 0.768257 |
55
  | SVHN | 0.671251 |
56
  | Flickr | 0.8808 |
57
- | MSCOCO | 0.636489 |
58
  | WinoGAViL | 0.571813 |
59
- | iWildCam | 0.215716 |
60
  | Camelyon17 | 0.711536 |
61
  | FMoW | 0.209024 |
62
- | Dollar Street | 0.711449 |
63
- | GeoDE | 0.921503 |
64
- | **Average** | **0.705323** |
 
65
 
 
66
  ## Model Usage
67
  ### With OpenCLIP
68
  ```
 
20
  - Data Filtering Networks: https://arxiv.org/abs/2309.17425
21
  - **Samples Seen:** 39B (224 x 224) + 5B (384 x 384)
22
  ## Model Metrics
 
23
  | dataset | metric |
24
  |:-----------------------|---------:|
25
+ | ImageNet 1k | 0.84218 |
26
+ | Caltech-101 | 0.954479 |
27
  | CIFAR-10 | 0.9879 |
28
  | CIFAR-100 | 0.9041 |
29
+ | CLEVR Counts | 0.362467 |
30
+ | CLEVR Distance | 0.206067 |
31
+ | Country211 | 0.37673 |
32
+ | Describable Textures | 0.71383 |
33
  | EuroSAT | 0.608333 |
34
+ | FGVC Aircraft | 0.719938 |
35
+ | Food-101 | 0.963129 |
36
+ | GTSRB | 0.679018 |
37
+ | ImageNet Sketch | 0.73338 |
38
+ | ImageNet v2 | 0.7837 |
39
+ | ImageNet-A | 0.7992 |
40
+ | ImageNet-O | 0.3785 |
41
+ | ImageNet-R | 0.937633 |
42
+ | KITTI Vehicle Distance | 0.38256 |
43
  | MNIST | 0.8372 |
44
+ | ObjectNet[^1] | 0.796867 |
45
+ | Oxford Flowers-102 | 0.896834 |
46
+ | Oxford-IIIT Pet | 0.966841 |
47
+ | Pascal VOC 2007 | 0.826255 |
48
  | PatchCamelyon | 0.695953 |
49
  | Rendered SST2 | 0.566722 |
50
  | RESISC45 | 0.755079 |
51
+ | Stanford Cars | 0.959955 |
52
  | STL-10 | 0.991125 |
53
+ | SUN397 | 0.772799 |
54
  | SVHN | 0.671251 |
55
  | Flickr | 0.8808 |
56
+ | MSCOCO | 0.636889 |
57
  | WinoGAViL | 0.571813 |
58
+ | iWildCam | 0.224911 |
59
  | Camelyon17 | 0.711536 |
60
  | FMoW | 0.209024 |
61
+ | Dollar Street | 0.71729 |
62
+ | GeoDE | 0.935699 |
63
+ | **Average** | **0.709421** |
64
+
65
 
66
+ [^1]: Center-crop pre-processing used for ObjectNet (squashing results in 6pp lower accuracy)
67
  ## Model Usage
68
  ### With OpenCLIP
69
  ```