bwang0911 commited on
Commit
fce8f6a
1 Parent(s): 144a2e0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -10
README.md CHANGED
@@ -2,16 +2,16 @@
2
  license: apache-2.0
3
  ---
4
 
5
- ## Tiny-Embedding
6
 
7
- An embedding model trained for study embedding quality vs model architecture (width/depth) given a size constraint (12M params).
8
 
9
- - **bo-emb-tiny-2-128**: 2 layers/hidden size 128/4.4m
10
- - **bo-emb-tiny-4-128**: 4 layers/H 128/4.8m
11
- - **bo-emb-tiny-6-128**: 6 layers/H 128/5.2m
12
- - **bo-emb-tiny-8-128**: 8 layers/H 128/5.6m
13
- - **bo-emb-tiny-10-128**: 10 layers/H 128/6.0m
14
- - **bo-emb-tiny-12-128**: 12 layers/H 128/6.4m
15
- - **bo-emb-mini-2-256**: 2 layers/H 256/9.7m
16
- - **bo-emb-mini-4-256**: 4 layers/H 256/11.3m
17
 
 
2
  license: apache-2.0
3
  ---
4
 
5
+ ## Cat Embeddings
6
 
7
+ A set of embedding model trained for study embedding quality vs model architecture (width/depth) given a size constraint (12M params).
8
 
9
+ - **cat-emb-tiny-2-128**: 2 layers/hidden size 128/4.4m
10
+ - **cat-emb-tiny-4-128**: 4 layers/H 128/4.8m
11
+ - **cat-emb-tiny-6-128**: 6 layers/H 128/5.2m
12
+ - **cat-emb-tiny-8-128**: 8 layers/H 128/5.6m
13
+ - **cat-emb-tiny-10-128**: 10 layers/H 128/6.0m
14
+ - **cat-emb-tiny-12-128**: 12 layers/H 128/6.4m
15
+ - **cat-emb-mini-2-256**: 2 layers/H 256/9.7m
16
+ - **cat-emb-mini-4-256**: 4 layers/H 256/11.3m
17