Commit
·
27af99a
1
Parent(s):
4f1fe5a
Update README.md
Browse files
README.md
CHANGED
|
@@ -28,6 +28,8 @@ This model has been distilled from `mixedbread-ai/mxbai-embed-2d-large-v1`, with
|
|
| 28 |
- **red-beetle-base-v0**: The original model, without using PCA or Zipf. The lack of PCA and Zipf also makes this a decent model for further training.
|
| 29 |
- **red-beetle-base-v1**: The original model, with PCA at 1024 dimensions and (Zipf)^3 re-weighting.
|
| 30 |
- **red-beetle-small-v1**: A smaller version of the original model, with PCA at 384 dimensions and (Zipf)^3 re-weighting.
|
|
|
|
|
|
|
| 31 |
|
| 32 |
## Installation
|
| 33 |
|
|
|
|
| 28 |
- **red-beetle-base-v0**: The original model, without using PCA or Zipf. The lack of PCA and Zipf also makes this a decent model for further training.
|
| 29 |
- **red-beetle-base-v1**: The original model, with PCA at 1024 dimensions and (Zipf)^3 re-weighting.
|
| 30 |
- **red-beetle-small-v1**: A smaller version of the original model, with PCA at 384 dimensions and (Zipf)^3 re-weighting.
|
| 31 |
+
- **red-beetle-base-v1.1**: The original model, with PCA at 1024 dimensions, Zipf and SIF re-weighting, learnt from a subset of the FineWeb-Edu sample-10BT dataset.
|
| 32 |
+
- **red-beetle-small-v1.1**: A smaller version of the original model, with PCA at 384 dimensions, Zipf and SIF re-weighting, learnt from a subset of the FineWeb-Edu sample-10BT dataset.
|
| 33 |
|
| 34 |
## Installation
|
| 35 |
|