genmo/mochi-1-preview
Text-to-Video
•
Updated
•
40.5k
•
1.15k
BaYang
bayang
·
AI & ML interests
Heuristic methods
Recent Activity
new activity
19 days ago
deepfile/embedder-100p:Adding `safetensors` variant of this model
new activity
23 days ago
sentence-transformers/all-MiniLM-L6-v2:Support for Tensorflow.js
liked
a model
about 1 month ago
genmo/mochi-1-preview
Organizations
bayang's activity
Adding `safetensors` variant of this model
#1 opened 19 days ago
by
SFconvertbot
Support for Tensorflow.js
2
#94 opened 24 days ago
by
bayang
liked
a
model
about 1 month ago
liked
a
model
about 2 months ago
Guide for creating openvino and qint8 for hf model
7
#89 opened 2 months ago
by
bayang
updated
a
model
2 months ago
reacted to
tomaarsen's
post with 🔥
2 months ago
Post
5669
I just released Sentence Transformers v3.3.0 & it's huge! 4.5x speedup for CPU with OpenVINO int8 static quantization, training with prompts for a free perf. boost, PEFT integration, evaluation on NanoBEIR, and more! Details:
1. We integrate Post-Training Static Quantization using OpenVINO, a very efficient solution for CPUs that processes 4.78x as many texts per second on average, while only hurting performance by 0.36% on average. There's a new
2. We add the option to train with prompts, e.g. strings like "query: ", "search_document: " or "Represent this sentence for searching relevant passages: ". It's as simple as using the
3. Sentence Transformers now supports training PEFT adapters via 7 new methods for adding new adapters or loading pre-trained ones. You can also directly load a trained adapter with SentenceTransformer as if it's a normal model. Very useful for e.g. 1) training multiple adapters on 1 base model, 2) training bigger models than otherwise possible, or 3) cheaply hosting multiple models by switching multiple adapters on 1 base model.
4. We added easy evaluation on NanoBEIR, a subset of BEIR a.k.a. the MTEB Retrieval benchmark. It contains 13 datasets with 50 queries and up to 10k documents each. Evaluation is fast, and can easily be done during training to track your model's performance on general-purpose information retrieval tasks.
Additionally, we also deprecate Python 3.8, add better compatibility with Transformers v4.46.0, and more. Read the full release notes here: https://github.com/UKPLab/sentence-transformers/releases/tag/v3.3.0
1. We integrate Post-Training Static Quantization using OpenVINO, a very efficient solution for CPUs that processes 4.78x as many texts per second on average, while only hurting performance by 0.36% on average. There's a new
export_static_quantized_openvino_model method to quantize a model.2. We add the option to train with prompts, e.g. strings like "query: ", "search_document: " or "Represent this sentence for searching relevant passages: ". It's as simple as using the
prompts argument in SentenceTransformerTrainingArguments. Our experiments show that you can easily reach 0.66% to 0.90% relative performance improvement on NDCG@10 at no extra cost by adding "query: " before each training query and "document: " before each training answer.3. Sentence Transformers now supports training PEFT adapters via 7 new methods for adding new adapters or loading pre-trained ones. You can also directly load a trained adapter with SentenceTransformer as if it's a normal model. Very useful for e.g. 1) training multiple adapters on 1 base model, 2) training bigger models than otherwise possible, or 3) cheaply hosting multiple models by switching multiple adapters on 1 base model.
4. We added easy evaluation on NanoBEIR, a subset of BEIR a.k.a. the MTEB Retrieval benchmark. It contains 13 datasets with 50 queries and up to 10k documents each. Evaluation is fast, and can easily be done during training to track your model's performance on general-purpose information retrieval tasks.
Additionally, we also deprecate Python 3.8, add better compatibility with Transformers v4.46.0, and more. Read the full release notes here: https://github.com/UKPLab/sentence-transformers/releases/tag/v3.3.0
ONNX Models
2
#82 opened 3 months ago
by
ha1772007
updated
a
model
2 months ago
Unable to load the model
4
#4 opened 4 months ago
by
xardbaiz
liked
a
model
4 months ago
liked
2
datasets
6 months ago
Convert flan-t5 to GGUF
2
#3 opened 10 months ago
by
bogdan1
Quantizedd size warning
2
#9 opened 11 months ago
by
bayang
liked
a
model
11 months ago
liked
a
model
12 months ago
License is now MIT; enable Inference API
5
#70 opened about 1 year ago
by
mrfakename
Version teknium/Puffin-Phi-v2 over the original Phi
2
#5 opened about 1 year ago
by
bayang
liked
a
model
about 1 year ago