Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
jan-hq
/
stealth-finance-v2-dpo-adapter
like
0
PEFT
Safetensors
jan-hq/distilabel_dpo_pairs_binarized
argilla/OpenHermes2.5-dpo-binarized-alpha
jan-hq/capybara_dpo_binarized
jan-hq/bagel_dpo_binarized
jan-hq/ultrafeedback_preferences_cleaned_binarized
jan-hq/openmath_instruct_dpo_binarized
jan-hq/distil_math_dpo_binarized
jan-hq/evol_codealpaca_dpo_binarized
mixtral
alignment-handbook
trl
dpo
Generated from Trainer
4-bit precision
bitsandbytes
License:
mit
Model card
Files
Files and versions
Community
Train
Use this model
main
stealth-finance-v2-dpo-adapter
/
README.md
Commit History
End of training
8a75540
verified
jan-hq
commited on
Feb 24
Model save
c7f70d3
verified
jan-hq
commited on
Feb 24
jan-hq
commited on
jan-hq
commited on
