Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Bill Winslarkakar
Y-A-R-K
Follow
billwinslarkakar@gmail.com
AI & ML interests
None yet
Recent Activity
replied
to
bartowski
's
post
3 days ago
Old mixtral model quants may be broken! Recently Slaren over on llama.cpp refactored the model loader - in a way that's super awesome and very powerful - but with it came breaking of support for "split tensor MoE models", which applies to older mixtral models You may have seen my upload of one such older mixtral model, ondurbin/bagel-dpo-8x7b-v0.2, and with the newest changes it seems to be able to run without issue If you happen to run into issues with any other old mixtral models, drop a link here and I'll try to remake them with the new changes so that we can continue enjoying them :)
View all activity
Organizations
None yet
models
None public yet
datasets
None public yet
