Request: Hastagaras/Halu-8B-Llama3-Blackroot
Hello, could you please quantize my merged model? [Template below].
Sure. Please edit your message filling the Required sections of the request template:
#how-to-request-a-model-quantization
You can just copy the entire template text box, edit your comment replacing it with the template and then fill the information.
You can see an example request here.
Model name: Halu-8B-Llama3-Blackroot
Model link: https://huggingface.co/Hastagaras/Halu-8B-Llama3-Blackroot
Brief description:
I don't know what to say about this model... this model is very strange...Maybe because Blackroot's amazing Loras used human data and not synthetic data, hence the model turned out to be very human-like...even the actions or narrations.
An image/direct image link to represent the model (square shaped):
Is that okay?
Looks good. Will get to it as soon as I can.
Thank you so much!
This model is very unsafe in certain parts...especially in RP
Always good to hear that. My favorite.
I'll tag you here when it's up and close it. Will be today, might just take time to upload if I end up having issues.
Thank you! please tell me if the model have any issues
Will be uploaded at:
https://huggingface.co/Lewdiculous/Halu-8B-Llama3-Blackroot-GGUF-IQ-Imatrix/
You can check a bit later and it should be all there. You can add feedback when you get around testing for your use case.