Edit model card

Qwen1.5-7B-Chat-2.2bpw-exl2

This is a 2.2bpw quantized version of Qwen/Qwen1.5-7B-Chat made with exllamav2.

To run this, make sure you installed the up-to-date version of Exllamav2.

License

This project is distributed under the Tongyi Qianwen LICENSE AGREEMENT. See the LICENSE file for more information.

Feeling Generous? 😊

Eager to buy me a cup of 2$ coffe or iced tea?πŸ΅β˜• Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?

Downloads last month
0
Inference API
Input a message to start chatting with DrNicefellow/Qwen1.5-7B-Chat-2.2bpw-exl2.
This model can be loaded on Inference API (serverless).

Collection including DrNicefellow/Qwen1.5-7B-Chat-2.2bpw-exl2