LLMs quantized with GPTQ
Irina Proskurina
iproskurina
AI & ML interests
LLMs: quantization, pre-training
Recent Activity
updated
a model
2 days ago
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g0111-s0
published
a model
2 days ago
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g0111-s0
updated
a model
4 days ago
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g10-s0
Organizations
Collections
4
models
54
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g0111-s0
Text Generation
•
Updated
•
2
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g10-s0
Text Generation
•
Updated
•
12
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g11-s0
Text Generation
•
Updated
•
9
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g562-s0
Text Generation
•
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g12-s0
Text Generation
•
Updated
•
5
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g563-s0
Text Generation
•
Updated
•
10
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g0-s0
Text Generation
•
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g13-s0
Text Generation
•
Updated
•
6
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/opt-test
Text Generation
•
Updated
•
10
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg)
iproskurina/opt-125m-gptq2
Text Generation
•
Updated
•
23