Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
1211
11
Tom Jobbins
PRO
TheBloke
Follow
gdumas's profile picture
Andres-1's profile picture
gabrielsubtil's profile picture
22200 followers
·
16 following
TheBlokeAI
TheBloke
AI & ML interests
LLM: quantisation, fine tuning
Articles
Making LLMs lighter with AutoGPTQ and transformers
Aug 23, 2023
•
33
Organizations
TheBloke
's activity
All
Models
Datasets
Spaces
Papers
Collections
Community
Posts
Upvotes
Likes
New activity in
TheBloke/Llama-2-70B-GGUF
10 months ago
fix for join commands
1
#2 opened 10 months ago by
orbiter
New activity in
TheBloke/CodeLlama-70B-hf-AWQ
10 months ago
not codelama
3
#1 opened 10 months ago by
luckiskind
New activity in
TheBloke/MegaDolphin-120b-GPTQ
10 months ago
Missing files
2
#1 opened 10 months ago by
Danne980
New activity in
TheBloke/Fennec-Mixtral-8x7B-GGUF
11 months ago
Is this the same model with orangetin/OpenHermes-Mixtral-8x7B ?
2
#2 opened 11 months ago by
bingw5
New activity in
Yhyu13/LMCocktail-10.7B-v1
11 months ago
Quant pls
4
#1 opened 11 months ago by
Yhyu13
New activity in
VAGOsolutions/SauerkrautLM-SOLAR-Instruct
11 months ago
Quants uploading now
1
#4 opened 11 months ago by
TheBloke
New activity in
ddh0/OrcaMaidXL-17B-32k
11 months ago
Add YaRN modeling code
#1 opened 11 months ago by
TheBloke
New activity in
TheBloke/openchat-3.5-1210-AWQ
11 months ago
Update special_tokens_map.json
#1 opened 11 months ago by
alpayariyak
New activity in
TheBloke/openchat-3.5-1210-GPTQ
11 months ago
Update special_tokens_map.json
#1 opened 11 months ago by
alpayariyak
New activity in
TheBloke/Llama-2-13B-Chat-Dutch-AWQ
11 months ago
Update to new format and include chat template with default system message
#1 opened 11 months ago by
BramVanroy
New activity in
TheBloke/Llama-2-13B-Chat-Dutch-GPTQ
11 months ago
Update to new format and include chat template with default system message
#1 opened 11 months ago by
BramVanroy
New activity in
ddh0/Norocetacean-20b-10k
11 months ago
Update configuration_llama.py, required to get model to Load as `rope_scaling` needs to be None, or else a dictionary
#1 opened 11 months ago by
TheBloke
New activity in
TheBloke/Rogue-Rose-103b-v0.2-GPTQ
11 months ago
Missing Model
1
#1 opened 11 months ago by
Razzor9000
New activity in
Undi95/Mixtral-8x7B-MoE-RP-Story
11 months ago
Model config.json has Mistral params instead of Mixtral, breaking ExLlama quants and maybe affecting others too
#3 opened 11 months ago by
TheBloke
New activity in
TheBloke/SOLAR-10.7B-Instruct-v1.0-GGUF
11 months ago
vocabulary maybe wrong
3
#1 opened 11 months ago by
limoncc
New activity in
TheBloke/openchat-3.5-1210-GGUF
11 months ago
Sorta Broken
6
#1 opened 11 months ago by
dillfrescott
New activity in
TheBloke/Mixtral-8x7B-v0.1-GPTQ
11 months ago
RuntimeError: shape '[32, 8]' is invalid for input of size 0
7
#5 opened 11 months ago by
woldeM
New activity in
mattshumer/mistral-8x7b-chat
12 months ago
Quant pls
1
#5 opened 12 months ago by
Yhyu13
New activity in
TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ
12 months ago
Did anyone get it to run?
11
#1 opened 12 months ago by
dimaischenko
New activity in
TheBlokeAI/Mixtral-tiny-GPTQ
12 months ago
Seems like the GPTQ versions are broken
4
#2 opened 12 months ago by
NePe
Load more