TheBloke
/

WizardLM-30B-Uncensored-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (4)

Adding Evaluation Results

#15 opened 12 months ago by

leaderboard-pr-bot

is it possible to use a continuous batching inference server with this model?

#14 opened about 1 year ago by

Can the model be sharded over several GPUs?

#13 opened over 1 year ago by

Works well on a 3090 ! Insane good !

#11 opened over 1 year ago by

Anyone has been successful in deploying this to Sagemaker or so?

#9 opened over 1 year ago by

Model exits in Windows Booga

#8 opened over 1 year ago by

Model Performance Curiosity

#7 opened over 1 year ago by

Have a problem with rtx4090

#6 opened over 1 year ago by

i got messy code

#3 opened over 1 year ago by

Will this work with the Local LLMs One-Click UI runpod?

#2 opened over 1 year ago by

How much vram+ram 30B needs? I have 3060 12gb + 32gb ram.

#1 opened over 1 year ago by