TheBloke

/

Wizard-Vicuna-30B-Uncensored-GPTQ

like 548

Hi. I followed the directions on the model's card. I have a fresh copy of the oobabooga text gen ui. When I try to load the model I get the error pasted at the bottom. I tried renaming the quantize_config.json file to config.json but got another error. Am I doing something wrong? Thanks!!

Traceback (most recent call last): File “/home/joey/source/text-generation-webui/server.py”, line 71, in load_model_wrapper shared.model, shared.tokenizer = load_model(shared.model_name) File “/home/joey/source/text-generation-webui/modules/models.py”, line 79, in load_model shared.model_type = find_model_type(model_name) File “/home/joey/source/text-generation-webui/modules/models.py”, line 67, in find_model_type config = AutoConfig.from_pretrained(path_to_model, trust_remote_code=shared.args.trust_remote_code) File “/home/joey/miniconda3/envs/aa2/lib/python3.9/site-packages/transformers/models/auto/configuration_auto.py”, line 931, in from_pretrained config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs) File “/home/joey/miniconda3/envs/aa2/lib/python3.9/site-packages/transformers/configuration_utils.py”, line 574, in get_config_dict config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs) File “/home/joey/miniconda3/envs/aa2/lib/python3.9/site-packages/transformers/configuration_utils.py”, line 629, in _get_config_dict resolved_config_file = cached_file( File “/home/joey/miniconda3/envs/aa2/lib/python3.9/site-packages/transformers/utils/hub.py”, line 388, in cached_file raise EnvironmentError( OSError: models/TheBloke_Wizard-Vicuna-30B-Uncensored-GPTQ does not appear to have a file named config.json. Checkout ‘https://huggingface.co/models/TheBloke_Wizard-Vicuna-30B-Uncensored-GPTQ/None’ for available files.