bigcode

/

starcoderbase

like 387

Hi, I am trying to run the given inference code in the Model Card, but it gives me such error after downloading the files:

Downloading (…)okenizer_config.json: 100%|██████████████████████████████████████████████████████████████| 677/677 [00:00<00:00, 44.4kB/s]
Downloading (…)olve/main/vocab.json: 100%|████████████████████████████████████████████████████████████| 777k/777k [00:00<00:00, 1.02MB/s]                                                                                                                                            
Downloading (…)olve/main/merges.txt: 100%|█████████████████████████████████████████████████████████████| 442k/442k [00:00<00:00, 774kB/s]
Downloading (…)/main/tokenizer.json: 100%|██████████████████████████████████████████████████████████| 2.06M/2.06M [00:00<00:00, 2.09MB/s]
Downloading (…)cial_tokens_map.json: 100%|██████████████████████████████████████████████████████████████| 532/532 [00:00<00:00, 99.9kB/s]
Downloading (…)lve/main/config.json: 100%|███████████████████████████████████████████████████████████| 1.04k/1.04k [00:00<00:00, 271kB/s]
Traceback (most recent call last):                                   
  File "/home/workspace//starcoder/starcoder.py", line 7, in <module>                                                               
    model = AutoModelForCausalLM.from_pretrained(checkpoint, trust_remote_code=True).to(device)
  File "/root/miniconda3/envs/starcoder/lib/python3.9/site-packages/transformers/models/auto/auto_factory.py", line 441, in from_pretrained
    config, kwargs = AutoConfig.from_pretrained(                     
  File "/root/miniconda3/envs/starcoder/lib/python3.9/site-packages/transformers/models/auto/configuration_auto.py", line 917, in from_pretrained
    config_class = CONFIG_MAPPING[config_dict["model_type"]]         
  File "/root/miniconda3/envs/starcoder/lib/python3.9/site-packages/transformers/models/auto/configuration_auto.py", line 623, in __getitem__
    raise KeyError(key)                                              
KeyError: 'gpt_bigcode' 

Seems like error in config.json, right?