TheBloke

/

Nous-Capybara-34B-GGUF

like 163

I tried this very simple code which is in the model card

    from transformers import AutoModelForCausalLM
    llm = AutoModelForCausalLM.from_pretrained("TheBloke/Nous-Capybara-34B-GGUF", model_file="nous-capybara-34b.Q4_K_M.gguf", gpu_layers=0)

and I'm getting this error

     ".../venv/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py", line 761, in __getitem__
      raise KeyError(key)
      KeyError: 'yi'