unsloth

/

gemma-2b-bnb-4bit

like 14

Hi guys,
I ran into the follwoing error during this tutorial https://colab.research.google.com/drive/15gGm7x_jTm017_Ic8e317tdIpDG53Mtu?usp=sharing#scrollTo=2eSvM9zX_2d3. (error is the same for all models, in the test run I used mistral).

Specs:

• Ubuntu 20.04
• conda 24.1.2

As I can neither find any occurrences of the error online, nor seem to be capable of finding the issue myself, I am reaching out to you guys.
Does anyone know where it comes from? Thanks for your help!

HTTPError Traceback (most recent call last)
File ~/anaconda3/envs/unsloth/lib/python3.10/site-packages/huggingface_hub/utils/_errors.py:304, in hf_raise_for_status(response, endpoint_name)
303 try:
--> 304 response.raise_for_status()
305 except HTTPError as e:

File ~/anaconda3/envs/unsloth/lib/python3.10/site-packages/requests/models.py:1024, in Response.raise_for_status(self)
1023 if http_error_msg:
-> 1024 raise HTTPError(http_error_msg, response=self)

HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/unsloth/mistral-7b-bnb-4bit/resolve/main/config.json

The above exception was the direct cause of the following exception:

RepositoryNotFoundError Traceback (most recent call last)
File ~/anaconda3/envs/unsloth/lib/python3.10/site-packages/transformers/utils/hub.py:399, in cached_file(path_or_repo_id, filename, cache_dir, force_download, resume_download, proxies, token, revision, local_files_only, subfolder, repo_type, user_agent, _raise_exceptions_for_gated_repo, _raise_exceptions_for_missing_entries, _raise_exceptions_for_connection_errors, _commit_hash, **deprecated_kwargs)
397 try:
398 # Load from URL or cache if already cached
--> 399 resolved_file = hf_hub_download(
400 path_or_repo_id,
401 filename,
402 subfolder=None if len(subfolder) == 0 else subfolder,
403 repo_type=repo_type,
404 revision=revision,
...
--> 102 raise RuntimeError(f"Unsloth: {model_name} is not a full model or a PEFT model.")
104 # Check base model again for PEFT
105 model_name = _get_model_name(peft_config.base_model_name_or_path, load_in_4bit)

RuntimeError: Unsloth: unsloth/mistral-7b-bnb-4bit is not a full model or a PEFT model.