Hugging Face's logo

royleibov
/
Llama-3.1-8B-ZipNN-Compressed

Text Generation
Transformers
Safetensors
PyTorch
llama
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
mreso commited on
Commit
df34336
•
1 Parent(s): 6d52333

Upload patch.diff (#1)

Browse files

- Upload patch.diff (2cbc44f1bb93c008a9bf94c7fdb42b7bb4b127db)

Files changed (1) hide show
  1. patch.diff +2 -2
patch.diff CHANGED
@@ -1,5 +1,5 @@
1
  diff --git a/src/transformers/models/llama/convert_llama_weights_to_hf.py b/src/transformers/models/llama/convert_llama_weights_to_hf.py
2
- index a0fbe4680a..73944d2c2c 100644
3
  --- a/src/transformers/models/llama/convert_llama_weights_to_hf.py
4
  +++ b/src/transformers/models/llama/convert_llama_weights_to_hf.py
5
  @@ -17,10 +17,10 @@ import json
@@ -105,7 +105,7 @@ index a0fbe4680a..73944d2c2c 100644
105
  + bos_token_id = 128000
106
  +
107
  + if instruct:
108
- + eos_token_id = [128001, 128009]
109
  + else:
110
  + eos_token_id = 128001
111
  + else:
 
1
  diff --git a/src/transformers/models/llama/convert_llama_weights_to_hf.py b/src/transformers/models/llama/convert_llama_weights_to_hf.py
2
+ index a0fbe4680..8b0ce2b13 100644
3
  --- a/src/transformers/models/llama/convert_llama_weights_to_hf.py
4
  +++ b/src/transformers/models/llama/convert_llama_weights_to_hf.py
5
  @@ -17,10 +17,10 @@ import json
 
105
  + bos_token_id = 128000
106
  +
107
  + if instruct:
108
+ + eos_token_id = [128001, 128008, 128009]
109
  + else:
110
  + eos_token_id = 128001
111
  + else: