cortexso
/

deepseek-r1-distill-llama-70b

Text Generation

Model card Files Files and versions Community

Minh141120 commited on Jan 31

Commit

d4b08db

·

verified ·

1 Parent(s): 97cd985

Update model.yml

Files changed (1) hide show

model.yml +1 -1

model.yml CHANGED Viewed

@@ -43,6 +43,6 @@ engine: llama-cpp
 prompt_template: "{system_message}<\uFF5CUser\uFF5C>{prompt}<\uFF5CAssistant\uFF5C\
   >"
 ctx_len: 4096
-ngl: 80
 # END REQUIRED
 # END MODEL LOAD PARAMETERS

 prompt_template: "{system_message}<\uFF5CUser\uFF5C>{prompt}<\uFF5CAssistant\uFF5C\
   >"
 ctx_len: 4096
+ngl: 81
 # END REQUIRED
 # END MODEL LOAD PARAMETERS