Doesn't return any value using API? Model loaded successfully on runpod using The_Bloke's template
#4
by
rafa9
- opened
The result shows just empty string like:
"{\"results\": [{\"text\": \"\"}]}"
The sent request is:
let request = {
max_new_tokens: 500,
do_sample: true,
temperature: 0.3,
top_p: 0.1,
typical_p: 1,
epsilon_cutoff: 0, // In units of 1e-4
eta_cutoff: 0, // In units of 1e-4
repetition_penalty: 1.18,
top_k: 40,
min_length: 10,
no_repeat_ngram_size: 0,
num_beams: 1,
penalty_alpha: 0,
length_penalty: 1,
early_stopping: false,
mirostat_mode: 0,
mirostat_tau: 5,
mirostat_eta: 0.1,
seed: -1,
add_bos_token: true,
truncation_length: 2048,
ban_eos_token: false,
skip_special_tokens: true,
stopping_strings: [],
};
request = {
...request,
prompt: `Repeat this text please: "π Hellow world how are you π»"`,
};
rafa9
changed discussion status to
closed
You got it sorted?