Sipho's picture

7

Sipho

DQ83

·

AI & ML interests

None yet

Organizations

None yet

DQ83's activity

New activity in TheBloke/CodeFuse-CodeLlama-34B-GPTQ about 1 year ago

How to Instruct Template in TGI?

#1 opened over 1 year ago by

New activity in TheBloke/WizardCoder-15B-1.0-GPTQ over 1 year ago

Exllama not working

#16 opened over 1 year ago by

8bit GPTQ model

#3 opened over 1 year ago by

New activity in TheBloke/CodeLlama-34B-GPTQ over 1 year ago

Strange output in oobabooga

#2 opened over 1 year ago by

New activity in TheBloke/CodeLlama-13B-Instruct-GPTQ over 1 year ago

thanks for all the nice models. unfortunately all CodeLlamas throw "KeyError: ‘pad_token_id’"

#2 opened over 1 year ago by

New activity in TheBloke/LosslessMegaCoder-Llama2-13B-Mini-GGML over 1 year ago

how to get it working with Exlama ?

#1 opened over 1 year ago by

New activity in ToolBench/ToolLLaMA-2-7b-v1 over 1 year ago

what about an quantized version so we can load in Exlama with large context size?

#1 opened over 1 year ago by