Rafa's picture

11 1 7

Rafa

rafa9

·

AI & ML interests

None yet

Organizations

rafa9's activity

New activity in mlabonne/Llama-3.1-70B-Instruct-lorablated 2 months ago

Delay time and execution time considerably larger compared to 3.0 model?

#8 opened 2 months ago by

New activity in cloudyu/Mixtral_34Bx2_MoE_60B 9 months ago

How to try this model with Ooba's text-generation-webui?

#13 opened 9 months ago by

New activity in LoneStriker/Air-Striker-Mixtral-8x7B-Instruct-ZLoss-3.75bpw-h6-exl2 9 months ago

What quantization is it? Can be used with vLLM?

#1 opened 9 months ago by

New activity in budecosystem/genz-70b about 1 year ago

Is there a way to avoid it identifying itself as AI?

#2 opened about 1 year ago by

New activity in transformer3/H2-keywordextractor over 1 year ago

How do we make a request? Result from inference API and inference endpoint are different

#2 opened over 1 year ago by

New activity in TheBloke/guanaco-65B-GPTQ over 1 year ago

Getting KeyError: 'model.layers.16.self_attn.q_proj.wf1' on trying to prompt on Runpod

#10 opened over 1 year ago by

New activity in TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ over 1 year ago

Doesn't return any value using API? Model loaded successfully on runpod using The_Bloke's template

#4 opened over 1 year ago by

New activity in TheBloke/VicUnlocked-alpaca-65B-QLoRA-GGML over 1 year ago

How to run this on runpod?

#2 opened over 1 year ago by

New activity in cognitivecomputations/Wizard-Vicuna-30B-Uncensored over 1 year ago

Is it 30B? In the description it says 13B

#2 opened over 1 year ago by

New activity in TheBloke/WizardLM-30B-Uncensored-GPTQ over 1 year ago

Error on start - raise EnvironmentError( OSError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack

#10 opened over 1 year ago by

Anyone has been successful in deploying this to Sagemaker or so?

#9 opened over 1 year ago by