Munish Kumar

Unable to use model

#1 opened 9 days ago by

New activity in QuantFactory/dolphin-2.9-llama3-8b-GGUF 23 days ago

What am I doing wrong? Using Oobabooga.

#1 opened 2 months ago by

Goldenblood56

does not appear to have a file named config.json

#2 opened 2 months ago by

atubong

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 24 days ago

Compatibility with llama-cpp and Ollama

6

#17 opened about 1 month ago by

liashchynskyi

New activity in QuantFactory/Llama-3-Alpha-Ko-8B-Instruct-GGUF 27 days ago

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

#1 opened 28 days ago by

coconut00

New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF about 1 month ago

error when loading the model

5

#3 opened about 1 month ago by

StefanStroescu

New activity in mistralai/Codestral-22B-v0.1 about 1 month ago

How to convert to HF format?

5

#6 opened about 1 month ago by

ddh0

New activity in internlm/internlm2-math-plus-1_8b about 1 month ago

Rename configuration_internlm.py to configuration_internlm2.py

#1 opened about 1 month ago by

New activity in internlm/internlm2-math-plus-7b about 1 month ago

Rename configuration_internlm.py to configuration_internlm2.py

#1 opened about 1 month ago by

New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF about 1 month ago

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

#2 opened 2 months ago by

BigDeeper

Working with llama cpp ?

4

#1 opened 2 months ago by

ivanpzk

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF about 1 month ago

This quantized Llama3 cannot answer in different language like original Meta Llama3 model

#16 opened about 1 month ago by

taiSupermicro

--leave-output-tensor !

#13 opened about 2 months ago by

ZeroWw

Still endless output with any gguf if not instruct mode

#14 opened about 2 months ago by

alexcardo

New activity in QuantFactory/Phi-3-mini-4k-instruct-GGUF 2 months ago

How Are End Tokens Managed?

#2 opened 2 months ago by deleted

New activity in cognitivecomputations/dolphin-2.9-llama3-8b 2 months ago

Update README.md

#10 opened 2 months ago by

GGUF quants are here

#5 opened 2 months ago by

New activity in munish0838/funsd-vqa 2 months ago

[bot] Conversion to Parquet

#1 opened 5 months ago by

parquet-converter

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 2 months ago

what is the meaning of these suffix

10

#3 opened 2 months ago by

zenwangzy24

不同版本对性能的要求

#5 opened 2 months ago by

liyis

New activity in QuantFactory/Meta-Llama-3-8B-GGUF 2 months ago

Your Q4_K_M model is incomplete

#2 opened 2 months ago by

Shards86

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 2 months ago

(Fixed) Missing end Token?

14

#1 opened 2 months ago by deleted

Q4_K_S suspiciously small

#2 opened 2 months ago by

PartyParrot

New activity in Nexusflow/Starling-LM-7B-beta 3 months ago

Adding proposed model avatar

#3 opened 3 months ago by

Suparious

New activity in QuantFactory/Starling-LM-7B-beta-GGUF 3 months ago

Delete Starling-LM-7B-beta.q8_0.gguf

#1 opened 3 months ago by

New activity in 0-hero/Matter-0.1-7B-boost-DPO-preview 3 months ago

Update README.md

#2 opened 3 months ago by

New activity in munish0838/Matter-0.1-7B-boost-GGUF 3 months ago

Update README.md

#2 opened 3 months ago by

Delete Matter-0.1-7B-boost.q8_0.gguf

#1 opened 3 months ago by

New activity in ntu-spml/distilhubert 4 months ago

RuntimeError: expected scalar type Long but found Int

#2 opened 4 months ago by

New activity in nielsr/XFUN over 1 year ago

JSONDecodeError: Expecting value: line 8 column 1 (char 7)