Alex Cardo

New activity in bartowski/Nemotron-Mini-4B-Instruct-GGUF 16 days ago

LM Studio Says "unknown model architecture"

6

#1 opened 16 days ago by

New activity in mlx-community/gemma-2-2b-it-fp16 about 1 month ago

ValueError: Model type gemma2 not supported

#2 opened about 1 month ago by

New activity in NikolayKozloff/Vikhr-Gemma-2B-instruct-Q8_0-GGUF about 1 month ago

General knowledge issue

#1 opened about 1 month ago by

New activity in city96/FLUX.1-dev-gguf about 1 month ago

My experience

9

#9 opened about 1 month ago by

SaisExperiments

New activity in bartowski/gemma-2-2b-it-GGUF about 2 months ago

surprising - that model is incredible for it's size.

20

#2 opened about 2 months ago by

mirek190

GGML_ASSERT: src/llama.cpp:11811: false

2

#1 opened about 2 months ago by

New activity in CohereForAI/aya-23-8B 4 months ago

Can you provide the correct prompt template to use this model as a translator

#6 opened 4 months ago by

New activity in mlx-community/aya-23-8B-4bit 4 months ago

Strange behavior

#2 opened 4 months ago by

New activity in bartowski/aya-23-8B-GGUF 4 months ago

Another <EOS_TOKEN> issue

#2 opened 4 months ago by

New activity in microsoft/Phi-3-small-8k-instruct 4 months ago

Why a different architecture from mini and medium?

#5 opened 4 months ago by

winddude

New activity in MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF 4 months ago

Can you please also quantize Phi-3-SMALL!!!

#2 opened 4 months ago by

New activity in lightblue/suzume-llama-3-8B-multilingual-gguf 4 months ago

Prompt example for LLAMA CPP for translations tasks

#1 opened 4 months ago by

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF-v2 4 months ago

I'm experiencing the same endless loop with this version as well

#1 opened 4 months ago by

New activity in lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF 5 months ago

Prompt Template example

#7 opened 5 months ago by

101rakibulhasan

New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 5 months ago

Still endless output with any gguf if not instruct mode

#14 opened 5 months ago by

New activity in lightblue/suzume-llama-3-8B-multilingual 5 months ago

Template for LLama CPP server

#6 opened 5 months ago by

New activity in apple/OpenELM 5 months ago

Whether this model an open-source?

#20 opened 5 months ago by

New activity in meta-llama/Meta-Llama-3-8B-Instruct 5 months ago

The best 8B in the planet right now. PERIOD!

2

#22 opened 5 months ago by

cyberneticos

New activity in FuseAI/FuseChat-7B-VaRM 7 months ago

How to prompt it correctly?

#6 opened 7 months ago by

New activity in Vikhrmodels/Vikhr-7B-instruct_0.2 7 months ago

Что лежит в основе модели и какой был датасет?

#4 opened 7 months ago by

New activity in second-state/Gemma-7b-it-GGUF 7 months ago

Glitch with Gemma model

#2 opened 7 months ago by

New activity in rahuldshetty/gemma-7b-it-gguf-quantized 7 months ago

This quant gives a terrifying output

#1 opened 7 months ago by

New activity in allenai/OLMo-7B 8 months ago

Will there be quantized versions? (GGUF)

10

#4 opened 8 months ago by

New activity in TheBloke/openchat-3.5-0106-GGUF 9 months ago

EOS token wrong

4

#1 opened 9 months ago by

mljxy

New activity in TheBloke/openchat-3.5-1210-GGUF 9 months ago

What am I doing wrong?

#2 opened 9 months ago by

New activity in TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF 10 months ago

Even this excellent high-end model doesn't follow my instructions

#8 opened 10 months ago by

New activity in TheBloke/zephyr-7B-beta-GGUF 10 months ago

How is it possible that Q4_K_M performs better than any Q5, Q6 and even Q8?

#8 opened 10 months ago by