Orange Apples

#1 opened about 20 hours ago by

New activity in NousResearch/Hermes-2-Theta-Llama-3-70B-GGUF 9 days ago

fit in 24gb?

#1 opened 9 days ago by

apol

New activity in mradermacher/model_requests about 1 month ago

cognitivecomputations/dolphin-2.9.2-mixtral-8x22b

#76 opened about 1 month ago by

New activity in failspy/Phi-3-medium-4k-instruct-abliterated-v3-GGUF about 1 month ago

WizardLM-2-8x22B abliteration inquiry

#1 opened about 1 month ago by

New activity in xxx777xxxASD/L3_SnowStorm_4x8B about 1 month ago

Feedback

#1 opened about 1 month ago by

New activity in failspy/Smaug-Llama-3-70B-Instruct-abliterated-v3 about 1 month ago

missing tokenizer?

#1 opened about 1 month ago by

mradermacher

New activity in NeverSleep/Llama-3-Lumimaid-70B-v0.1 about 1 month ago

8x22B Inquiry

9

#4 opened about 1 month ago by

New activity in froggeric/creativity about 1 month ago

2024-05-15 update

#8 opened about 2 months ago by

froggeric

New activity in mradermacher/WizardLM-2-8x22B-i1-GGUF about 1 month ago

Q2_K_S quant request

8

#1 opened about 1 month ago by

New activity in BeaverAI/Coomand-R-35B-v1-exl2 about 2 months ago

3.25bpw quant request

#1 opened about 2 months ago by

New activity in turboderp/command-r-v01-35B-exl2 about 2 months ago

What's the VRAM usage?

9

#2 opened 3 months ago by

CamiloMM

New activity in TheDrummer/Coomand-R-35B-v1-GGUF about 2 months ago

Exception errors attempting to run in Koboldcpp

4

#3 opened about 2 months ago by

CherylF

New activity in Virt-io/SillyTavern-Presets about 2 months ago

Feedback

42

#1 opened 3 months ago by

Virt-io

New activity in NeverSleep/Llama-3-Lumimaid-70B-v0.1 about 2 months ago

feedback

22

#2 opened about 2 months ago by

Szarka

New activity in zaq-hack/ChaoticSoliloquy-4x8B-bpw600-h6-exl2-rpcal about 2 months ago

Quant request

#1 opened about 2 months ago by

New activity in xxx777xxxASD/L3-ChaoticSoliloquy-v1.5-4x8B about 2 months ago

Seems unhinged compared to the first version

#1 opened about 2 months ago by

New activity in JayhC/ChaoticSoliloquy-4x8B-6bpw-h6-exl2 about 2 months ago

Quant request

3

#1 opened about 2 months ago by

New activity in alchemonaut/QuartetAnemoi-70B-t0.0001 about 2 months ago

Llama 3 70B

#10 opened about 2 months ago by

New activity in mradermacher/Aurora-Nights-103B-v1.0-i1-GGUF 4 months ago

Weight Calculation

3

#2 opened 4 months ago by

New activity in zaq-hack/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-bpw300-h6-exl2-rpcal 4 months ago

3.5bpw quant request

4

#1 opened 4 months ago by

New activity in dranger003/Senku-70B-iMat.GGUF 4 months ago

Slow prompt processing

#2 opened 4 months ago by

New activity in alchemonaut/QuartetAnemoi-70B-t0.0001 4 months ago

Prompt template?

#4 opened 4 months ago by

New activity in rAIfle/NoroMaid-v0.4-Mixtral-Instruct-8x7b-Zloss-exl2-rpcal 4 months ago

Quant Request

#2 opened 4 months ago by

New activity in lucyknada/Mixtral_34Bx2_MoE_60B-2.8bpw 4 months ago

Is this ExLlamaV2?

#1 opened 4 months ago by

New activity in brucethemoose/Yi-34B-200K-RPMerge-exl2-40bpw 5 months ago

5pbw quant request

#3 opened 5 months ago by

New activity in MarsupialAI/Yi-34B-200K-RPMerge_GGUF 5 months ago

Broken QK6 quant

#1 opened 5 months ago by

New activity in bartowski/bagel-20b-v04-llama-exl2 5 months ago

How to run without trust remote code on in Oobabooga?

#1 opened 5 months ago by

New activity in wolfram/miquliz-120b-v2.0-GGUF 5 months ago

IQ1 Quants

#1 opened 5 months ago by

New activity in Artefact2/Midnight-Rose-103B-v1.0-GGUF 5 months ago

IQ1 quants

#2 opened 5 months ago by

New activity in Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF 5 months ago

103b and 120b models

#7 opened 5 months ago by

New activity in Steelskull/Etheria-55b-v0.1 5 months ago

Feedback on using Etheria for RP

#2 opened 5 months ago by

New activity in Artefact2/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-GGUF 5 months ago

IQ3_XXS quant request

#2 opened 5 months ago by

New activity in Nexesenex/WinterGoddess-1.4x-limarpv3-70B-L2-32k-Requant.GGUF 5 months ago

Surprisingly good for stories

4

#2 opened 5 months ago by

cliffwalls

New activity in Doctor-Shotgun/Nous-Capybara-limarpv3-34B 7 months ago

Updated EXL2 Quants

#3 opened 7 months ago by

New activity in nsfwthrowitaway69/Venus-103b-v1.1 7 months ago

Is this an upgrade over v1.0?

5

#4 opened 7 months ago by

New activity in rwitz/go-bruins-v2 7 months ago

Prompt template

#9 opened 7 months ago by

New activity in nsfwthrowitaway69/Venus-103b-v1.1 7 months ago

GGUF quants

#3 opened 7 months ago by

New activity in royallab/Aetheria-L2-70B 7 months ago

EXL2 Quants

#2 opened 7 months ago by

New activity in DiscoResearch/DiscoLM-120b 7 months ago

Summoning EXL2 version ;)

9

#2 opened 7 months ago by

wolfram

New activity in LoneStriker/deepseek-llm-67b-Spicy-3.1-1-2.65bpw-h6-exl2 7 months ago

Why does Deepseek 67B have a bigger file size than 70B models?

#1 opened 7 months ago by

New activity in SUSTech/SUS-Chat-34B 7 months ago

Quant for the community

#1 opened 7 months ago by

Yhyu13

New activity in jebcarter/psyonic-cetacean-20B 7 months ago

This model vs PsyOrca2

#1 opened 7 months ago by

New activity in royallab/Aetheria-L2-70B-exl2 7 months ago

Quant Request

#1 opened 7 months ago by

New activity in LoneStriker/tulu-2-dpo-70b-2.4bpw-h6-exl2 7 months ago

SillyTavern Gibberish Output

#1 opened 7 months ago by

New activity in allenai/tulu-2-dpo-70b 7 months ago

SillyTavern Settings

#8 opened 7 months ago by

New activity in Sao10K/Euryale-1.4-L2-70B 7 months ago

EXL2 Quants

#1 opened 7 months ago by

New activity in AzureBlack/Euryale-1.4-L2-70B-exl2 7 months ago

24GB VRAM out of memory

#1 opened 7 months ago by

New activity in zgce/Yi-34b-Chat-Spicyboros-limarpv3_GGUF 7 months ago

Quant Request

3

#1 opened 7 months ago by

New activity in Undi95/X-MythoChronos-13B-GGUF 7 months ago

Model recommendations

#2 opened 7 months ago by

New activity in Herman555/MythoMist-AshhLimaRP-Mistral-7B-GGUF 7 months ago

Favorite Model?

6

#2 opened 7 months ago by

New activity in royallab/ZephRP-m7b 7 months ago

Zephyr 7B Beta

#1 opened 7 months ago by

New activity in taozi555/RpBird-Yi-34B-200k 7 months ago

GGUF quants

#1 opened 7 months ago by