Quants that run fast on single 3090/4090 card with 24GB of VRAM and 4096 context length
TeeZee
TeeZee
AI & ML interests
LLM Roleplaying, on a quest to create a perfect model
Organizations
None yet
Collections
11
models
79
TeeZee/2xbagel-dpo-34b-v0.2
Text Generation
•
Updated
•
1.76k
•
2
TeeZee/DarkForest-20B-v3.0
Text Generation
•
Updated
•
11
•
4
TeeZee/DarkForest-20B-v3.0-bpw8.0-h8-exl2
Text Generation
•
Updated
•
1
TeeZee/BigMaid-20B-v2.0
Text Generation
•
Updated
•
9
•
1
TeeZee/BigMaid-20B-v2.0-bpw8.0-h8-exl2
Text Generation
•
Updated
•
2
TeeZee/DarkForest-20B-v2.0
Text Generation
•
Updated
•
1.51k
•
23
TeeZee/NEBULA-23.8B-v1.0-bpw4.34-h8-exl2
Text Generation
•
Updated
•
3
TeeZee/NEBULA-23.8B-v1.0-bpw4.45-h8-exl2
Text Generation
•
Updated
•
2
TeeZee/Phi-3-mini-128k-instruct-LASER
Text Generation
•
Updated
•
1
TeeZee/Phi-3-mini-4k-instruct-LASER
Text Generation
•
Updated
•
10