PrunaAI
/

cognitivecomputations-dolphin-2.9-llama3-8b-256k-AWQ-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

cognitivecomputations-dolphin-2.9-llama3-8b-256k-AWQ-4bit-smashed / smash_config.json

Commit History

1ff3d25cf63eeb7d4db79ea99406cccfb60dae0b5906cd6b07533efe2eb32261

ebbf76a
verified

sharpenb commited on Apr 29

Upload folder using huggingface_hub (#1)

dcc81e2
verified

sharpenb commited on Apr 29