Edit model card
Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Downloads last month
18
Inference API
Input a message to start chatting with MarsupialAI/Llama-3SOME-8B-v1-BETA_6.9bpw_exl2.
This model can be loaded on Inference API (serverless).