casperhansen
/

llama-3-70b-instruct-awq

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Update generation_config.json

#3

by alugowski - opened Apr 19

base: refs/heads/main

←

from: refs/pr/3

Discussion Files changed

Apr 19

Pull in upstream second stop token.

Fixes issue where inference does not stop.

See upstream: https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct/blob/main/generation_config.json

Update generation_config.json119cfca4

casperhansen changed pull request status to closed Apr 19

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment