aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions Community

optimum-neuron-cache / inference-cache-config

Commit History

Added teknium/OpenHermes-2.5-Mistral-7B

1518247
verified

dacorvo HF staff commited on Mar 8, 2024

Added Llama-70b batch_size 4 to inference cache

593822e
verified

dacorvo HF staff commited on Mar 8, 2024

Create mistral.json

b5d0afd
verified

philschmid commited on Mar 5, 2024

Create gpt2.json

3bdb891
verified

philschmid commited on Mar 5, 2024

Create inference-cache-config/llama.json

1960ccb
verified

philschmid commited on Mar 5, 2024