aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions Community

optimum-neuron-cache / inference-cache-config /mistral.json

Commit History

Update inference-cache-config/mistral.json

8ea3b57
verified

dacorvo HF staff commited on Sep 27

Update inference-cache-config/mistral.json

6c4c814
verified

dacorvo HF staff commited on Sep 26

Add more batch_size for mistral on smaller instances

545cd4d
verified

dacorvo HF staff commited on May 31

Update Mistral cached configurations

ee458f5
verified

dacorvo HF staff commited on May 31

Add Mistral-v2

20e585f
verified

dacorvo HF staff commited on Apr 9

Remove variants from main mistral config

ef07aca
verified

dacorvo HF staff commited on Mar 21

Added teknium/OpenHermes-2.5-Mistral-7B

1518247
verified

dacorvo HF staff commited on Mar 8

Create mistral.json

b5d0afd
verified

philschmid HF staff commited on Mar 5