aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions Community

optimum-neuron-cache / inference-cache-config

7 contributors

History: 4 commits

dacorvo's picture

dacorvo HF staff

Added Llama-70b batch_size 4 to inference cache

593822e verified 8 months ago