Commits · aws-neuron/optimum-neuron-cache

Added Llama-70b batch_size 4 to inference cache

593822e
verified

dacorvo HF staff commited on Mar 8

Synchronizing local compiler cache.

608a595
verified

dacorvo HF staff commited on Mar 8

Synchronizing local compiler cache.

357b3b9
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

76f544f
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

cc67271
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

d1d6248
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

042b17d
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

0690473
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

2bb801f
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

32e98a1
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

b623c53
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

e53253c
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

37b4a65
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

3f9e268
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

e04b5e9
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

8b5452b
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

20f5c81
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

ed40157
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

2ffd687
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

ffa803e
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

23056cb
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

994a16a
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

6474f75
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

c7d73e7
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

1531ad8
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

0d9af3a
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

2983640
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

367f9f0
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

65ee443
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

b4432fb
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

1dac733
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

0e8a2c2
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

86bb6c0
verified

dacorvo HF staff commited on Mar 7

Synchronizing local compiler cache.

4769999
verified

dacorvo HF staff commited on Mar 6

Synchronizing local compiler cache.

c303216
verified

philschmid HF staff commited on Mar 5

Synchronizing local compiler cache.

c28d054
verified

philschmid HF staff commited on Mar 5

Create mistral.json

b5d0afd
verified

philschmid HF staff commited on Mar 5

Create gpt2.json

3bdb891
verified

philschmid HF staff commited on Mar 5

Create inference-cache-config/llama.json

1960ccb
verified

philschmid HF staff commited on Mar 5

Synchronizing local compiler cache.

c813817
verified

philschmid HF staff commited on Mar 5

Synchronizing local compiler cache.

944d15b
verified

philschmid HF staff commited on Mar 5

Synchronizing local compiler cache.

b5e2606
verified

philschmid HF staff commited on Mar 5

Synchronizing local compiler cache.

34d6a12
verified

dacorvo HF staff commited on Mar 5

Synchronizing local compiler cache.

45ccc4c
verified

philschmid HF staff commited on Mar 5

Synchronizing local compiler cache.

0944c5c
verified

philschmid HF staff commited on Mar 5

Synchronizing local compiler cache.

ac34d64
verified

philschmid HF staff commited on Mar 5

Synchronizing local compiler cache.

5e98af4
verified

philschmid HF staff commited on Mar 5

Synchronizing local compiler cache.

0dc06e7
verified

5cp commited on Mar 4

Synchronizing local compiler cache.

2fb280c
verified

5cp commited on Feb 28

Synchronizing local compiler cache.

1279d34
verified

5cp commited on Feb 27

Commit History

Added Llama-70b batch_size 4 to inference cache 593822e verified

Synchronizing local compiler cache. 608a595 verified

Synchronizing local compiler cache. 357b3b9 verified

Synchronizing local compiler cache. 76f544f verified

Synchronizing local compiler cache. cc67271 verified

Synchronizing local compiler cache. d1d6248 verified

Synchronizing local compiler cache. 042b17d verified

Synchronizing local compiler cache. 0690473 verified

Synchronizing local compiler cache. 2bb801f verified

Synchronizing local compiler cache. 32e98a1 verified

Synchronizing local compiler cache. b623c53 verified

Synchronizing local compiler cache. e53253c verified

Synchronizing local compiler cache. 37b4a65 verified

Synchronizing local compiler cache. 3f9e268 verified

Synchronizing local compiler cache. e04b5e9 verified

Synchronizing local compiler cache. 8b5452b verified

Synchronizing local compiler cache. 20f5c81 verified

Synchronizing local compiler cache. ed40157 verified

Synchronizing local compiler cache. 2ffd687 verified

Synchronizing local compiler cache. ffa803e verified

Synchronizing local compiler cache. 23056cb verified

Synchronizing local compiler cache. 994a16a verified

Synchronizing local compiler cache. 6474f75 verified

Synchronizing local compiler cache. c7d73e7 verified

Synchronizing local compiler cache. 1531ad8 verified

Synchronizing local compiler cache. 0d9af3a verified

Synchronizing local compiler cache. 2983640 verified

Synchronizing local compiler cache. 367f9f0 verified

Synchronizing local compiler cache. 65ee443 verified

Synchronizing local compiler cache. b4432fb verified

Synchronizing local compiler cache. 1dac733 verified

Synchronizing local compiler cache. 0e8a2c2 verified

Synchronizing local compiler cache. 86bb6c0 verified

Synchronizing local compiler cache. 4769999 verified

Synchronizing local compiler cache. c303216 verified

Synchronizing local compiler cache. c28d054 verified

Create mistral.json b5d0afd verified

Create gpt2.json 3bdb891 verified

Create inference-cache-config/llama.json 1960ccb verified

Synchronizing local compiler cache. c813817 verified

Synchronizing local compiler cache. 944d15b verified

Synchronizing local compiler cache. b5e2606 verified

Synchronizing local compiler cache. 34d6a12 verified

Synchronizing local compiler cache. 45ccc4c verified

Synchronizing local compiler cache. 0944c5c verified

Synchronizing local compiler cache. ac34d64 verified

Synchronizing local compiler cache. 5e98af4 verified

Synchronizing local compiler cache. 0dc06e7 verified

Synchronizing local compiler cache. 2fb280c verified

Synchronizing local compiler cache. 1279d34 verified

Added Llama-70b batch_size 4 to inference cache

593822e
verified

Synchronizing local compiler cache.

608a595
verified

Synchronizing local compiler cache.

357b3b9
verified

Synchronizing local compiler cache.

76f544f
verified

Synchronizing local compiler cache.

cc67271
verified

Synchronizing local compiler cache.

d1d6248
verified

Synchronizing local compiler cache.

042b17d
verified

Synchronizing local compiler cache.

0690473
verified

Synchronizing local compiler cache.

2bb801f
verified

Synchronizing local compiler cache.

32e98a1
verified

Synchronizing local compiler cache.

b623c53
verified

Synchronizing local compiler cache.

e53253c
verified

Synchronizing local compiler cache.

37b4a65
verified

Synchronizing local compiler cache.

3f9e268
verified

Synchronizing local compiler cache.

e04b5e9
verified

Synchronizing local compiler cache.

8b5452b
verified

Synchronizing local compiler cache.

20f5c81
verified

Synchronizing local compiler cache.

ed40157
verified

Synchronizing local compiler cache.

2ffd687
verified

Synchronizing local compiler cache.

ffa803e
verified

Synchronizing local compiler cache.

23056cb
verified

Synchronizing local compiler cache.

994a16a
verified

Synchronizing local compiler cache.

6474f75
verified

Synchronizing local compiler cache.

c7d73e7
verified

Synchronizing local compiler cache.

1531ad8
verified

Synchronizing local compiler cache.

0d9af3a
verified

Synchronizing local compiler cache.

2983640
verified

Synchronizing local compiler cache.

367f9f0
verified

Synchronizing local compiler cache.

65ee443
verified

Synchronizing local compiler cache.

b4432fb
verified

Synchronizing local compiler cache.

1dac733
verified

Synchronizing local compiler cache.

0e8a2c2
verified

Synchronizing local compiler cache.

86bb6c0
verified

Synchronizing local compiler cache.

4769999
verified

Synchronizing local compiler cache.

c303216
verified

Synchronizing local compiler cache.

c28d054
verified

Create mistral.json

b5d0afd
verified

Create gpt2.json

3bdb891
verified

Create inference-cache-config/llama.json

1960ccb
verified

Synchronizing local compiler cache.

c813817
verified

Synchronizing local compiler cache.

944d15b
verified

Synchronizing local compiler cache.

b5e2606
verified

Synchronizing local compiler cache.

34d6a12
verified

Synchronizing local compiler cache.

45ccc4c
verified

Synchronizing local compiler cache.

0944c5c
verified

Synchronizing local compiler cache.

ac34d64
verified

Synchronizing local compiler cache.

5e98af4
verified

Synchronizing local compiler cache.

0dc06e7
verified

Synchronizing local compiler cache.

2fb280c
verified

Synchronizing local compiler cache.

1279d34
verified