Update README.md
Browse files
README.md
CHANGED
|
@@ -43,7 +43,7 @@ For a full breakdown on evaluation metrics and performance impact please refer t
|
|
| 43 |
| Baseline | 82.00 | 77.90 | 80.40 | 54.56 | 67.90 | 70.63 | 82.56 | **73.71** |
|
| 44 |
| 50% SingleInputKV | 80.38 | 78.22 | 79.30 | 54.54 | 67.30 | 69.73 | 79.45 | **72.70** |
|
| 45 |
|
| 46 |
-
##
|
| 47 |
|
| 48 |
Instructions on how to use vLLM for both evaluation and performance benchmarks:
|
| 49 |
https://github.com/Snowflake-Labs/vllm/tree/swiftkv/examples/swiftkv
|
|
|
|
| 43 |
| Baseline | 82.00 | 77.90 | 80.40 | 54.56 | 67.90 | 70.63 | 82.56 | **73.71** |
|
| 44 |
| 50% SingleInputKV | 80.38 | 78.22 | 79.30 | 54.54 | 67.30 | 69.73 | 79.45 | **72.70** |
|
| 45 |
|
| 46 |
+
## Get started by serving SwiftKV on vLLM
|
| 47 |
|
| 48 |
Instructions on how to use vLLM for both evaluation and performance benchmarks:
|
| 49 |
https://github.com/Snowflake-Labs/vllm/tree/swiftkv/examples/swiftkv
|