The Impact of Hyperparameters on Large Language Model Inference Performance: An Evaluation of vLLM and HuggingFace Pipelines Paper ⢠2408.01050 ⢠Published Aug 2, 2024 ⢠8