Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
microsoft
/
MInference
like
58
Running
on
Zero
App
Files
Files
Community
3
b215053
MInference
/
minference
/
configs
1 contributor
History:
1 commit
iofu728
Feature(MInference): build demo
43a7079
5 months ago
Llama_3_8B_Instruct_262k_kv_out_v32_fit_o_best_pattern.json
Safe
50.1 kB
Feature(MInference): build demo
5 months ago
Phi_3_mini_128k_instruct_kv_out_v32_fit_o_best_pattern.json
Safe
61.2 kB
Feature(MInference): build demo
5 months ago
Yi_9B_200k_kv_out_v32_fit_o_best_pattern.json
Safe
75.3 kB
Feature(MInference): build demo
5 months ago
model2path.py
Safe
634 Bytes
Feature(MInference): build demo
5 months ago