3 contributors

History: 21 commits

yangapku

update batch inference

33ae36b 11 months ago

assets
update modeling_qwen.py 12 months ago
examples
update react_prompt.md 11 months ago
.gitattributes

1.52 kB

update model 12 months ago
LICENSE

6.9 kB

update batch infer 12 months ago
NOTICE

2.7 kB

update batch infer 12 months ago
README.md

32.9 kB

Update README.md 11 months ago
cache_autogptq_cuda_256.cpp

8.4 kB

update kernels 12 months ago
cache_autogptq_cuda_kernel_256.cu

52 kB

update kernels 12 months ago
config.json

910 Bytes

update model 12 months ago
configuration_qwen.py

2.35 kB

softmax_in_fp32 11 months ago
cpp_kernels.py

1.92 kB

update kernels 12 months ago
generation_config.json

249 Bytes

update default generate hyperparams 11 months ago
model-00001-of-00008.safetensors

1.96 GB
LFS

update model 12 months ago
model-00002-of-00008.safetensors

2.02 GB
LFS

update model 12 months ago
model-00003-of-00008.safetensors

2.02 GB
LFS

update model 12 months ago
model-00004-of-00008.safetensors

2.02 GB
LFS

update model 12 months ago
model-00005-of-00008.safetensors

2.02 GB
LFS

update model 12 months ago
model-00006-of-00008.safetensors

2.02 GB
LFS

update model 12 months ago
model-00007-of-00008.safetensors

2.02 GB
LFS

update model 12 months ago
model-00008-of-00008.safetensors

1.33 GB
LFS

update model 12 months ago
model.safetensors.index.json

19.5 kB

update model 12 months ago
modeling_qwen.py

57.6 kB

update batch inference 11 months ago
qwen.tiktoken

2.56 MB

update model 12 months ago
qwen_generation_utils.py

14.6 kB

update model 12 months ago
tokenization_qwen.py

9.62 kB

update tokenization.py 11 months ago
tokenizer_config.json

173 Bytes

format 11 months ago