7 contributors

History: 18 commits

x54-729

fast tokenizer and stream_chat fix

2d132f0 verified 8 months ago

.gitattributes

3.09 kB

use bin instead of safetensors with max shard of 2GB 8 months ago
README.md

10.9 kB

Update license in README.md 8 months ago
config.json

855 Bytes

update rope_scaling 8 months ago
configuration_internlm.py

7.49 kB

support flash attn 2 8 months ago
configuration_internlm2.py

7.02 kB

fast tokenizer and stream_chat fix 8 months ago
generation_config.json

132 Bytes

use bin instead of safetensors with max shard of 2GB 8 months ago
modeling_internlm2.py

60 kB

fast tokenizer and stream_chat fix 8 months ago
pytorch_model-00001-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.92 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00002-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00003-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00004-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00005-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00006-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00007-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00008-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00009-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00010-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00011-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00012-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00013-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00014-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00015-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00016-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00017-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00018-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00019-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00020-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.56 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00021-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.14 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model.bin.index.json

27.2 kB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
special_tokens_map.json

95 Bytes

initial commit internlm2-chat-20b model 8 months ago
tokenization_internlm.py

8.92 kB

initial commit internlm2-chat-20b model 8 months ago
tokenization_internlm2.py

8.81 kB

fast tokenizer and stream_chat fix 8 months ago
tokenization_internlm2_fast.py

7.72 kB

fast tokenizer and stream_chat fix 8 months ago
tokenizer.model

1.48 MB
LFS

initial commit internlm2-chat-20b model 8 months ago
tokenizer_config.json

2.18 kB

Update special tokens (#3) 8 months ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)