2 contributors

History: 32 commits

beomi

Fix Tokenizer bug on transfomers>4.34

cd41dda over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
LICENSE

8.16 kB

Create LICENSE over 1 year ago
README.md

8.62 kB

Add citation, Remove llama2 readme over 1 year ago
config.json

606 Bytes

Update model with >10B trained ckpt, change model type to bfloat16(match pretrain) over 1 year ago
generation_config.json

159 Bytes

Add 5B korean trained model, test version. over 1 year ago
model-00001-of-00015.safetensors

919 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00002-of-00015.safetensors

990 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00003-of-00015.safetensors

967 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00004-of-00015.safetensors

967 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00005-of-00015.safetensors

990 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00006-of-00015.safetensors

944 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00007-of-00015.safetensors

990 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00008-of-00015.safetensors

967 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00009-of-00015.safetensors

967 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00010-of-00015.safetensors

990 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00011-of-00015.safetensors

944 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00012-of-00015.safetensors

990 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00013-of-00015.safetensors

967 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00014-of-00015.safetensors

742 MB
LFS

Add >40B trained ckpt over 1 year ago
model-00015-of-00015.safetensors

380 MB
LFS

Add >40B trained ckpt over 1 year ago
model.safetensors.index.json

26.8 kB

Add 5B korean trained model, test version. over 1 year ago
pytorch_model-00001-of-00015.bin
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
919 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00002-of-00015.bin
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
990 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00003-of-00015.bin
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
967 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00004-of-00015.bin
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
967 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00005-of-00015.bin
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
990 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00006-of-00015.bin
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
944 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00007-of-00015.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
990 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00008-of-00015.bin
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
What is a pickle import?
967 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00009-of-00015.bin
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
967 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00010-of-00015.bin
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
990 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00011-of-00015.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
944 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00012-of-00015.bin
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
990 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00013-of-00015.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
967 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00014-of-00015.bin
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
742 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model-00015-of-00015.bin
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
380 MB
LFS

Add >40B trained ckpt over 1 year ago
pytorch_model.bin.index.json

26.8 kB

Add 5B korean trained model, test version. over 1 year ago
special_tokens_map.json

414 Bytes

Upload tokenizer over 1 year ago
tokenizer.json

2.55 MB

Fix Tokenizer bug on transfomers>4.34 over 1 year ago
tokenizer_config.json

842 Bytes

Fix Tokenizer bug on transfomers>4.34 over 1 year ago

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (3)