ko-embedding-v1-preview-241130 / checkpoint-35

1 contributor

History: 20 commits

sigridjineth

Upload checkpoint-35/global_step35/mp_rank_00_model_states.pt with huggingface_hub

45a213c verified about 1 month ago

global_step35
Upload checkpoint-35/global_step35/mp_rank_00_model_states.pt with huggingface_hub about 1 month ago
colbert_linear.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.1 MB
LFS

Upload checkpoint-35/colbert_linear.pt with huggingface_hub about 1 month ago
config.json

787 Bytes

Upload checkpoint-35/config.json with huggingface_hub about 1 month ago
latest

13 Bytes

Upload checkpoint-35/latest with huggingface_hub about 1 month ago
model.safetensors

1.14 GB
LFS

Upload checkpoint-35/model.safetensors with huggingface_hub about 1 month ago
rng_state_0.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype"
How to fix it?
16 kB
LFS

Upload checkpoint-35/rng_state_0.pth with huggingface_hub about 1 month ago
rng_state_1.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype"
How to fix it?
16 kB
LFS

Upload checkpoint-35/rng_state_1.pth with huggingface_hub about 1 month ago
rng_state_2.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype"
How to fix it?
16 kB
LFS

Upload checkpoint-35/rng_state_2.pth with huggingface_hub about 1 month ago
rng_state_3.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype"
How to fix it?
16 kB
LFS

Upload checkpoint-35/rng_state_3.pth with huggingface_hub about 1 month ago
rng_state_4.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype"
How to fix it?
16 kB
LFS

Upload checkpoint-35/rng_state_4.pth with huggingface_hub about 1 month ago
rng_state_5.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype"
How to fix it?
16 kB
LFS

Upload checkpoint-35/rng_state_5.pth with huggingface_hub about 1 month ago
rng_state_6.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype"
How to fix it?
16 kB
LFS

Upload checkpoint-35/rng_state_6.pth with huggingface_hub about 1 month ago
rng_state_7.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "numpy.dtype"
How to fix it?
16 kB
LFS

Upload checkpoint-35/rng_state_7.pth with huggingface_hub about 1 month ago
sentencepiece.bpe.model

5.07 MB
LFS

Upload checkpoint-35/sentencepiece.bpe.model with huggingface_hub about 1 month ago
sparse_linear.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
3.52 kB
LFS

Upload checkpoint-35/sparse_linear.pt with huggingface_hub about 1 month ago
special_tokens_map.json

964 Bytes

Upload checkpoint-35/special_tokens_map.json with huggingface_hub about 1 month ago
tokenizer.json

17.1 MB
LFS

Upload checkpoint-35/tokenizer.json with huggingface_hub about 1 month ago
tokenizer_config.json

1.17 kB

Upload checkpoint-35/tokenizer_config.json with huggingface_hub about 1 month ago
trainer_state.json

6.45 kB

Upload checkpoint-35/trainer_state.json with huggingface_hub about 1 month ago
training_args.bin
Detected Pickle imports (12)
- "torch.device",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "FlagEmbedding.finetune.embedder.encoder_only.m3.arguments.EncoderOnlyEmbedderM3TrainingArguments",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "accelerate.state.PartialState",
- "torch.float16",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.OptimizerNames",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "transformers.trainer_utils.SchedulerType"
How to fix it?
7.03 kB
LFS

Upload checkpoint-35/training_args.bin with huggingface_hub about 1 month ago

Detected Pickle imports (3)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (3)

Detected Pickle imports (12)