CT-LLM-SFT-experiment-ckpts / Chinese_tiny_llm-zh_105k_en_105k

1 contributor

History: 10 commits

dododododo

Upload Chinese_tiny_llm-zh_105k_en_105k/tokenization_baichuan.py with huggingface_hub

250137c verified 4 months ago

added_tokens.json

67 Bytes

Upload Chinese_tiny_llm-zh_105k_en_105k/added_tokens.json with huggingface_hub 4 months ago
generation_config.json

111 Bytes

Upload Chinese_tiny_llm-zh_105k_en_105k/generation_config.json with huggingface_hub 4 months ago
model.safetensors
4.27 GB
LFS

Upload Chinese_tiny_llm-zh_105k_en_105k/model.safetensors with huggingface_hub 4 months ago
scheduler.pt

1.06 kB
LFS

Upload Chinese_tiny_llm-zh_105k_en_105k/scheduler.pt with huggingface_hub 4 months ago
special_tokens_map.json

628 Bytes

Upload Chinese_tiny_llm-zh_105k_en_105k/special_tokens_map.json with huggingface_hub 4 months ago
tokenization_baichuan.py

9.64 kB

Upload Chinese_tiny_llm-zh_105k_en_105k/tokenization_baichuan.py with huggingface_hub 4 months ago
tokenizer.model

2 MB
LFS

Upload Chinese_tiny_llm-zh_105k_en_105k/tokenizer.model with huggingface_hub 4 months ago
tokenizer_config.json

1.61 kB

Upload Chinese_tiny_llm-zh_105k_en_105k/tokenizer_config.json with huggingface_hub 4 months ago
trainer_state.json

597 kB

Upload Chinese_tiny_llm-zh_105k_en_105k/trainer_state.json with huggingface_hub 4 months ago
training_args.bin
Detected Pickle imports (11)
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.trainer_utils.HubStrategy",
- "transformers.training_args_seq2seq.Seq2SeqTrainingArguments",
- "transformers.trainer_utils.SchedulerType",
- "torch.bfloat16",
- "torch.device",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.OptimizerNames",
- "accelerate.state.PartialState"
How to fix it?
6.01 kB
LFS

Upload Chinese_tiny_llm-zh_105k_en_105k/training_args.bin with huggingface_hub 4 months ago

Detected Pickle imports (11)