CT-LLM-SFT-experiment-ckpts / Chinese_tiny_llm-zh_105k_en_26k

1 contributor

History: 12 commits

dododododo

Upload Chinese_tiny_llm-zh_105k_en_26k/zero_to_fp32.py with huggingface_hub

54979b5 verified 7 months ago

added_tokens.json

67 Bytes

Upload Chinese_tiny_llm-zh_105k_en_26k/added_tokens.json with huggingface_hub 7 months ago
config.json

709 Bytes

Upload Chinese_tiny_llm-zh_105k_en_26k/config.json with huggingface_hub 7 months ago
generation_config.json

111 Bytes

Upload Chinese_tiny_llm-zh_105k_en_26k/generation_config.json with huggingface_hub 7 months ago
model.safetensors

4.27 GB
LFS

Upload Chinese_tiny_llm-zh_105k_en_26k/model.safetensors with huggingface_hub 7 months ago
scheduler.pt
Pickle imports
- No problematic imports detected
What is a pickle import?
1.06 kB
LFS

Upload Chinese_tiny_llm-zh_105k_en_26k/scheduler.pt with huggingface_hub 7 months ago
special_tokens_map.json

628 Bytes

Upload Chinese_tiny_llm-zh_105k_en_26k/special_tokens_map.json with huggingface_hub 7 months ago
tokenization_baichuan.py

9.64 kB

Upload Chinese_tiny_llm-zh_105k_en_26k/tokenization_baichuan.py with huggingface_hub 7 months ago
tokenizer.model

2 MB
LFS

Upload Chinese_tiny_llm-zh_105k_en_26k/tokenizer.model with huggingface_hub 7 months ago
tokenizer_config.json

1.61 kB

Upload Chinese_tiny_llm-zh_105k_en_26k/tokenizer_config.json with huggingface_hub 7 months ago
trainer_state.json

373 kB

Upload Chinese_tiny_llm-zh_105k_en_26k/trainer_state.json with huggingface_hub 7 months ago
training_args.bin
Detected Pickle imports (11)
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.trainer_utils.HubStrategy",
- "transformers.training_args_seq2seq.Seq2SeqTrainingArguments",
- "transformers.trainer_utils.SchedulerType",
- "torch.bfloat16",
- "torch.device",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.OptimizerNames",
- "accelerate.state.PartialState"
How to fix it?
6.01 kB
LFS

Upload Chinese_tiny_llm-zh_105k_en_26k/training_args.bin with huggingface_hub 7 months ago
zero_to_fp32.py

24.3 kB

Upload Chinese_tiny_llm-zh_105k_en_26k/zero_to_fp32.py with huggingface_hub 7 months ago

Pickle imports

Detected Pickle imports (11)