1 contributor

History: 26 commits

tanliboy

Fix bos with "<|endoftext|>"

c67f2b6 verified 5 months ago

runs
End of training 5 months ago
.gitattributes

1.52 kB

initial commit 5 months ago
README.md

1.58 kB

End of training 5 months ago
added_tokens.json

80 Bytes

Training in progress, step 100 5 months ago
all_results.json

401 Bytes

End of training 5 months ago
config.json

700 Bytes

End of training 5 months ago
eval_results.json

187 Bytes

End of training 5 months ago
generation_config.json

117 Bytes

Model save 5 months ago
merges.txt

1.67 MB

Training in progress, step 100 5 months ago
model-00001-of-00004.safetensors

4.88 GB
LFS

Model save 5 months ago
model-00002-of-00004.safetensors

4.93 GB
LFS

Model save 5 months ago
model-00003-of-00004.safetensors

4.33 GB
LFS

Model save 5 months ago
model-00004-of-00004.safetensors

1.09 GB
LFS

Model save 5 months ago
model.safetensors.index.json

27.8 kB

Model save 5 months ago
special_tokens_map.json

370 Bytes

Training in progress, step 100 5 months ago
tokenizer.json

7.03 MB

Training in progress, step 100 5 months ago
tokenizer_config.json

1.4 kB

Fix bos with "<|endoftext|>" 5 months ago
train_results.json

234 Bytes

Model save 5 months ago
trainer_state.json

34.2 kB

Model save 5 months ago
training_args.bin
Detected Pickle imports (13)
- "transformers.training_args.OptimizerNames",
- "torch.bfloat16",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "torch.device",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "transformers.integrations.deepspeed.HfDeepSpeedConfig",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.IntervalStrategy",
- "alignment.configs.SFTConfig",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SchedulerType"
How to fix it?
6.2 kB
LFS

Training in progress, step 100 5 months ago
vocab.json

2.78 MB

Training in progress, step 100 5 months ago

Detected Pickle imports (13)