End of training
0c242ee
verified
-
1.52 MB
End of training
zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (8)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.Tensor",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.float16",
- "torch._tensor._rebuild_from_type_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
180 MB
End of training
-
1.52 MB
Training in progress, step 26
zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (8)
- "torch.Tensor",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "torch.float16",
- "torch._tensor._rebuild_from_type_v2",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
180 MB
End of training
-
1.52 MB
Training in progress, step 26
zero_pp_rank_2_mp_rank_00_optim_states.pt
Detected Pickle imports (8)
- "torch.Tensor",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "torch.float16",
- "torch._tensor._rebuild_from_type_v2",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
180 MB
End of training
-
1.52 MB
Training in progress, step 26
zero_pp_rank_3_mp_rank_00_optim_states.pt
Detected Pickle imports (8)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch._tensor._rebuild_from_type_v2",
- "torch.Tensor",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.float16",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
180 MB
End of training
-
1.52 MB
Training in progress, step 26
zero_pp_rank_4_mp_rank_00_optim_states.pt
Detected Pickle imports (8)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch._tensor._rebuild_from_type_v2",
- "torch.Tensor",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.float16",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
180 MB
End of training
-
1.52 MB
Training in progress, step 26
zero_pp_rank_5_mp_rank_00_optim_states.pt
Detected Pickle imports (8)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.Tensor",
- "torch.FloatStorage",
- "torch.float16",
- "torch._tensor._rebuild_from_type_v2",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
180 MB
End of training
