Update README.md

README.md

@@ -34,11 +34,11 @@ If you want to contact us & join us, you can  ✉️  to our team : <opendilab@p
 | Algo.\Env.   | [LunarLander](https://di-engine-docs.readthedocs.io/en/latest/13_envs/lunarlander.html) | [LunarLanderContinuous](https://di-engine-docs.readthedocs.io/en/latest/13_envs/lunarlander.html) | [BipedalWalker](https://di-engine-docs.readthedocs.io/en/latest/13_envs/bipedalwalker.html) | [Pendulum](https://di-engine-docs.readthedocs.io/en/latest/13_envs/pendulum.html) | [Pong](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [SpaceInvaders](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [Qbert](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [Hopper](https://di-engine-docs.readthedocs.io/en/latest/13_envs/mujoco.html) | [Halfcheetah](https://di-engine-docs.readthedocs.io/en/latest/13_envs/mujoco.html) | [Walker2d](https://di-engine-docs.readthedocs.io/en/latest/13_envs/mujoco.html) |
 | :-------------: | :-------------: | :-------------: | :------------------------: | :------------: | :--------------: | :------------: | :------------------: | :---------: | :---------: | :---------: |
 | [PPO](https://arxiv.org/pdf/1707.06347.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/LunarLanderContinuous-v2-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/QbertNoFrameskip-v4-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-PPO) |
-| [DQN](https://storage.googleapis.com/deepmind-media/dqn/DQNNaturePaper.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-DQN) | 🔓 | 🔓 | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-DQN) | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-DQN) | [✅](https://huggingface.co/OpenDILabCommunity/QbertNoFrameskip-v4-DQN) | 🔓 | 🔓 | 🔓 |
-| [C51](https://arxiv.org/pdf/1707.06887.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-C51) | 🔓 | 🔓 | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-C51) | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-C51) | [✅](https://huggingface.co/OpenDILabCommunity/QbertNoFrameskip-v4-C51) | 🔓 | 🔓 | 🔓 |
-| [DDPG](https://arxiv.org/pdf/1509.02971.pdf) | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-DDPG) | 🔓 | 🔓 | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-DDPG) |
-| [TD3](https://arxiv.org/pdf/1802.09477.pdf) | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-TD3) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-TD3) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-TD3) | 🔓 | 🔓 | 🔓 |[✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-TD3)  | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-TD3) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-TD3) |
-| [SAC](https://arxiv.org/pdf/1801.01290.pdf) | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-SAC) | 🔓 | 🔓 | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-SAC) |
+| [DQN](https://storage.googleapis.com/deepmind-media/dqn/DQNNaturePaper.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-DQN) | 🔒 | 🔒 | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-DQN) | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-DQN) | [✅](https://huggingface.co/OpenDILabCommunity/QbertNoFrameskip-v4-DQN) | 🔒 | 🔒 | 🔒 |
+| [C51](https://arxiv.org/pdf/1707.06887.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-C51) | 🔒 | 🔒 | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-C51) | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-C51) | [✅](https://huggingface.co/OpenDILabCommunity/QbertNoFrameskip-v4-C51) | 🔒 | 🔒 | 🔒 |
+| [DDPG](https://arxiv.org/pdf/1509.02971.pdf) | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-DDPG) | 🔒 | 🔒 | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-DDPG) |
+| [TD3](https://arxiv.org/pdf/1802.09477.pdf) | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-TD3) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-TD3) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-TD3) | 🔒 | 🔒 | 🔒 |[✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-TD3)  | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-TD3) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-TD3) |
+| [SAC](https://arxiv.org/pdf/1801.01290.pdf) | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-SAC) | 🔒 | 🔒 | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-SAC) |
 | [IMPALA](https://arxiv.org/pdf/1802.01561.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-IMPALA) |  |  |  | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-IMPALA)  | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-IMPALA)  |  |  |  |  |
 
 </details>
@@ -49,13 +49,13 @@ If you want to contact us & join us, you can  ✉️  to our team : <opendilab@p
 
 | Algo.\Env.   | [CartPole](https://di-engine-docs.readthedocs.io/en/latest/13_envs/cartpole.html) | [LunarLander](https://di-engine-docs.readthedocs.io/en/latest/13_envs/lunarlander.html) | [LunarLanderContinuous](https://di-engine-docs.readthedocs.io/en/latest/13_envs/lunarlander.html) | [Pendulum](https://di-engine-docs.readthedocs.io/en/latest/13_envs/pendulum.html) | [Pong](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [Breakout](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [MsPacman](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [TicTacToe]() | []() | []() |
 | :-------------: | :-------------: | :-------------: | :------------------------: | :------------: | :--------------: | :------------: | :------------------: | :---------: | :---------: | :---------: |
-| [AlphaZero](https://www.science.org/doi/10.1126/science.aar6404) |  |  |  |  |  |  |  | [✅](https://huggingface.co/OpenDILabCommunity/TicTacToe-play-with-bot-AlphaZero) |  |  |
-| [Sampled AlphaZero](https://www.science.org/doi/10.1126/science.aar6404) |  |  |  |  |  |  |  |  |  |  |
-| [Muzero](https://arxiv.org/abs/1911.08265) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-MuZero) |  | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/BreakoutNoFrameskip-v4-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/MsPacmanNoFrameskip-v4-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/TicTacToe-play-with-bot-MuZero) |  |  |
-| [EfficientZero](https://arxiv.org/abs/2111.00210) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-EfficientZero) | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-EfficientZero) |  | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-EfficientZero) |  |  | [✅](https://huggingface.co/OpenDILabCommunity/MsPacmanNoFrameskip-v4-EfficientZero) |  |  |  |
-| [Gumbel MuZero](https://openreview.net/pdf?id=bERaNdoegnO&) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-GumbelMuZero) |  |  |  |  |  |  |  |  |  |
-| [Sampled EfficientZero](https://arxiv.org/abs/2104.06303) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-SampledEfficientZero) |  |  |  |  |  |  |  |  |  |
-| [Stochastic MuZero](https://openreview.net/pdf?id=X6D9bAHhBQ1) |  |  |  |  |  |  |  |  |  |  |
+| [AlphaZero](https://www.science.org/doi/10.1126/science.aar6404) | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/TicTacToe-play-with-bot-AlphaZero) |  |  |
+| [Sampled AlphaZero](https://www.science.org/doi/10.1126/science.aar6404) | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 |  |  |  |
+| [MuZero](https://arxiv.org/abs/1911.08265) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-MuZero) | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/BreakoutNoFrameskip-v4-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/MsPacmanNoFrameskip-v4-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/TicTacToe-play-with-bot-MuZero) |  |  |
+| [EfficientZero](https://arxiv.org/abs/2111.00210) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-EfficientZero) | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-EfficientZero) | 🔒 | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-EfficientZero) |  |  | [✅](https://huggingface.co/OpenDILabCommunity/MsPacmanNoFrameskip-v4-EfficientZero) |  |  |  |
+| [Gumbel MuZero](https://openreview.net/pdf?id=bERaNdoegnO&) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-GumbelMuZero) |  | 🔒 |  |  | 🔒 | 🔒 |  |  |  |
+| [Sampled EfficientZero](https://arxiv.org/abs/2104.06303) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-SampledEfficientZero) |  |  |  |  |  |  | 🔒 |  |  |
+| [Stochastic MuZero](https://openreview.net/pdf?id=X6D9bAHhBQ1) | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 | 🔒 |
 
 </details>