trtd56 commited on
Commit
f98d7fe
1 Parent(s): db85165

Push Reinforce agent to the Hub

Browse files
README.md ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - CartPole-v1
4
+ - ppo
5
+ - deep-reinforcement-learning
6
+ - reinforcement-learning
7
+ - custom-implementation
8
+ - deep-rl-class
9
+ model-index:
10
+ - name: PPO
11
+ results:
12
+ - metrics:
13
+ - type: mean_reward
14
+ value: 166.60 +/- 82.10
15
+ name: mean_reward
16
+ task:
17
+ type: reinforcement-learning
18
+ name: reinforcement-learning
19
+ dataset:
20
+ name: CartPole-v1
21
+ type: CartPole-v1
22
+ ---
23
+
24
+ # PPO Agent Playing CartPole-v1
25
+
26
+ This is a trained model of a PPO agent playing CartPole-v1.
27
+ To learn to code your own PPO agent and train it Unit 8 of the Deep Reinforcement Learning Class: https://github.com/huggingface/deep-rl-class/tree/main/unit8
28
+
29
+ # Hyperparameters
30
+ ```python
31
+ {'exp_name': 'ppo'
32
+ 'seed': 1
33
+ 'torch_deterministic': True
34
+ 'cuda': True
35
+ 'track': False
36
+ 'wandb_project_name': 'cleanRL'
37
+ 'wandb_entity': None
38
+ 'capture_video': False
39
+ 'env_id': 'CartPole-v1'
40
+ 'total_timesteps': 50000
41
+ 'learning_rate': 0.00025
42
+ 'num_envs': 4
43
+ 'num_steps': 128
44
+ 'anneal_lr': True
45
+ 'gae': True
46
+ 'gamma': 0.99
47
+ 'gae_lambda': 0.95
48
+ 'num_minibatches': 4
49
+ 'update_epochs': 4
50
+ 'norm_adv': True
51
+ 'clip_coef': 0.2
52
+ 'clip_vloss': True
53
+ 'ent_coef': 0.01
54
+ 'vf_coef': 0.5
55
+ 'max_grad_norm': 0.5
56
+ 'target_kl': None
57
+ 'repo_id': 'trtd56/ppo-CartPole'
58
+ 'batch_size': 512
59
+ 'minibatch_size': 128}
60
+ ```
61
+
logs/events.out.tfevents.1659742919.005638f23f8c.1147.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e31ff59418ef04b477bde1c07798dcff740c3c5ec0d6b25292f0458be3d836d
3
+ size 106876
model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6075a5849c2bd12bd8927a607c41a702f1b6d5e787a01e070ab78c3d887ac7ca
3
+ size 40257
replay.mp4 ADDED
Binary file (21.9 kB). View file
 
results.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"env_id": "CartPole-v1", "mean_reward": 166.6, "std_reward": 82.0977466195023, "n_evaluation_episodes": 10, "eval_datetime": "2022-08-05T23:42:32.602128"}