heriosousa commited on
Commit
b181dd2
1 Parent(s): ed21741

Push Reinforce agent to the Hub

Browse files
README.md ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - CartPole-v1
4
+ - ppo
5
+ - deep-reinforcement-learning
6
+ - reinforcement-learning
7
+ - custom-implementation
8
+ - deep-rl-class
9
+ model-index:
10
+ - name: PPO
11
+ results:
12
+ - task:
13
+ type: reinforcement-learning
14
+ name: reinforcement-learning
15
+ dataset:
16
+ name: CartPole-v1
17
+ type: CartPole-v1
18
+ metrics:
19
+ - type: mean_reward
20
+ value: 154.70 +/- 96.81
21
+ name: mean_reward
22
+ verified: false
23
+ ---
24
+
25
+ # PPO Agent Playing CartPole-v1
26
+
27
+ This is a trained model of a PPO agent playing CartPole-v1.
28
+ To learn to code your own PPO agent and train it Unit 8 of the Deep Reinforcement Learning Class: https://github.com/huggingface/deep-rl-class/tree/main/unit8
29
+
30
+ # Hyperparameters
31
+ ```python
32
+ {'exp_name': '__file__'
33
+ 'seed': 1
34
+ 'torch_deterministic': True
35
+ 'cuda': True
36
+ 'track': False
37
+ 'wandb_project_name': 'cleanRL'
38
+ 'wandb_entity': None
39
+ 'capture_video': False
40
+ 'env_id': 'CartPole-v1'
41
+ 'total_timesteps': 50000
42
+ 'learning_rate': 0.00025
43
+ 'num_envs': 4
44
+ 'num_steps': 128
45
+ 'anneal_lr': True
46
+ 'gae': True
47
+ 'gamma': 0.99
48
+ 'gae_lambda': 0.95
49
+ 'num_minibatches': 4
50
+ 'update_epochs': 4
51
+ 'norm_adv': True
52
+ 'clip_coef': 0.2
53
+ 'clip_vloss': True
54
+ 'ent_coef': 0.01
55
+ 'vf_coef': 0.5
56
+ 'max_grad_norm': 0.5
57
+ 'target_kl': None
58
+ 'f': '/root/.local/share/jupyter/runtime/kernel-9c96fe8c-041c-4681-aa25-a76703c94d0d.json'
59
+ 'repo_id': 'heriosousa/ppo-CartPole-v1'
60
+ 'batch_size': 512
61
+ 'minibatch_size': 128}
62
+ ```
63
+
logs/events.out.tfevents.1666034883.76ffa0929498.1430.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08b748b3f00b792d8d3a9c9579140cacedcdc8e9dd7803a9f705b4c92274cbeb
3
+ size 107638
model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd9ff9de82386b7ee63d81b281ffbcf2eafcb8f250454b49d0c2209fb0b402c7
3
+ size 40257
replay.mp4 ADDED
Binary file (10.2 kB). View file
 
results.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"env_id": "CartPole-v1", "mean_reward": 154.7, "std_reward": 96.80501020091883, "n_evaluation_episodes": 10, "eval_datetime": "2022-10-17T19:28:34.296936"}