jrahn commited on
Commit
f4457ed
1 Parent(s): a8eeae4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -78,7 +78,7 @@ Total documents: 10,669,024
78
 
79
  <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
80
 
81
- Params: 150M -> 300MB / checkpoint
82
  Tokens: ~10B (10,287,579,136)
83
  Total training time: ~12hrs
84
  Hardware: 2x RTX4090
 
78
 
79
  <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
80
 
81
+ Params: 125M -> 250MB / checkpoint
82
  Tokens: ~10B (10,287,579,136)
83
  Total training time: ~12hrs
84
  Hardware: 2x RTX4090