File size: 297 Bytes
4f948a1 4ff4712 3efa064 0d157f6 4f948a1 0d157f6 77aa4f2 6de87a0 77aa4f2 6de87a0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
license: cc-by-sa-4.0
datasets:
- facebook/belebele
---
Pretrained toy model. Made with Andrej Karpathy's NanoGPT, ~2023. Trained on part of Tagalog portion of Belebele.
Parameters:
* batch_size = 64
* block_size = 256
* n_layer = 8
* n_head = 8
* n_embd = 768
Everything else is left as is. |