File size: 341 Bytes
fe39385 5b96da5 fe39385 5b96da5 528cb3d 5b96da5 4ef2d01 5b96da5 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
---
language:
- en
tags:
- spiking neural netwroks
- text-generation
- rwkv
license: bsd-2-clause
datasets:
- bookcorpus
---
# SpikeGPT-BookCorpus
## Model Description
SpikeGPT-BookCorpus is a L18-D768 SpikeGPT model trained on BookCorpus. See https://github.com/ridgerchu/SpikeGPT for details.
ctx_len = 1024
n_layer = 18
n_embd = 768
|