Text Generation
Transformers
Safetensors
English
stripedhyena
custom_code
Zymrael commited on
Commit
f6851b9
·
1 Parent(s): d2ec434

chore: kernel disclaimer

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -28,3 +28,7 @@ StripedHyena is a hybrid architecture composed of multi-head, grouped-query atte
28
  - Improvement to training and inference-optimal scaling laws, compared to optimized Transformer architectures such as Llama-2.
29
  - Trained on sequences of up to 32k, allowing it to process longer prompts.
30
 
 
 
 
 
 
28
  - Improvement to training and inference-optimal scaling laws, compared to optimized Transformer architectures such as Llama-2.
29
  - Trained on sequences of up to 32k, allowing it to process longer prompts.
30
 
31
+ ### Note
32
+
33
+ To use StripedHyena outside of the playground, you will need to install custom kernels. Please follow the instructions from the [standalone repository](https://github.com/togethercomputer/stripedhyena).
34
+