metadata
license: mit
datasets:
- togethercomputer/RedPajama-Data-1T-Sample
language:
- en
library_name: transformers
This is a set of sparse autoencoders (SAEs) trained on the residual stream of Llama 3 8B using the RedPajama corpus. The SAEs are organized by layer, and can be loaded using the EleutherAI sae library.