SAEs for use with the SAELens library
This repository contains the following SAEs:
- blocks.1.hook_resid_post/l0_15/ortho_10k/threshold_0.5
- blocks.1.hook_resid_post/l0_21/ortho_10k/threshold_0.3
- blocks.1.hook_resid_post/l0_13/ortho_10k/threshold_0.5
- blocks.1.hook_resid_post/l0_27/ortho_10k/threshold_0.7
Load these SAEs using SAELens as below:
from sae_lens import SAE
sae, cfg_dict, sparsity = SAE.from_pretrained("chanind/sae-gemma-2-2b-tied-jumprelu-act-ortho", "<sae_id>")