Single SAEs trained on the residual stream activation vectors from every transformer layer simultaneously: https://arxiv.org/abs/2409.04185
Tim Lawson
tim-lawson
AI & ML interests
Mechanistic interpretability, language modelling, semantics
Recent Activity
updated
a model
about 19 hours ago
tim-lawson/mlsae-pythia-410m-deduped-x64-k32-tfm
updated
a model
about 21 hours ago
tim-lawson/sae-pythia-410m-deduped-x64-k32-layers-21
updated
a model
about 21 hours ago
tim-lawson/sae-pythia-410m-deduped-x64-k32-tfm-layers-21
Organizations
None yet
Collections
6
Papers
1
models
199
tim-lawson/mlsae-pythia-410m-deduped-x64-k32-tfm
Updated
•
51
tim-lawson/sae-pythia-410m-deduped-x64-k32-layers-21
Updated
tim-lawson/sae-pythia-410m-deduped-x64-k32-tfm-layers-21
Updated
•
2
tim-lawson/sae-pythia-410m-deduped-x64-k32-layers-9
Updated
tim-lawson/sae-pythia-410m-deduped-x64-k32-tfm-layers-9
Updated
tim-lawson/sae-pythia-410m-deduped-x64-k32-layers-10
Updated
•
2
tim-lawson/sae-pythia-410m-deduped-x64-k32-tfm-layers-10
Updated
tim-lawson/sae-pythia-410m-deduped-x64-k32-layers-22
Updated
tim-lawson/sae-pythia-410m-deduped-x64-k32-tfm-layers-22
Updated
tim-lawson/mlsae-gemma-2-2b-x64-k32
Updated
•
11
datasets
60
tim-lawson/mlsae-Llama-3.2-3B-x64-k32-dists
Viewer
•
Updated
•
197k
•
40
tim-lawson/mlsae-gemma-2-2b-x64-k32-dists
Viewer
•
Updated
•
147k
•
44
tim-lawson/mlsae-gpt2-x64-k32-dists
Preview
•
Updated
•
32
tim-lawson/sae-pythia-160m-deduped-x64-k32-tfm-layers-11-dists
Viewer
•
Updated
•
49.2k
•
30
tim-lawson/sae-pythia-160m-deduped-x64-k32-tfm-layers-10-dists
Viewer
•
Updated
•
49.2k
•
34
tim-lawson/sae-pythia-160m-deduped-x64-k32-tfm-layers-8-dists
Viewer
•
Updated
•
49.2k
•
38
tim-lawson/sae-pythia-160m-deduped-x64-k32-tfm-layers-9-dists
Viewer
•
Updated
•
49.2k
•
31
tim-lawson/sae-pythia-160m-deduped-x64-k32-tfm-layers-7-dists
Viewer
•
Updated
•
49.2k
•
30
tim-lawson/sae-pythia-160m-deduped-x64-k32-tfm-layers-5-dists
Viewer
•
Updated
•
49.2k
•
30
tim-lawson/sae-pythia-160m-deduped-x64-k32-tfm-layers-6-dists
Viewer
•
Updated
•
49.2k
•
32