ArthurConmyGDM
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,7 @@ license: cc-by-nc-4.0
|
|
4 |
|
5 |
# Gemma Scope:
|
6 |
|
7 |
-
!(
|
8 |
|
9 |
This is a landing page for **Gemma Scope**, a comprehensive, open suite of sparse autoencoders for Gemma 2 9B and 2B. Sparse Autoencoders are a "microscope" of sorts that can help us break down a model’s internal activations into the underlying concepts, just as biologists use microscopes to study the individual cells of plants and animals.
|
10 |
|
@@ -14,7 +14,7 @@ This is a landing page for **Gemma Scope**, a comprehensive, open suite of spars
|
|
14 |
- Check out the [interactive Gemma Scope demo](https://www.neuronpedia.org/gemma-scope) made by [Neuronpedia](https://www.neuronpedia.org/).
|
15 |
- Check out our [Google Colab notebook tutorial](https://colab.research.google.com/drive/17dQFYUYnuKnP6OwQPH9v_GSYUW5aj-Rp?ts=66a77041) for how to use Gemma Scope.
|
16 |
- Read the Gemma Scope technical report (TODO link).
|
17 |
-
- Check out Mishax,
|
18 |
|
19 |
# Quick start:
|
20 |
|
|
|
4 |
|
5 |
# Gemma Scope:
|
6 |
|
7 |
+
![](gemma_scope.gif)
|
8 |
|
9 |
This is a landing page for **Gemma Scope**, a comprehensive, open suite of sparse autoencoders for Gemma 2 9B and 2B. Sparse Autoencoders are a "microscope" of sorts that can help us break down a model’s internal activations into the underlying concepts, just as biologists use microscopes to study the individual cells of plants and animals.
|
10 |
|
|
|
14 |
- Check out the [interactive Gemma Scope demo](https://www.neuronpedia.org/gemma-scope) made by [Neuronpedia](https://www.neuronpedia.org/).
|
15 |
- Check out our [Google Colab notebook tutorial](https://colab.research.google.com/drive/17dQFYUYnuKnP6OwQPH9v_GSYUW5aj-Rp?ts=66a77041) for how to use Gemma Scope.
|
16 |
- Read the Gemma Scope technical report (TODO link).
|
17 |
+
- Check out [Mishax](https://github.com/google-deepmind/mishax), a GDM internal tool that we used in this projec to exposing the internal activations inside Gemma 2 models.
|
18 |
|
19 |
# Quick start:
|
20 |
|