Add pipeline tag: text-generation (#1)

- Add pipeline tag: text-generation (3328523b3bd7cd186e4f70f230df5e896aa7b779)


Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>

README.md

@@ -1,23 +1,23 @@
 ---
-license: mit
-library_name: transformers
 base_model:
 - meta-llama/Llama-2-7b-hf
+library_name: transformers
+license: mit
+pipeline_tag: text-generation
 ---
+
 # TokenButler
 <!-- markdownlint-disable first-line-h1 -->
 <!-- markdownlint-disable html -->
 <!-- markdownlint-disable no-duplicate-header -->
 
-
-
 <div align="center">
   <img src="https://github.com/abdelfattah-lab/TokenButler/blob/main/figs/tokenbutlerlogo.png?raw=true" width="50%" alt="TokenButler" />
 </div>
 <hr>
 <div align="center" style="line-height: 1;">
   <!-- Paper Badge -->
-  <a href="https://github.com/abdelfattah-lab/TokenButler/blob/main/TokenButler_Draft.pdf" target="_blank" style="margin: 2px;">
+  <a href="https://arxiv.org/abs/2503.07518" target="_blank" style="margin: 2px;">
     <img alt="Paper" 
          src="https://img.shields.io/badge/Paper-View-orange?logo=readthedocs&logoColor=white" 
          style="display: inline-block; vertical-align: middle;"/>
@@ -25,18 +25,22 @@ base_model:
   <!-- GitHub Badge -->
   <a href="https://github.com/abdelfattah-lab/TokenButler" target="_blank" style="margin: 2px;">
     <img alt="GitHub" 
-         src="https://img.shields.io/badge/GitHub-Repo-black?logo=github&logoColor=white" 
+         src="https://img.shields.io/badge/GitHub-%23121011.svg?logo=github&logoColor=white" 
+         style="display: inline-block; vertical-align: middle;"/>
+  </a>
+  <!-- Huggingface Badge -->
+  <a href="https://huggingface.co/collections/akhauriyash/tokenbutler-67cf181b5762d0d60e5f312b" target="_blank" style="margin: 2px;">
+    <img alt="Huggingface" 
+         src="https://img.shields.io/badge/Hugging%20Face-FFD21E?logo=huggingface&logoColor=000" 
          style="display: inline-block; vertical-align: middle;"/>
   </a>
 </div>
 
 <br>
 
-
-
 The collection of TokenButler models can be found [here](https://huggingface.co/collections/akhauriyash/tokenbutler-67cf181b5762d0d60e5f312b). To run the `meta-llama/Llama-2-7b-hf` model, follow:
 
-```
+```python
 from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
 
 question = "If millionaires have butlers, why don't million dollar language models have a butler too? I think its because "
@@ -53,7 +57,7 @@ print(response[0]['generated_text'][len(question):])
 
 Note that the 'default' configured sparsity is 50%. Further, there is a 'sliding window' of 128 and 8 'anchor tokens'. To 'change' the sparsity, you can use the following function after loading the model. Please note that the 'fixed' is the only supported strategy at the moment, which 'fixes' the sparsity of each layer (except the first) at the 'pc' (percentage) mentioned. This can also be found at `test_hf.py`. Sliding window and anchor tokens can be changed in a similar manner.
 
-```
+```python
 def set_sparsity(model, sparsity):
     for module in model.modules():
         if module.__class__.__name__.__contains__("AttentionExperimental"):
@@ -64,7 +68,6 @@ def set_sparsity(model, sparsity):
 model = set_sparsity(model, "fixed_60pc")
 ```
 
-
 # Predictor Architecture
 <div align="center">
   <img src="https://github.com/abdelfattah-lab/TokenButler/blob/main/figs/mainfig.png?raw=true" width="100%" alt="TokenButlerFigure" />
@@ -73,4 +76,18 @@ model = set_sparsity(model, "fixed_60pc")
 # Custom Synthetic Task
 <div align="center">
   <img src="https://github.com/abdelfattah-lab/TokenButler/blob/main/figs/datasetfig.png?raw=true" width="100%" alt="Synthetic Tasks" />
-</div>
+</div>
+
+## Citation
+
+```bibtex
+@misc{akhauri2025tokenbutlertokenimportancepredictable,
+      title={TokenButler: Token Importance is Predictable}, 
+      author={Yash Akhauri and Ahmed F AbouElhamayed and Yifei Gao and Chi-Chih Chang and Nilesh Jain and Mohamed S. Abdelfattah},
+      year={2025},
+      eprint={2503.07518},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL},
+      url={https://arxiv.org/abs/2503.07518}, 
+}
+```