Add BERTopic model

README.md

@@ -0,0 +1,82 @@
+
+---
+tags:
+- bertopic
+library_name: bertopic
+pipeline_tag: text-classification
+---
+
+# tweets_deforestation_all__RT_exclude_biggerclusters
+
+This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model. 
+BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets. 
+
+## Usage 
+
+To use this model, please install BERTopic:
+
+```
+pip install -U bertopic
+```
+
+You can use the model as follows:
+
+```python
+from bertopic import BERTopic
+topic_model = BERTopic.load("thiagoquilice/tweets_deforestation_all__RT_exclude_biggerclusters")
+
+topic_model.get_topic_info()
+```
+
+## Topic overview
+
+* Number of topics: 13
+* Number of training documents: 389209
+
+<details>
+  <summary>Click here for an overview of all topics.</summary>
+  
+  | Topic ID | Topic Keywords | Topic Frequency | Label | 
+|----------|----------------|-----------------|-------| 
+| -1 | desmatamento - amazônia - na - de - em | 2371 | Deforestation in the Amazon | 
+| 0 | que - de - do - desmatamento - amazônia | 127251 | Deforestation in the Amazon | 
+| 1 | petição - assine - impedir - exploração - via | 114185 | Protect the Amazon Rainforest | 
+| 2 | soja - de - cerrado - que - da | 46552 | Soya in the Cerrado region | 
+| 3 | em - de - na - km - desmatamento | 33829 | Deforestation in the Amazon | 
+| 4 | que - de - não - do - com | 17702 | Political and environmental issues in Brazil | 
+| 5 | menor - cai - na - desmatamento - amazônia | 8855 | Deforestation in the Amazon decreases and reaches lower rates in recent years | 
+| 6 | impedir - exploração - petição - via - assine | 8611 | Protect the Amazon: Sign the Petition | 
+| 7 | cerrado - do - de - desmatamento - no | 7695 | Deforestation in the Cerrado region | 
+| 8 |  -  -  -  -  | 7163 | "Technology trends and their impact on society" | 
+| 9 | petition - sign - the - impedir - exploração | 6901 | Protect the Amazon Rainforest | 
+| 10 | tamanho - sp - leia - quase - legal | 5157 | Deforestation in the Amazon | 
+| 11 | in - partners - best - raze - loot | 2937 | Deforestation and exploitation of indigenous lands |
+  
+</details>
+
+## Training hyperparameters
+
+* calculate_probabilities: False
+* language: None
+* low_memory: False
+* min_topic_size: 10
+* n_gram_range: (1, 1)
+* nr_topics: None
+* seed_topic_list: None
+* top_n_words: 10
+* verbose: True
+* zeroshot_min_similarity: 0.7
+* zeroshot_topic_list: None
+
+## Framework versions
+
+* Numpy: 1.25.2
+* HDBSCAN: 0.8.33
+* UMAP: 0.5.6
+* Pandas: 2.0.3
+* Scikit-Learn: 1.2.2
+* Sentence-transformers: 2.7.0
+* Transformers: 4.41.0
+* Numba: 0.58.1
+* Plotly: 5.15.0
+* Python: 3.10.12

config.json

@@ -0,0 +1,16 @@
+{
+  "calculate_probabilities": false,
+  "language": null,
+  "low_memory": false,
+  "min_topic_size": 10,
+  "n_gram_range": [
+    1,
+    1
+  ],
+  "nr_topics": null,
+  "seed_topic_list": null,
+  "top_n_words": 10,
+  "verbose": true,
+  "zeroshot_min_similarity": 0.7,
+  "zeroshot_topic_list": null
+}

ctfidf.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c72955348457816172f482ab04c81a001d9d1142e6ae110db5fe77841507d21d
+size 3418784

topic_embeddings.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:297db9625e7d2af69792a4332afc8664fe80f241db3b0657d92e1f36a1adb8b7
+size 40024