Edit model card

cnn_dailymail_6789_200000_100000_v1_150topics_train

This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.

Usage

To use this model, please install BERTopic:

pip install -U bertopic

You can use the model as follows:

from bertopic import BERTopic
topic_model = BERTopic.load("KingKazma/cnn_dailymail_6789_200000_100000_v1_150topics_train")

topic_model.get_topic_info()

Topic overview

  • Number of topics: 150
  • Number of training documents: 200000
Click here for an overview of all topics.
Topic ID Topic Keywords Topic Frequency Label
-1 said - one - year - people - also 5 -1_said_one_year_people
0 league - player - club - cup - goal 104194 0_league_player_club_cup
1 police - said - told - murder - court 19383 1_police_said_told_murder
2 security - us - military - government - said 14660 2_security_us_military_government
3 race - win - champion - open - murray 6315 3_race_win_champion_open
4 nfl - fight - game - team - player 4973 4_nfl_fight_game_team
5 dog - animal - cat - zoo - pet 2700 5_dog_animal_cat_zoo
6 obama - republican - president - republicans - romney 2115 6_obama_republican_president_republicans
7 car - driver - driving - vehicle - road 2068 7_car_driver_driving_vehicle
8 flight - plane - passenger - airline - airport 2016 8_flight_plane_passenger_airline
9 nhs - bank - patient - eu - cent 1995 9_nhs_bank_patient_eu
10 show - film - cosby - movie - actor 1914 10_show_film_cosby_movie
11 weather - storm - snow - rain - water 1874 11_weather_storm_snow_rain
12 shark - whale - ship - oil - sea 1577 12_shark_whale_ship_oil
13 fashion - art - painting - artist - collection 1513 13_fashion_art_painting_artist
14 war - soldier - army - scotland - british 1485 14_war_soldier_army_scotland
15 space - earth - mars - planet - nasa 1300 15_space_earth_mars_planet
16 ebola - virus - disease - health - outbreak 1212 16_ebola_virus_disease_health
17 russian - russia - ukraine - putin - ukrainian 1193 17_russian_russia_ukraine_putin
18 haiti - cuba - chavez - cuban - president 1173 18_haiti_cuba_chavez_cuban
19 korea - north - korean - kim - south 1120 19_korea_north_korean_kim
20 china - chinese - chinas - hong - beijing 928 20_china_chinese_chinas_hong
21 property - house - price - home - estate 909 21_property_house_price_home
22 mandela - africa - african - boko - haram 884 22_mandela_africa_african_boko
23 bali - thai - thailand - philippines - bangkok 866 23_bali_thai_thailand_philippines
24 apple - iphone - device - apples - ipad 862 24_apple_iphone_device_apples
25 prince - royal - duchess - queen - princess 827 25_prince_royal_duchess_queen
26 fire - blaze - firefighter - smoke - flame 769 26_fire_blaze_firefighter_smoke
27 mexico - mexican - cartel - border - drug 746 27_mexico_mexican_cartel_border
28 food - sugar - diet - calorie - chocolate 739 28_food_sugar_diet_calorie
29 school - education - pupil - schools - teacher 725 29_school_education_pupil_schools
30 india - delhi - indian - indias - singh 558 30_india_delhi_indian_indias
31 facebook - user - app - social - twitter 537 31_facebook_user_app_social
32 album - music - song - bieber - band 536 32_album_music_song_bieber
33 pope - vatican - francis - church - cardinal 534 33_pope_vatican_francis_church
34 name - child - boo - baby - wedding 525 34_name_child_boo_baby
35 marijuana - smoking - tobacco - drug - cannabis 520 35_marijuana_smoking_tobacco_drug
36 sandusky - penn - student - paterno - fraternity 505 36_sandusky_penn_student_paterno
37 internet - computer - hacker - online - user 490 37_internet_computer_hacker_online
38 weight - size - diet - stone - fat 466 38_weight_size_diet_stone
39 book - novel - author - shades - potter 398 39_book_novel_author_shades
40 japan - japanese - china - nuclear - reactor 397 40_japan_japanese_china_nuclear
41 marriage - samesex - gay - state - court 396 41_marriage_samesex_gay_state
42 ancient - archaeologist - tomb - roman - site 384 42_ancient_archaeologist_tomb_roman
43 cancer - patient - skin - breast - treatment 381 43_cancer_patient_skin_breast
44 mayor - ford - weiner - occupy - blasio 374 44_mayor_ford_weiner_occupy
45 energy - gas - price - fracking - oil 361 45_energy_gas_price_fracking
46 saatchi - madoff - ecclestone - lawson - nigella 318 46_saatchi_madoff_ecclestone_lawson
47 abortion - baby - ivf - breastfeeding - woman 312 47_abortion_baby_ivf_breastfeeding
48 christmas - shopper - shopping - tree - store 309 48_christmas_shopper_shopping_tree
49 nazi - hitler - jews - camp - auschwitz 308 49_nazi_hitler_jews_camp
50 climate - ice - warming - change - carbon 275 50_climate_ice_warming_change
51 berlusconi - italian - roma - berlusconis - mafia 263 51_berlusconi_italian_roma_berlusconis
52 rail - train - hs2 - london - passenger 260 52_rail_train_hs2_london
53 transcript - student - news - todays - cnn 256 53_transcript_student_news_todays
54 lottery - ticket - jackpot - winning - powerball 248 54_lottery_ticket_jackpot_winning
55 abbott - minister - australian - asylum - australia 239 55_abbott_minister_australian_asylum
56 fossil - specie - neanderthals - dinosaur - human 237 56_fossil_specie_neanderthals_dinosaur
57 kasem - hospital - euthanasia - ashya - kerri 224 57_kasem_hospital_euthanasia_ashya
58 hotel - beach - island - resort - city 223 58_hotel_beach_island_resort
59 robot - 3d - printer - toy - technology 214 59_robot_3d_printer_toy
60 jackson - jacksons - aeg - murray - michael 209 60_jackson_jacksons_aeg_murray
61 brain - autism - sleep - alzheimers - adhd 208 61_brain_autism_sleep_alzheimers
62 food - meat - product - cull - beef 204 62_food_meat_product_cull
63 game - console - xbox - gaming - playstation 201 63_game_console_xbox_gaming
64 hollande - sarkozy - trierweiler - french - francois 196 64_hollande_sarkozy_trierweiler_french
65 alcohol - wine - drinking - beer - drink 180 65_alcohol_wine_drinking_beer
66 woman - childcare - child - benefit - work 174 66_woman_childcare_child_benefit
67 tower - building - 911 - memorial - york 172 67_tower_building_911_memorial
68 epstein - prince - roberts - andrew - sex 162 68_epstein_prince_roberts_andrew
69 wars - film - star - movie - hobbit 152 69_wars_film_star_movie
70 spanish - gibraltar - spain - eta - basque 143 70_spanish_gibraltar_spain_eta
71 jobs - billion - apple - wealth - gates 139 71_jobs_billion_apple_wealth
72 waste - water - bag - plastic - toilet 137 72_waste_water_bag_plastic
73 sotomayor - court - justice - supreme - ginsburg 131 73_sotomayor_court_justice_supreme
74 falklands - clarkson - argentina - falkland - islands 130 74_falklands_clarkson_argentina_falkland
75 miner - mine - factory - garment - bangladesh 129 75_miner_mine_factory_garment
76 fgm - circumcision - hpv - genital - mutilation 127 76_fgm_circumcision_hpv_genital
77 pollution - allergy - air - smog - pollen 115 77_pollution_allergy_air_smog
78 bosnian - mladic - serb - srebrenica - war 113 78_bosnian_mladic_serb_srebrenica
79 eye - ear - hand - surgery - implant 100 79_eye_ear_hand_surgery
80 vitamin - statin - caffeine - risk - heart 98 80_vitamin_statin_caffeine_risk
81 jeffs - flds - utah - church - polygamy 95 81_jeffs_flds_utah_church
82 travolta - scientology - polanski - church - cruise 93 82_travolta_scientology_polanski_church
83 toyota - recall - gm - vehicle - ignition 92 83_toyota_recall_gm_vehicle
84 miss - pageant - beauty - competition - universe 89 84_miss_pageant_beauty_competition
85 kyle - routh - sniper - littlefield - kyles 85 85_kyle_routh_sniper_littlefield
86 veil - muslim - niqab - ban - burka 81 86_veil_muslim_niqab_ban
87 hair - amish - beard - mullet - moustache 79 87_hair_amish_beard_mullet
88 cruise - amoeba - norovirus - ill - illness 78 88_cruise_amoeba_norovirus_ill
89 ring - diamond - jewelry - jewellery - heist 76 89_ring_diamond_jewelry_jewellery
90 corruption - country - population - index - happiness 76 90_corruption_country_population_index
91 clown - ghost - haunted - exorcism - ghostly 73 91_clown_ghost_haunted_exorcism
92 bobbi - kristina - houston - whitney - gordon 68 92_bobbi_kristina_houston_whitney
93 dubai - hajj - pilgrim - mecca - mme 68 93_dubai_hajj_pilgrim_mecca
94 balloon - heene - trappe - falcon - circus 66 94_balloon_heene_trappe_falcon
95 park - ski - canyon - national - cave 64 95_park_ski_canyon_national
96 expedition - pole - antarctic - ice - ship 64 96_expedition_pole_antarctic_ice
97 hockey - nhl - ice - game - kings 63 97_hockey_nhl_ice_game
98 bull - gored - pamplona - bullfighting - bullfight 62 98_bull_gored_pamplona_bullfighting
99 king - luther - civil - lincoln - kings 61 99_king_luther_civil_lincoln
100 bucket - bowl - als - challenge - puppy 60 100_bucket_bowl_als_challenge
101 tibetan - tibet - dalai - tibetans - lama 60 101_tibetan_tibet_dalai_tibetans
102 mushroom - ash - tree - pumpkin - plant 59 102_mushroom_ash_tree_pumpkin
103 ballet - filin - bolshoi - dancer - dmitrichenko 50 103_ballet_filin_bolshoi_dancer
104 gm - crop - food - plant - genetically 50 104_gm_crop_food_plant
105 disney - disneyland - walt - park - frozen 45 105_disney_disneyland_walt_park
106 nuclear - davos - treaty - obama - weapon 45 106_nuclear_davos_treaty_obama
107 bitcoin - currency - coin - bitcoins - note 43 107_bitcoin_currency_coin_bitcoins
108 gun - laser - 3d - printer - weapon 42 108_gun_laser_3d_printer
109 teeth - dentist - dental - tooth - denture 40 109_teeth_dentist_dental_tooth
110 fragrance - scent - perfume - smell - bottle 39 110_fragrance_scent_perfume_smell
111 holiday - apd - tax - flight - thanksgiving 38 111_holiday_apd_tax_flight
112 oldest - age - imich - okawa - birthday 36 112_oldest_age_imich_okawa
113 plate - search - camera - police - database 36 113_plate_search_camera_police
114 kitty - hello - hong - kong - sanrio 32 114_kitty_hello_hong_kong
115 nobel - prize - peace - award - committee 31 115_nobel_prize_peace_award
116 violin - orchestra - stradivarius - instrument - stradivari 31 116_violin_orchestra_stradivarius_instrument
117 dna - graphene - cell - genome - synthetic 30 117_dna_graphene_cell_genome
118 teresa - giudice - gabor - anhalt - zsa 29 118_teresa_giudice_gabor_anhalt
119 gandolfini - sopranos - gandolfinis - soprano - actor 27 119_gandolfini_sopranos_gandolfinis_soprano
120 turing - bletchley - enigma - turings - code 26 120_turing_bletchley_enigma_turings
121 nelson - napoleon - battle - trafalgar - hms 26 121_nelson_napoleon_battle_trafalgar
122 redskins - name - native - snyder - mascot 25 122_redskins_name_native_snyder
123 marilyn - fawcett - monroe - oneal - farrah 25 123_marilyn_fawcett_monroe_oneal
124 helmet - virtual - oculus - headset - vr 25 124_helmet_virtual_oculus_headset
125 eurovision - contest - song - conchita - azerbaijan 23 125_eurovision_contest_song_conchita
126 flag - union - national - flags - st 21 126_flag_union_national_flags
127 clooney - amal - alamuddin - chao - george 20 127_clooney_amal_alamuddin_chao
128 python - monty - cleese - pythons - idle 19 128_python_monty_cleese_pythons
129 accent - dialect - language - cromarty - sound 19 129_accent_dialect_language_cromarty
130 mayan - apocalypse - maya - calendar - end 18 130_mayan_apocalypse_maya_calendar
131 evolution - creationism - scientific - intelligent - theory 18 131_evolution_creationism_scientific_intelligent
132 prabowo - indonesia - jakarta - widodo - jokowi 17 132_prabowo_indonesia_jakarta_widodo
133 favourite - fan - top - yougov - five 15 133_favourite_fan_top_yougov
134 detroit - poverty - city - census - rate 15 134_detroit_poverty_city_census
135 arafat - arafats - polonium - palestinian - polonium210 15 135_arafat_arafats_polonium_palestinian
136 dmlaterbundle - twittervia - lanza - zann - ilfracombe 13 136_dmlaterbundle_twittervia_lanza_zann
137 clock - time - hour - daylight - westworth 13 137_clock_time_hour_daylight
138 ikea - furniture - ikeas - kamprad - fsc 12 138_ikea_furniture_ikeas_kamprad
139 phone - radiation - mobile - cancer - cell 10 139_phone_radiation_mobile_cancer
140 dangi - guinness - kulkarni - tall - mruga 9 140_dangi_guinness_kulkarni_tall
141 vick - vicks - nfl - falcons - virginia 9 141_vick_vicks_nfl_falcons
142 bulb - light - leds - paddle - bulbs 8 142_bulb_light_leds_paddle
143 wormhole - photon - teleportation - relativity - warp 7 143_wormhole_photon_teleportation_relativity
144 bundy - cliven - bundys - cattle - land 6 144_bundy_cliven_bundys_cattle
145 valentines - cuddle - romantic - hess - cuddling 6 145_valentines_cuddle_romantic_hess
146 port - cairo - almasry - egypt - ministry 6 146_port_cairo_almasry_egypt
147 sanford - sanfords - jenny - carolina - mark 5 147_sanford_sanfords_jenny_carolina
148 deeds - gus - creigh - virginia - son 5 148_deeds_gus_creigh_virginia

Training hyperparameters

  • calculate_probabilities: False
  • language: english
  • low_memory: False
  • min_topic_size: 10
  • n_gram_range: (1, 1)
  • nr_topics: 150
  • seed_topic_list: None
  • top_n_words: 10
  • verbose: False

Framework versions

  • Numpy: 1.23.5
  • HDBSCAN: 0.8.33
  • UMAP: 0.5.3
  • Pandas: 1.5.3
  • Scikit-Learn: 1.2.2
  • Sentence-transformers: 2.2.2
  • Transformers: 4.31.0
  • Numba: 0.57.1
  • Plotly: 5.15.0
  • Python: 3.10.12
Downloads last month
2
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.