bertopic-20-newsgroups

This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.

Usage

To use this model, please install BERTopic:

pip install -U bertopic

You can use the model as follows:

from bertopic import BERTopic
topic_model = BERTopic.load("ctam8736/bertopic-20-newsgroups")

topic_model.get_topic_info()

Topic overview

• Number of topics: 135
• Number of training documents: 11314

Click here for an overview of all topics.

Topic ID	Topic Keywords	Topic Frequency	Label
-1	article - information - subject - re - what	10	-1_article_information_subject_re
0	scsi - scsi2 - scsi1 - drives - bios	3737	0_scsi_scsi2_scsi1_drives
1	nhl - puck - leafs - flyers - pitching	976	1_nhl_puck_leafs_flyers
2	firearm - firearms - handgun - guns - gun	918	2_firearm_firearms_handgun_guns
3	ford - honda - nissan - bmw - dealer	409	3_ford_honda_nissan_bmw
4	encryption - encrypted - crypto - nsa - chip	387	4_encryption_encrypted_crypto_nsa
5	atheism - atheist - atheists - christianity - belief	377	5_atheism_atheist_atheists_christianity
6	hezbollah - gaza - lebanon - palestinians - lebanese	342	6_hezbollah_gaza_lebanon_palestinians
7	window - x11r5 - openwindows - x11 - x11r4	249	7_window_x11r5_openwindows_x11
8	modems - modem - mouse - ports - port	243	8_modems_modem_mouse_ports
9	anonymity - anonymous - mailing - usenet - newsgroups	151	9_anonymity_anonymous_mailing_usenet
10	armenians - armenia - armenian - azerbaijani - azerbaijan	147	10_armenians_armenia_armenian_azerbaijani
11	clinton - stephanopoulos - secretary - president - congress	135	11_clinton_stephanopoulos_secretary_president
12	os - windows - win32 - microsoft - win31	133	12_os_windows_win32_microsoft
13	diseases - disease - candida - infection - infections	113	13_diseases_disease_candida_infection
14	superstition - msg - sensitivity - glutamate - causes	100	14_superstition_msg_sensitivity_glutamate
15	laserjet - inkjet - printers - bubblejet - bubblejets	86	15_laserjet_inkjet_printers_bubblejet
16	billboard - billboards - nasa - space - advertising	75	16_billboard_billboards_nasa_space
17	radar - detectors - detector - detecting - radarjust	68	17_radar_detectors_detector_detecting
18	speeding - speeds - mph - speed - driving	64	18_speeding_speeds_mph_speed
19	ssto - moonbase - moon - lunar - billion	63	19_ssto_moonbase_moon_lunar
20	station - nasa - redesign - space - shuttle	61	20_station_nasa_redesign_space
21	eternity - afterlife - heaven - hell - judgement	49	21_eternity_afterlife_heaven_hell
22	testament - manuscripts - scripture - bible - hebrew	47	22_testament_manuscripts_scripture_bible
23	homosexuality - heterosexual - homosexual - homosexuals - gays	45	23_homosexuality_heterosexual_homosexual_homosexuals
24	libertarians - libertarian - libertarianism - regulation - governments	44	24_libertarians_libertarian_libertarianism_regulation
25	islamic - muslim - islam - muslims - koran	44	25_islamic_muslim_islam_muslims
26	tax - taxes - vat - deficits - income	44	26_tax_taxes_vat_deficits
27	oil - drain - engine - fuel - dumping	44	27_oil_drain_engine_fuel
28	helmet - helmets - head - protection - gloves	43	28_helmet_helmets_head_protection
29	fonts - font - ttfonts - truetype - printing	42	29_fonts_font_ttfonts_truetype
30	morality - moral - morals - instinctive - immoral	39	30_morality_moral_morals_instinctive
31	colormaps - colourmap - colormap - xalloccolor - cwcolormap	39	31_colormaps_colourmap_colormap_xalloccolor
32	homosexuals - molesters - homosexual - homosexuality - pedophilia	38	32_homosexuals_molesters_homosexual_homosexuality
33	migraine - migraines - headache - headaches - analgesics	37	33_migraine_migraines_headache_headaches
34	resurrection - gospels - tomb - testament - jesuss	37	34_resurrection_gospels_tomb_testament
35	graphics - copyright - images - siggraph - image	37	35_graphics_copyright_images_siggraph
36	mormon - mormons - lds - brigham - utah	35	36_mormon_mormons_lds_brigham
37	scientific - scipsychology - scientist - science - methodology	34	37_scientific_scipsychology_scientist_science
38	tapes - tape - backup - copy - floppy	34	38_tapes_tape_backup_copy
39	drugs - marijuana - drug - legalizing - legalization	34	39_drugs_marijuana_drug_legalizing
40	punishment - punish - murder - penalty - murderer	34	40_punishment_punish_murder_penalty
41	sphere - globe - radius - pointstruct - circle	34	41_sphere_globe_radius_pointstruct
42	surgery - patients - hernia - massager - pain	33	42_surgery_patients_hernia_massager
43	genocide - bosnia - atheism - serbs - christians	32	43_genocide_bosnia_atheism_serbs
44	insurance - liability - insureyear - deductible - accident	32	44_insurance_liability_insureyear_deductible
45	polygon - polygons - triangulation - hexagons - polyn	30	45_polygon_polygons_triangulation_hexagons
46	spacecraft - galileo - galileos - mission - magellan	29	46_spacecraft_galileo_galileos_mission
47	countersteering - countersteeringfaq - countersteer - riding - bikes	29	47_countersteering_countersteeringfaq_countersteer_riding
48	antenna - antennas - transmitters - transmitting - radios	28	48_antenna_antennas_transmitters_transmitting
49	canine - dogs - dog - spaniel - springer	28	49_canine_dogs_dog_spaniel
50	batteries - battery - electrolyte - galvanized - zinc	28	50_batteries_battery_electrolyte_galvanized
51	oscilloscope - scopes - scope - oscilliscopes - digital	27	51_oscilloscope_scopes_scope_oscilliscopes
52	xgrabkey - definekeys - accelerators - accelerator - shiftkeyq	27	52_xgrabkey_definekeys_accelerators_accelerator
53	protoncentaur - centaur - proton - accelerator - nuclear	27	53_protoncentaur_centaur_proton_accelerator
54	telephone - dial - phone - call - lines	26	54_telephone_dial_phone_call
55	marriages - wedding - vows - weddings - marriage	25	55_marriages_wedding_vows_weddings
56	ibm - levels - level - nasa - software	25	56_ibm_levels_level_nasa
57	nasa - aerospace - astronomy - spacecraft - astronomical	24	57_nasa_aerospace_astronomy_spacecraft
58	motif - neosoft - unix - platforms - software	24	58_motif_neosoft_unix_platforms
59	nuclear - cooling - reactor - tower - towers	23	59_nuclear_cooling_reactor_tower
60	injuries - struck - snot - rocks - warningplease	23	60_injuries_struck_snot_rocks
61	transmissions - shifter - automatics - autos - auto	22	61_transmissions_shifter_automatics_autos
62	lzr1260 - printing - mwt9caxaxaxaxaxaxaxaxaxaxaxaxax - m9l0qaxaxaxaxaxaxaxaxaxaxaxaxaxax - mi68qaxaxaxaxaxaxaxaxaxaxaxaxaxax	22	62_lzr1260_printing_mwt9caxaxaxaxaxaxaxaxaxaxaxaxax_m9l0qaxaxaxaxaxaxaxaxaxaxaxaxaxax
63	cview - files - directory - file - tmp	21	63_cview_files_directory_file
64	immaculate - mary - marys - conception - catholics	21	64_immaculate_mary_marys_conception
65	cryptology - cryptanalyst - crypt - cryptanalysis - ciphers	20	65_cryptology_cryptanalyst_crypt_cryptanalysis
66	hotelco - hotels - resorts - hotel - tickets	20	66_hotelco_hotels_resorts_hotel
67	3dos - 3do - 3ds - 3d - 3dstudio	20	67_3dos_3do_3ds_3d
68	comet - comets - jupiter - asteroids - jovian	20	68_comet_comets_jupiter_asteroids
69	polishing - scratches - paint - rubbing - glaze	20	69_polishing_scratches_paint_rubbing
70	newsgroup - groups - groupsplit - group - split	20	70_newsgroup_groups_groupsplit_group
71	koresh - koreshs - david - sermon - biblical	20	71_koresh_koreshs_david_sermon
72	parking - parked - liability - unsafe - stickers	20	72_parking_parked_liability_unsafe
73	trumpet - tcp - windows - winqvtnet - winsock	19	73_trumpet_tcp_windows_winqvtnet
74	freon - heater - coolant - r12 - vents	19	74_freon_heater_coolant_r12
75	sabbath - commandments - sunday - worship - church	19	75_sabbath_commandments_sunday_worship
76	geekdom - computer - fourdcom - csws18icsunysbedu - psychnet	19	76_geekdom_computer_fourdcom_csws18icsunysbedu
77	bosnia - serbs - sanctions - somalia - war	18	77_bosnia_serbs_sanctions_somalia
78	soundblaster - midi - midimapper - soundexe - wavfiles	18	78_soundblaster_midi_midimapper_soundexe
79	condo - remodeled - townhome - bedroom - rent	18	79_condo_remodeled_townhome_bedroom
80	odometers - odometer - sensor - mileage - sensors	18	80_odometers_odometer_sensor_mileage
81	joystick - joysticks - joyport - joyread - hardware	17	81_joystick_joysticks_joyport_joyread
82	abortion - abortions - roe - proabortion - fetus	17	82_abortion_abortions_roe_proabortion
83	seizures - seizure - allergies - corn - cereal	17	83_seizures_seizure_allergies_corn
84	sobriety - sober - drinking - drink - drinks	17	84_sobriety_sober_drinking_drink
85	nubus - lciiipowerpc - pds - powerpcs - powerpc	17	85_nubus_lciiipowerpc_pds_powerpcs
86	mining - miners - minerals - miner - mineral	17	86_mining_miners_minerals_miner
87	outlets - outlet - electrical - wiring - grounded	16	87_outlets_outlet_electrical_wiring
88	rosicrucianum - rosicrucian - orders - order - organization	16	88_rosicrucianum_rosicrucian_orders_order
89	tempest - shielding - surveillance - encryption - electromagnetic	16	89_tempest_shielding_surveillance_encryption
90	monitor - monitors - screen - scrolling - display	16	90_monitor_monitors_screen_scrolling
91	krillean - photographs - photography - kirlian - pictures	16	91_krillean_photographs_photography_kirlian
92	scanner - scanners - scanning - scans - scanman	16	92_scanner_scanners_scanning_scans
93	sexism - sexist - extramarital - islamic - marriage	16	93_sexism_sexist_extramarital_islamic
94	noisy - noise - noises - rattled - quiets	16	94_noisy_noise_noises_rattled
95	orion - astronomy - museum - prototype - space	15	95_orion_astronomy_museum_prototype
96	easter - pagan - celebrating - feast - celebration	15	96_easter_pagan_celebrating_feast
97	batf - assault - waco - blasting - blast	15	97_batf_assault_waco_blasting
98	batchfile - ini - updating - file - winfileini	15	98_batchfile_ini_updating_file
99	copyprotect - copying - protected - copy - protection	15	99_copyprotect_copying_protected_copy
100	42 - tiff - tiff6 - significance - universe	14	100_42_tiff_tiff6_significance
101	stove - stoves - splitfires - splitfire - burns	14	101_stove_stoves_splitfires_splitfire
102	automotive - backing - lights - corvette - reverse	14	102_automotive_backing_lights_corvette
103	dock - docks - minidocks - portable - minidock	14	103_dock_docks_minidocks_portable
104	cdaudio - stereo - audio - soundbase - speakers	14	104_cdaudio_stereo_audio_soundbase
105	uv - flashlight - houselights - fluorescent - lamps	14	105_uv_flashlight_houselights_fluorescent
106	papal - papacy - pope - popes - schism	14	106_papal_papacy_pope_popes
107	scsi - quadra - quadras - quadraspecific - firmware	14	107_scsi_quadra_quadras_quadraspecific
108	crohns - colitis - dietary - gastroenterology - diet	13	108_crohns_colitis_dietary_gastroenterology
109	crashes - powerbook - plugged - corrupted - duos	13	109_crashes_powerbook_plugged_corrupted
110	eyedness - handedness - righteye - righthandedness - eyes	13	110_eyedness_handedness_righteye_righthandedness
111	wrench - pliers - tool - tools - srb	13	111_wrench_pliers_tool_tools
112	scripture - scriptures - prophecy - revelation - revelations	13	112_scripture_scriptures_prophecy_revelation
113	nikon - lens - lenses - olympus - 35mm	13	113_nikon_lens_lenses_olympus
114	prosecution - suspects - encrypted - defendant - incriminate	13	114_prosecution_suspects_encrypted_defendant
115	wheel - shaftdrives - wheelies - wheelie - shaftdrive	12	115_wheel_shaftdrives_wheelies_wheelie
116	obesity - rebound - dieting - diet - metabolism	12	116_obesity_rebound_dieting_diet
117	adl - adls - spying - fbi - investigation	12	117_adl_adls_spying_fbi
118	lunar - moon - exploration - attend - conference	12	118_lunar_moon_exploration_attend
119	draftees - draft - selective - military - abolished	12	119_draftees_draft_selective_military
120	sunrise - sunset - daylight - algorithm - astronomical	12	120_sunrise_sunset_daylight_algorithm
121	octopus - octopuses - octopi - squid - octapus	12	121_octopus_octopuses_octopi_squid
122	gassing - explosion - gas - explode - explosive	11	122_gassing_explosion_gas_explode
123	tutorial - handbook - chemistry - paperback - books	11	123_tutorial_handbook_chemistry_paperback
124	amp - decibels - current - ampere - db	11	124_amp_decibels_current_ampere
125	uniforms - jerseys - uniform - mets - reds	11	125_uniforms_jerseys_uniform_mets
126	eugenics - eugenic - geneticallyengineered - genetic - genetically	11	126_eugenics_eugenic_geneticallyengineered_genetic
127	fractals - fractal - fractally - compression - pascalfractals	11	127_fractals_fractal_fractally_compression
128	sunview - xputimage - pixmap - pixmaps - ximage	11	128_sunview_xputimage_pixmap_pixmaps
129	waving - wave - waves - bikers - bikes	11	129_waving_wave_waves_bikers
130	vocoder - compressionalgorithms - compression - modems - cryptophones	11	130_vocoder_compressionalgorithms_compression_modems
131	mouse - jumpiness - mousecom - mouseits - jumps	11	131_mouse_jumpiness_mousecom_mouseits
132	netware - lan - workgroup - workgroups - w4wg	10	132_netware_lan_workgroup_workgroups
133	timers - timer - ultralong - clock - oscillator	10	133_timers_timer_ultralong_clock

Training hyperparameters

• calculate_probabilities: False
• language: english
• low_memory: False
• min_topic_size: 10
• n_gram_range: (1, 1)
• nr_topics: auto
• seed_topic_list: None
• top_n_words: 10
• verbose: True
• zeroshot_min_similarity: 0.7
• zeroshot_topic_list: None

Framework versions

• Numpy: 1.23.5
• HDBSCAN: 0.8.33
• UMAP: 0.5.5
• Pandas: 2.2.1
• Scikit-Learn: 1.3.1
• Sentence-transformers: 2.5.1
• Transformers: 4.37.0.dev0
• Numba: 0.59.1
• Plotly: 5.20.0
• Python: 3.10.4