Added example of how to run function from command line. Updated packages. Embedding model default now smaller and at fp16.

App now retains original index following cleaning to allow for referring back to original data

Only aggregate topics not 'other', allowed for minimum sentence length, default max_topics now will auto aggregate topics. Added Cognito Auth functionality (boto3 with AWS).

Can split passages into sentences. Improved embedding, LLM representation models, improved zero shot capabilities

Updated packages. Improve hierarchy vis. Better models - mixedbread and phi3. Now option to split texts into sentences before modelling.

Should now parse custom regex correctly. Will now wipe previously created embeddings if 'low resource mode' option switched.

Allowed for uploading custom regex for cleaning. Fixed calculate all probabilities, reduce outliers. Added text tree for hierarchical modelling.

Upgraded to Gradio 4.16.0. Guide for converting to exe added.

Fixed file load with files including capital letters

Added clean data options, improved re-representation options and visualisation. General format changes

Model save now checks and makes a folder before writing the model

Lots of general fixes. New visualisations, fixed hierarchical vis for zero shot. Added calc all probabilities.

Split off LLM representation, visualisation, and reduce outliers from main function. Added hierarchical visualisation and logs

App should now check if embeddings are loaded before topic modelling. And will save only once.

Model export changed to safetensors. Improved representational model function. Got zero shot topic modelling working

first commit