sponsorblock-ml / src /model.py

Commit History

Update default classifier model
6a8bf30

Joshua Lochner commited on

Use new classifier for evaluation
787a8df

Joshua Lochner commited on

Upgrade classifier to transformer-based model
36f7534

Joshua Lochner commited on

Revert model input size back to 512 tokens
721bf64

Joshua Lochner commited on

Fix conflicting `--no_cuda` argument
09cabec

Joshua Lochner commited on

Add `no_cuda` argument to not use GPU
de9c8c4

Joshua Lochner commited on

Remove redundant calls to change device
8981122

Joshua Lochner commited on

Adjust tokenizer input size based on model input size
9604abd

Joshua Lochner commited on

Download classifier and vectorizer if not present
d7a594b

Joshua Lochner commited on

Create `get_model_tokenizer` helper method for loading model and tokenizer
bce5ce9

Joshua Lochner commited on

Add compatibility for python 3.6+
7781f10

Joshua Lochner commited on

Remove unused methods and improve caching
9ced7bd

Joshua Lochner commited on

Add cache system for loading classifiers/vectorizers
4678c9b

Joshua Lochner commited on

Add source code
5fbdd3c

Joshua Lochner commited on