jacobthebanana
/

politics

Feature Extraction

text-embeddings-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

politics / preprocess.sh

jacobthebanana's picture

Saving weights and logs of step 143142

cc8e143 over 2 years ago

history blame contribute delete

204 Bytes

	python3 process_bignews.py ~/data/bignews/bignews_$SPLIT.json /dev/shm/news_$SPLIT
	# python3 process_bignews.py ~/data/bignews/bignews_$SPLIT.json ~/data/bignews/processed_lite/bignews_$SPLIT --ratio 0.05