DDPO aesthetic predictor
This reprository contains the weights of the aesthetic predictor that you can find in the repository: https://github.com/christophschuhmann/improved-aesthetic-predictor so that any use can load it easily using huggingface_hub library.
import torch
from huggingface_hub import hf_hub_download
cached_path = hf_hub_download(
'trl-lib',
'aesthetic-model.pth'
)
state_dict = torch.load(cached_path)