README.md

## DDPO aesthetic predictor

This reprository contains the weights of the aesthetic predictor that you can find in the repository: https://github.com/christophschuhmann/improved-aesthetic-predictor so that any use can load it easily using `huggingface_hub` library.

```python
import torch
from huggingface_hub import hf_hub_download

cached_path = hf_hub_download(
  'trl-lib',
  'aesthetic-model.pth'
)

state_dict = torch.load(cached_path)
```