the trained dpo adaptor for control v1.1