VPR: 66.7%
Voting Positive Rate (VPR) involves four evaluators independently assessing each task, divided into several cases, each evaluated five times. A task is deemed successful only if all evaluators unanimously vote positively; otherwise, it is considered a failure.
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.