local_perplexity / README.md
atrost's picture
add local perplexity
83a740e

title: local_perplexity emoji: 🤗 colorFrom: blue colorTo: red sdk: gradio sdk_version: 3.19.1 app_file: app.py pinned: false tags:

  • evaluate
  • metric description: >- Perplexity (PPL) is one of the most common metrics for evaluating language models. It is defined as the exponentiated average negative log-likelihood of a sequence, calculated with exponent base e.

For more information on perplexity, see this tutorial. Metric Card for Perplexity