Spaces:
Running
Running
File size: 4,691 Bytes
3573a39 7eb3c10 91be13d 7eb3c10 7055d8b 3573a39 40a3acd be473e6 40a3acd 666860b 3573a39 9e4233f 69a9232 3573a39 9e4233f 3573a39 69a9232 3573a39 4a85196 1c00552 8f114e2 0607989 4a85196 1bcc148 4a85196 1c00552 0607989 666860b 1c00552 58c39e0 5704515 0607989 44e6352 0607989 5f9a95f 35be7f4 1bcc148 35be7f4 8f114e2 35be7f4 7eb3c10 0607989 666860b 0607989 6040976 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 |
INTRODUCTION_MD = """
<div style="display: flex; justify-content: center;"><h1>
🐢Giskard Evaluator - Text Classification
</h1></div>
Welcome to the Giskard Evaluator Space! Get a model vulnerability report immediately by simply sharing your model and dataset id below.
You can also checkout our library documentation <a href="https://docs.giskard.ai/en/latest/getting_started/quickstart/index.html">here</a>.
"""
CONFIRM_MAPPING_DETAILS_MD = """
<div style="display: flex; justify-content: center;"><h1>
<h1 style="text-align: center;">
Confirm Pre-processing Details
</h1>
</div>
Make sure the output variable's labels and the input variable's name are accurately mapped across both the dataset and the model. You can select the output variable's labels from the dropdowns below.
"""
CONFIRM_MAPPING_DETAILS_FAIL_MD = """
<h1 style="text-align: center;">
Confirm Pre-processing Details
</h1>
We're unable to automatically map the input variable's name and output variable's labels of your dataset with the model's. Please manually check the mapping below.
"""
CONFIRM_MAPPING_DETAILS_FAIL_RAW = """
We're unable to automatically map the input variable's name and output variable's labels of your dataset with the model's. Please manually check the mapping below.
"""
CHECK_CONFIG_OR_SPLIT_RAW = """
Please check your dataset config or split.
"""
CHECK_LOG_SECTION_RAW = """Your have successfully submitted a Giskard evaluation job. Further details are available in the Logs tab. You can find your report posted in your model's community discussion section."""
PREDICTION_SAMPLE_MD = """
<h1 style="text-align: center;">
Model Prediction Sample
</h1>
Here's a sample of your model's prediction on an example from the dataset.
"""
MAPPING_STYLED_ERROR_WARNING = """
<h3 style="text-align: center;color: orange; background-color: #fff0f3; border-radius: 8px; padding: 10px; ">
⚠️ We're unable to automatically map the input variable's name and output variable's labels of your dataset with the model's. Please manually check the mapping below.
</h3>
"""
UNMATCHED_MODEL_DATASET_STYLED_ERROR = """
<h3 style="text-align: center;color: #fa5f5f; background-color: #fbe2e2; border-radius: 8px; padding: 10px; ">
❌ Your model and dataset have different numbers of labels. Please double check your model and dataset.
</h3>
"""
NOT_TEXT_CLASSIFICATION_MODEL_RAW = """
Your model does not fall under the category of text classification. This page is specifically designated for the evaluation of text classification models.
"""
USE_INFERENCE_API_TIP = """
To speed up the evaluation, we recommend using the
<a href="https://huggingface.co/docs/api-inference/detailed_parameters#text-classification-task">
Hugging Face Inference API
</a>
. Please input your <a href="https://huggingface.co/docs/hub/security-tokens#user-access-tokens">Hugging Face token</a> to do so. You can find it <a href="https://huggingface.co/settings/tokens">here</a>.
"""
LOG_IN_TIPS = """
To use the Hugging Face Inference API, you need to log in to your Hugging Face account.
"""
HF_TOKEN_INVALID_STYLED= """
<p style="text-align: left;color: red; ">
Your Hugging Face token is invalid. Please double check your token.
</p>
"""
VALIDATED_MODEL_DATASET_STYLED = """
<h3 style="text-align: center;color: #4ca154; background-color: #e2fbe8; border-radius: 8px; padding: 10px; ">
Your model and dataset have been validated!
</h3>"""
def get_dataset_fetch_error_raw(error):
return f"""Sorry you cannot use this dataset because {error}. Contact HF team to support this dataset."""
|