Spaces:
Sleeping
Sleeping
File size: 3,044 Bytes
48fa8cf c2ca81b 1a117cc 48fa8cf |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
<p style='font-size:large;'>
You will be <mark>given a user profile and a travel-related query</mark>.
Your task is to <mark>evaluate the generated queries (numbered 1-6)</mark> based on the
following criteria:</p>
<p><strong><mark>Groundedness</mark>:</strong>
Evaluate how well the query incorporates the given filters.
<br> Select one of the following options:
<ol style="padding-left:2rem;">
<li><b>Not Grounded</b> - None of the filters are present in the query.</li> <li><b>Partially Grounded</b> -
Some filters are present, but not all. </li>
<li><b>Fully Grounded</b> - All provided filters are accurately reflected in the query.
</li>
<li><b>Unclear</b> - It is difficult to determine whether the filters are included.</li>
</ol>
</p>
<p><strong><mark>Clarity Assessment</mark>:</strong>
Evaluate how clear and understandable the query is.
Consider whether it is grammatically correct and easy to interpret.
<br>Your options are:
<ol style="padding-left:2rem;">
<li><b>Not Clear</b> - The query is difficult to understand or contains
significant grammatical errors.</li>
li><b>Somewhat Clear</b> - The query is understandable but may have
minor grammatical issues or slight ambiguity.</li>
<li><b>Very Clear</b> - The query is well-formed,
grammatically correct, and easy to understand.</li>
</ol>
</p>
<p><strong><mark>Persona Alignment</mark>:</strong>
How likely is the query to match the persona and reflect a question they would ask about travel?
<br>Your options are:
<ol style='padding-left:2rem;'>
<li><b>Not Aligned</b> - The user is not likely at all to ask this query.</li>
<li><b>Partially Aligned</b> - The user is quite likely to ask this query.</li>
<li><b>Aligned</b> - The user is very likely to ask this query. </li>
<li><b>Unclear</b> - It is unclear whether the user will ask this query.</li> </ol>
</p>
<p><strong><mark>Overall Fit</mark>:</strong></p>
<p>Evaluate how well the query aligns with the given filters and persona.
Consider all factors, including relevance, clarity, and persona alignment, to give an overall rating.
<br>Your options are:
<ol style="padding-left:2rem;">
<li><b>Poor</b> - The query does not match the filters or persona and is unclear.</li>
<li><b>Moderate</b> - The query somewhat matches the filters or persona but has issues with clarity or alignment.</li>
<!-- <li><b>Strong Fit</b> - The query is mostly relevant, clear, and well-aligned with the persona.</li> -->
<li><b>Strong Fit</b> - The query is highly relevant, clear, and perfectly aligned with the persona and filters.</li>
</ol> </p>
<p><strong><mark>Additional Comments (Optional)</mark>:</strong>
If you have any feedback, remarks, or interesting observations about the data, you can leave them here.
This is completely optional.
</p> |