Spaces:
Build error
Build error
File size: 4,599 Bytes
c32ee7d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 |
dataset: common_gen
templates:
45778bd5-fddc-4c60-a77b-4eff5bed1c0b: !Template
answer_choices: null
id: 45778bd5-fddc-4c60-a77b-4eff5bed1c0b
jinja: "Ignoring the order of the concepts: {{ concepts | join(\", \") }}; \n\
Generate a sentence with all the concepts :\n|||\n{{target}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- BLEU
- ROUGE
original_task: true
name: Given concepts - type 2
reference: Ignoring the order of the concepts:...
684f1859-0b8d-4efe-82e1-7218838813cd: !Template
answer_choices: null
id: 684f1859-0b8d-4efe-82e1-7218838813cd
jinja: 'Put the concepts together to form a sentence: {{ concepts | join(", ")
}}.
|||
{{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- BLEU
- ROUGE
original_task: true
name: Put together
reference: This is similar to a task description
a4991cc7-cc91-4f37-af80-1983a02eb950: !Template
answer_choices: null
id: a4991cc7-cc91-4f37-af80-1983a02eb950
jinja: "Construct a sentence with the word {{ concepts | choice }}. \n\nHint:\
\ Use {{concepts | join(\", \")}} to restrict the output sentence.\n|||\n{{target}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- BLEU
- ROUGE
original_task: true
name: choice in concept centric sentence generation
reference: ''
b2033df4-7922-45b8-a113-e7784135cea9: !Template
answer_choices: null
id: b2033df4-7922-45b8-a113-e7784135cea9
jinja: "{% set seq = [ \n'From the concepts mentioned below, generate a sentence:',\
\ \n'Convert the concepts to a sentence:', \n'Given the list of concepts, write\
\ a sentence:'\n] %} \n{{ seq | choice }}\n{{ concepts | join(\", \") }}\n|||\n\
{{target}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- BLEU
- ROUGE
original_task: true
name: random task template prompt
reference: With a randomly chosen task template, generate a sentence from the
list of concepts
b7012213-04c4-424d-85fb-39d63d8a0ca2: !Template
answer_choices: null
id: b7012213-04c4-424d-85fb-39d63d8a0ca2
jinja: 'What are the topics in the sentence: {{target}}
|||
{{ concepts | join(", ") }}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- BLEU
- ROUGE
original_task: false
name: topics from the sentence
reference: The template generates a random topic from the sentence
ed215962-8e51-45e7-b025-6e822f877098: !Template
answer_choices: null
id: ed215962-8e51-45e7-b025-6e822f877098
jinja: "We have the sentence: {{target}}; \nExtract all the key concepts: \n|||\n\
{{ concepts | join(\", \") }}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- BLEU
- ROUGE
original_task: false
name: sentence to concepts
reference: Template identifies the concepts from the sentence
f3fce748-89e0-4b88-94bb-72ddb9a04d10: !Template
answer_choices: null
id: f3fce748-89e0-4b88-94bb-72ddb9a04d10
jinja: 'Can you write a sentence about the topic {{concepts | choice}}?
|||
{{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- BLEU
- ROUGE
original_task: false
name: topic to sentence
reference: 'Choose a random topic and ask the model to write a sentence about
it '
fa787974-86dd-4f66-b2d7-6d3523ce00e1: !Template
answer_choices: null
id: fa787974-86dd-4f66-b2d7-6d3523ce00e1
jinja: "Humans can easily string together abstract concepts to form a coherent\
\ sentence. \nFor example, with the concepts {{ concepts | join(\", \") }},\
\ a simple sentence can be \n|||\n{{target}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- BLEU
- ROUGE
original_task: true
name: Example prompt
reference: The prompt is in the form of an example
fbeebb4f-cba1-4bc4-80ec-758a3c134033: !Template
answer_choices: null
id: fbeebb4f-cba1-4bc4-80ec-758a3c134033
jinja: "Given the list of concepts: {{ concepts | join(\", \") }}; \nGenerate\
\ a sentence with all the concepts :\n|||\n{{target}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- BLEU
- ROUGE
original_task: true
name: Given concepts type 1
reference: 'The prompt has the prefix "Given the .." '
|