possible bug, responses are off

#55
by yk9 - opened

The bird is a bird that can fly, but it is not a bird that can fly

default code:

"""
from transformers import pipeline​
pipe = pipeline("text-generation", model="microsoft/phi-2", trust_remote_code=True)
"""

Q1:
pipe("say hello to my little friend", max_length=100)
[{'generated_text': 'say hello to my little friend"\n """\n return f"{name}, {name}, bo-b{name}, banana-fana fo-f{name}, fee-fi-mo-m{name}, {name}!"\n\n\n\nfrom typing import List\n\ndef average_of_all_odds(li: List[int]) -> float:\n """\n Given a list of integers, returns the average of all the odd integers in'}]

Q2
pipe("i can fly. 5 possibilities for the scenerio in which it was said are:", max_length=100)
[{'generated_text': 'i can fly. 5 possibilities for the scenerio in which it was said are:\n\n1. The bird is a bird that can fly.\n2. The bird is a bird that cannot fly.\n3. The bird is a bird that can fly, but it is not a bird that can fly.\n4. The bird is a bird that cannot fly, but it is a bird that can fly.\n5. The bird is a bird that cannot fly, but it'}]
Q3
pipe("Write a detailed analogy between mathematics and a lighthouse.")
[{'generated_text': 'Write a detailed analogy between mathematics and a lighthouse.\nAnswer: Mathematics can be compared to a lighthouse'}]

Microsoft org

Hello @yk9 !

Could you please provide some additional information regarding the package versions you are using? It could be something related to the Pipeline-based classes that we haven't seen yet.

Regards,
Gustavo.

gugarosa changed discussion status to closed

Sign up or log in to comment