llemma_7b / sample.py
Pierce Maloney
adding intros k v l. to bad words (for testing)
60ed7ab
raw
history blame
308 Bytes
from handler import EndpointHandler
# init handler
my_handler = EndpointHandler(path=".")
# prepare sample payload
payload = {"inputs": "I want to turn the next page of the"}
# test the handler
payload=my_handler(payload, additional_bad_words_ids=[[1234, 2345]])
# show results
print("output:", payload)