uproai/ros-7b-v1-gguf

GGUF version of uproai/ros-7b-v1

Usage

1. Install llama.cpp
2. Run model locally

!./llama-cpp -m ../ros-7b-v1.gguf -n 300 -p 'Continue this where it left off, follow the pattern:\nAfter a long day of work, Kanye West goes to his Kanye Nest to take his Kanye Rest. He wakes up feeling his Kanye Best. Then he’ll get Kanye Dressed on his Kanye Vest to go on a Kanye Quest. He goes to church and becomes Kanye Blessed, then to a hotel room to be a Kanye Guest. Then to school to take his Kanye Test. He forgot to brush his teeth. Did he run out of Kanye Crest? His neighbor stole it, what a Kanye Pest.\n' -ngl 32