rokset3 commited on
Commit
4ec18d4
1 Parent(s): f8886c5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -50,8 +50,9 @@ model = AutoModelForCausalLM.from_pretrained(
50
  torch_dtype=torch.bfloat16
51
  )
52
  ```
53
-
54
- Use it inside via GOAT-STORYTELLING-AGENT framework:
 
55
 
56
  ```python
57
  from goat_storytelling_agent.story_processor.prompt_manager import generate_story
 
50
  torch_dtype=torch.bfloat16
51
  )
52
  ```
53
+ Currently, we support LLM endpoint generation, where you need to send a post request to generation endpoint (we recommend using Text Generation Inference by HuggingFace)
54
+ First, modify config.py and add your generation endpoint.
55
+ Then you can use it inside via GOAT-STORYTELLING-AGENT framework:
56
 
57
  ```python
58
  from goat_storytelling_agent.story_processor.prompt_manager import generate_story