Spaces:
Runtime error
Runtime error
medium link
Browse files
app.py
CHANGED
@@ -208,6 +208,7 @@ with gr.Blocks() as arena:
|
|
208 |
with gr.Column():
|
209 |
gr.Markdown(f"""
|
210 |
### brought to you by OpenAccess AI Collective
|
|
|
211 |
- This Space runs on CPU only, and uses GGML with GPU support via Runpod Serverless.
|
212 |
- Due to limitations of Runpod Serverless, it cannot stream responses immediately
|
213 |
- Responses WILL take AT LEAST 30 seconds to respond, probably longer
|
|
|
208 |
with gr.Column():
|
209 |
gr.Markdown(f"""
|
210 |
### brought to you by OpenAccess AI Collective
|
211 |
+
- Checkout out [our writeup on how this was built.](https://medium.com/@winglian/inference-any-llm-with-serverless-in-15-minutes-69eeb548a41d)
|
212 |
- This Space runs on CPU only, and uses GGML with GPU support via Runpod Serverless.
|
213 |
- Due to limitations of Runpod Serverless, it cannot stream responses immediately
|
214 |
- Responses WILL take AT LEAST 30 seconds to respond, probably longer
|