| <html> | |
| <head> | |
| <title>GGUF Inference</title> | |
| </head> | |
| <body> | |
| <h1>GGUF Inference API</h1> | |
| <h2>Currently running zephyr-7B-alpha(Q4_K_M)</h2> | |
| <p> | |
| <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a> | |
| </p> | |
| <ul> | |
| <li> | |
| <a href="https://0x81632-gguf-api.hf.space/docs" | |
| >/docs</a | |
| > | |
| </li> | |
| </ul> | |
| <p> | |
| </p> | |
| </body> | |
| </html> | |