notus-7B-v1-GGUF

Runtime error

limcheekin commited on Dec 10, 2023

Commit

877e768

1 Parent(s): 55fe9af

feat: updated to notus-7B-v1-GGUF

Files changed (4) hide show

Dockerfile CHANGED Viewed

@@ -15,7 +15,7 @@ RUN pip install -U pip setuptools wheel && \
 # Download model
 RUN mkdir model && \
-    curl -L https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF/resolve/main/zephyr-7b-beta.Q4_K_M.gguf -o model/gguf-model.bin
 COPY ./start_server.sh ./
 COPY ./main.py ./

 # Download model
 RUN mkdir model && \
+    curl -L https://huggingface.co/TheBloke/notus-7B-v1-GGUF/resolve/main/notus-7b-v1.Q6_K.gguf -o model/gguf-model.bin
 COPY ./start_server.sh ./
 COPY ./main.py ./

README.md CHANGED Viewed

@@ -1,20 +1,20 @@
 ---
-title: zephyr-7B-beta-GGUF (Q4_K_M)
 colorFrom: purple
 colorTo: blue
 sdk: docker
 models:
-  - HuggingFaceH4/zephyr-7b-beta
-  - TheBloke/zephyr-7B-beta-GGUF
 tags:
   - inference api
   - openai-api compatible
   - llama-cpp-python
-  - zephyr-7B-beta-GGUF
   - gguf
 pinned: false
 ---
-# zephyr-7B-beta-GGUF (Q4_K_M)
 Please refer to the [index.html](index.html) for more information.

 ---
+title: notus-7B-v1-GGUF (Q6_K)
 colorFrom: purple
 colorTo: blue
 sdk: docker
 models:
+  - argilla/notus-7b-v1
+  - TheBloke/notus-7B-v1-GGUF
 tags:
   - inference api
   - openai-api compatible
   - llama-cpp-python
+  - notus-7B-v1-GGUF
   - gguf
 pinned: false
 ---
+# notus-7B-v1-GGUF (Q6_K)
 Please refer to the [index.html](index.html) for more information.

index.html CHANGED Viewed

@@ -1,13 +1,15 @@
 <!DOCTYPE html>
 <html>
   <head>
-    <title>zephyr-7B-beta-GGUF (Q4_K_M)</title>
   </head>
   <body>
-    <h1>zephyr-7B-beta-GGUF (Q4_K_M)</h1>
     <p>
       With the utilization of the
-      <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a>
       package, we are excited to introduce the GGUF model hosted in the Hugging
       Face Docker Spaces, made accessible through an OpenAI-compatible API. This
       space includes comprehensive API documentation to facilitate seamless
@@ -16,27 +18,17 @@
     <ul>
       <li>
         The API endpoint:
-        <a href="https://limcheekin-zephyr-7b-beta-gguf.hf.space/v1"
-          >https://limcheekin-zephyr-7b-beta-gguf.hf.space/v1</a
         >
       </li>
       <li>
         The API doc:
-        <a href="https://limcheekin-zephyr-7b-beta-gguf.hf.space/docs"
-          >https://limcheekin-zephyr-7b-beta-gguf.hf.space/docs</a
         >
       </li>
     </ul>
-    <p>
-      Go ahead and try it out the API endpoint yourself with the
-      <a
-        href="https://huggingface.co/spaces/limcheekin/zephyr-7B-beta-GGUF/blob/main/zephyr-7b.ipynb"
-        target="_blank"
-      >
-        zephyr-7b.ipynb</a
-      >
-      jupyter notebook.
-    </p>
     <p>
       If you find this resource valuable, your support in the form of starring
       the space would be greatly appreciated. Your engagement plays a vital role

 <!DOCTYPE html>
 <html>
   <head>
+    <title>notus-7B-v1-GGUF (Q6_K)</title>
   </head>
   <body>
+    <h1>notus-7B-v1-GGUF (Q6_K)</h1>
     <p>
       With the utilization of the
+      <a href="https://github.com/abetlen/llama-cpp-python" target="_blank"
+        >llama-cpp-python</a
+      >
       package, we are excited to introduce the GGUF model hosted in the Hugging
       Face Docker Spaces, made accessible through an OpenAI-compatible API. This
       space includes comprehensive API documentation to facilitate seamless
     <ul>
       <li>
         The API endpoint:
+        <a href="https://limcheekin-notus-7b-v1-gguf.hf.space/v1"
+          >https://limcheekin-notus-7b-v1-gguf.hf.space/v1</a
         >
       </li>
       <li>
         The API doc:
+        <a href="https://limcheekin-notus-7b-v1-gguf.hf.space/docs"
+          >https://limcheekin-notus-7b-v1-gguf.hf.space/docs</a
         >
       </li>
     </ul>
     <p>
       If you find this resource valuable, your support in the form of starring
       the space would be greatly appreciated. Your engagement plays a vital role

zephyr-7b.ipynb DELETED Viewed

The diff for this file is too large to render. See raw diff