Spaces:
Running
Running
Commit
•
e543d33
1
Parent(s):
84b88a1
move "powered by" to down
Browse files- gradio_app.py +1 -2
gradio_app.py
CHANGED
@@ -29,12 +29,11 @@ I'm using here 13b model just for example. Also here's only CPU power.<br>
|
|
29 |
But you can use GPU power as well!<br><br>
|
30 |
<h1>How to GPU?</h1>
|
31 |
Change <code>`CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS`</code> in Dockerfile on <code>`CMAKE_ARGS="-DLLAMA_CUBLAS=on"`</code>. Also you can try <code>`DLLAMA_CLBLAST`</code> or <code>`DLLAMA_METAL`</code>.<br><br>
|
32 |
-
Powered by <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a> and <a href="https://www.gradio.app/">Gradio</a>.<br><br>
|
33 |
<h1>How to test it on own machine?</h1>
|
34 |
You can install Docker, build image and run it. I made <code>`run-docker.sh`</code> for ya. To stop container run <code>`docker ps`</code>, find name of container and run <code>`docker stop _dockerContainerName_`</code><br>
|
35 |
Or you can once follow steps in Dockerfile and try it on your machine, not in Docker.<br>
|
36 |
<br>''' + f"Memory used: {psutil.virtual_memory()[2]}<br>" + '''
|
37 |
-
<
|
38 |
|
39 |
'''
|
40 |
# Defining languages for translator (i just chose popular on my opinion languages!!!)
|
|
|
29 |
But you can use GPU power as well!<br><br>
|
30 |
<h1>How to GPU?</h1>
|
31 |
Change <code>`CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS`</code> in Dockerfile on <code>`CMAKE_ARGS="-DLLAMA_CUBLAS=on"`</code>. Also you can try <code>`DLLAMA_CLBLAST`</code> or <code>`DLLAMA_METAL`</code>.<br><br>
|
|
|
32 |
<h1>How to test it on own machine?</h1>
|
33 |
You can install Docker, build image and run it. I made <code>`run-docker.sh`</code> for ya. To stop container run <code>`docker ps`</code>, find name of container and run <code>`docker stop _dockerContainerName_`</code><br>
|
34 |
Or you can once follow steps in Dockerfile and try it on your machine, not in Docker.<br>
|
35 |
<br>''' + f"Memory used: {psutil.virtual_memory()[2]}<br>" + '''
|
36 |
+
Powered by <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a> and <a href="https://www.gradio.app/">Gradio</a>.<br><br>'''
|
37 |
|
38 |
'''
|
39 |
# Defining languages for translator (i just chose popular on my opinion languages!!!)
|