Update README.md
Browse files
README.md
CHANGED
@@ -23,4 +23,5 @@ JournaLLM is more than an app; it's a companion on your journey of self-discover
|
|
23 |
1. Clone the repository to you local folder: `git clone https://github.com/Ketansuhaas/JournaLLM.git`
|
24 |
2. Choose a pretrained LLM from [HuggingFace](https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v0.3-GGUF)
|
25 |
3. In `app.py`, change the model file in `llm = LlamaCpp(model_path=<model path>, n_ctx=2048)`.
|
26 |
-
4. In the terminal, type `streamlit run app.py`.
|
|
|
|
23 |
1. Clone the repository to you local folder: `git clone https://github.com/Ketansuhaas/JournaLLM.git`
|
24 |
2. Choose a pretrained LLM from [HuggingFace](https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v0.3-GGUF)
|
25 |
3. In `app.py`, change the model file in `llm = LlamaCpp(model_path=<model path>, n_ctx=2048)`.
|
26 |
+
4. In the terminal, type `streamlit run app.py`.
|
27 |
+
5. To use GPU, set `model_kwargs={"device": "gpu"}`
|