Update README.md

README.md

@@ -15,8 +15,6 @@ pipeline_tag: text-generation
 
 # MedleyMD
 
-# NOTE: Experimental
-
 ![logo](https://huggingface.co/sethuiyer/MedleyMD/resolve/main/logo.webp)
 
 
@@ -24,6 +22,8 @@ MedleyMD is a Mixure of Experts (MoE) made with the following models using [Lazy
 * [sethuiyer/Dr_Samantha_7b_mistral](https://huggingface.co/sethuiyer/Dr_Samantha_7b_mistral)
 * [fblgit/UNA-TheBeagle-7b-v1](https://huggingface.co/fblgit/UNA-TheBeagle-7b-v1)
 
+These models were chosen because `fblgit/UNA-TheBeagle-7b-v1` has excellent performance for a 7B parameter model and Dr.Samantha has capabilities of a medical knowledge-focused model (trained on USMLE databases and doctor-patient interactions) with the philosophical, psychological, and relational understanding, scoring 68.82% in topics related to clinical domain. 
+
 ## 🧩 Configuration
 
 ```yaml
@@ -40,6 +40,18 @@ experts:
 
 ```
 
+## GGUF
+GGUF is available to download. 
+1. [medleymd.Q4_K_M](https://huggingface.co/sethuiyer/MedleyMD-GGUF/resolve/main/medleymd.Q4_K_M.gguf) [7.2GB]
+2. [medleymd.Q5_K_M](https://huggingface.co/sethuiyer/MedleyMD-GGUF/resolve/main/medleymd.Q5_K_M.gguf) [9.13GB]
+
+
+## Ollama
+
+MedleyMD is now available on Ollama. You can use it by running the command ```ollama run stuehieyr/medleymd``` in your 
+terminal. If you have limited computing resources, check out this [video](https://www.youtube.com/watch?v=Qa1h7ygwQq8) to learn how to run it on 
+a Google Colab backend.
+
 ## 💻 Usage
 
 ```python
@@ -69,7 +81,7 @@ generation_kwargs = {
 messages = [{"role":"system", "content":"You are an helpful AI assistant. Please use </s> when you want to end the answer."},
 {"role": "user", "content": "Explain what a Mixture of Experts is in less than 100 words."}]
 prompt = pipeline.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
-outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
+outputs = pipeline(prompt, **generation_kwargs)
 print(outputs[0]["generated_text"])
 ```