Missing config.json therefore, can not download or run model using your github package
Have downloaded this model already, please provide config.json and instructions to modify your python packages so that I can load the model without having to re-download.
Thank you.
@kmmmmmmmm I have uploaded the config.json. For loading the model you can use the sample code in the readme. Could you please explain what instruction are you looking for?
I want to first use your app to ensure the model is loaded optimally, before making my own gradio app.
I need to use your sample gradio application from GitHub to learn about producing a custom gradio app, for making an assistant for a severely disabled person.
However your sample application only allows completing an entirely new download from huggingface before proceeding to load the model, this is not suitable due to my narrow bandwidth.
I want to know how to modify your sample code to skip the download method and proceed to the next step using the previously downloaded ggml-model-q4_0.bin and it's config.json.
However I may be mistaken, because I am assuming your GitHub sample application has the correct dependencies for loading the ggml format; if this is not the case I will look elsewhere for sample code and apologize for wasting your time.
Thank you for adding the .json file. I now see your github sample application is unsuitable for the ggml model. Thank you for your time.
Yes, that's right. The GitHub code only contains the code to load the normal format. ggml model loading is not currently added to the GitHub repo.