bradhutchings/llamafiles-mac-linux

Hello

Thanks for your interest in my llamafiles packages. These are free for your use. These packages run on MacOS X, Windows, and Linux.

There are three repos you need to visit:

• https://huggingface.co/bradhutchings/llamafiles-mac-linux/
• https://huggingface.co/bradhutchings/llamafiles-windows/
• https://huggingface.co/bradhutchings/gguf/

If you would like paid assistance or need help with AI projects, please email or start a discussion in the community. I do not accept pull requests.

-Brad
Brad Hutchings
brad@DemoMachine.net

Instructions

1. Create a folder. Your desktop is a good location. Call it LLMs or some such.
2. Download the gguf files for the models you want to run.
3. Move the .gguf files to that folder.
4. Mac and Linux users, visit this model: https://huggingface.co/bradhutchings/llamafiles-mac-linux/
   1. Download llamafile.llamafile.
   2. Move llamafile.llamafile to your LLMs folder.
   3. Download Start- .sh files corresponding to the .gguf files you downloaded.
   4. Move them to your LLMs folder.
   5. From a terminal, type:
      chmod a+x ~\LLMs\llamafile.llamafile
chmod a+x ~\LLMs\*.sh
   6. You can now run any of the .sh bash scripts to start an LLM and launch your browser.
5. Windows users, visit this model: https://huggingface.co/bradhutchings/llamafiles-windows/
   1. Download llamafile.exe.
   2. Move llamafile.exe to your LLMs folder.
   3. Download Start- .ps1 files corresponding to the .gguf files you downloaded.
   4. Move them to your LLMs folder.
   5. You can now run any of the .ps1 PowerShell scripts to start an LLM and launch your browser.