|
--- |
|
title: Phi-3.5 WebGPU |
|
emoji: ⚡ |
|
colorFrom: yellow |
|
colorTo: red |
|
sdk: static |
|
pinned: false |
|
license: apache-2.0 |
|
models: |
|
- onnx-community/Phi-3.5-mini-instruct-onnx-web |
|
short_description: A powerful AI chatbot that runs locally in your browser |
|
thumbnail: https://huggingface.co/spaces/webml-community/phi-3.5-webgpu/resolve/main/banner.png |
|
--- |
|
|
|
# Phi-3.5 WebGPU |
|
|
|
A simple React + Vite application for running [Phi-3.5-mini-instruct](https://huggingface.co/onnx-community/Phi-3.5-mini-instruct-onnx-web), a powerful small language model, locally in the browser using Transformers.js and WebGPU-acceleration. |
|
|
|
## Getting Started |
|
|
|
Follow the steps below to set up and run the application. |
|
|
|
### 1. Clone the Repository |
|
|
|
Clone the examples repository from GitHub: |
|
|
|
```sh |
|
git clone https://github.com/huggingface/transformers.js-examples.git |
|
``` |
|
|
|
### 2. Navigate to the Project Directory |
|
|
|
Change your working directory to the `smollm-webgpu` folder: |
|
|
|
```sh |
|
cd transformers.js-examples/smollm-webgpu |
|
``` |
|
|
|
### 3. Install Dependencies |
|
|
|
Install the necessary dependencies using npm: |
|
|
|
```sh |
|
npm i |
|
``` |
|
|
|
### 4. Run the Development Server |
|
|
|
Start the development server: |
|
|
|
```sh |
|
npm run dev |
|
``` |
|
|
|
The application should now be running locally. Open your browser and go to `http://localhost:5173` to see it in action. |
|
|
