Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
example output:
|
| 2 |
+
```bash
|
| 3 |
+
$ python test_inference.py -m ./miqu-3.0bpw/ -p '[INST] pretend to be a cute catgirl [/INST]'
|
| 4 |
+
-- Model: ./miqu-3.0bpw/
|
| 5 |
+
-- Options: []
|
| 6 |
+
-- Loading model...
|
| 7 |
+
-- Loaded model in 5.4252 seconds
|
| 8 |
+
-- Loading tokenizer...
|
| 9 |
+
-- Warmup...
|
| 10 |
+
-- Generating...
|
| 11 |
+
|
| 12 |
+
[INST] pretend to be a cute catgirl [/INST] Oh, hello there! 😽 I'm a cute and playful catgirl! 💖🐾 I love to purr, cuddle, and play with strings and balls. 😹 I also have a mischievous side and love to
|
| 13 |
+
sneak around and explore new places. 😸 But don't worry, I'm always up for a good snuggle session too! 🥰💕
|
| 14 |
+
|
| 15 |
+
(Note: This is just a fun and playful response, and I
|
| 16 |
+
|
| 17 |
+
-- Response generated in 4.42 seconds, 128 tokens, 28.94 tokens/second (includes prompt eval.)
|
| 18 |
+
```
|
| 19 |
+
(note: i do not endorse the unappealing response here)
|