finnvoorhees commited on
Commit
2c168b4
·
verified ·
1 Parent(s): 5261af4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: coreml
3
+ tags:
4
+ - CoreMLPipelines
5
+ ---
6
+
7
+ # coreml-DeepSeek-R1-Distill-Qwen-1.5B-4bit
8
+
9
+ This model was converted from [deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B](https://hf.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) to CoreML using [coremlpipelinestools](https://github.com/finnvoor/CoreMLPipelines/tree/main/coremlpipelinestools).
10
+
11
+ ### Use with [CoreMLPipelines](https://github.com/finnvoor/CoreMLPipelines)
12
+
13
+ ```swift
14
+ import CoreMLPipelines
15
+
16
+ let pipeline = try await TextGenerationPipeline(
17
+ modelName: "finnvoorhees/coreml-DeepSeek-R1-Distill-Qwen-1.5B-4bit"
18
+ )
19
+ let stream = pipeline(
20
+ messages: [[
21
+ "role": "user",
22
+ "content": "Write a poem about Ireland"
23
+ ]]
24
+ )
25
+ for try await text in stream {
26
+ print(text, terminator: "")
27
+ fflush(stdout)
28
+ }
29
+ print("")
30
+ ```
31
+