Geraldine commited on
Commit
b243bf6
1 Parent(s): 7908fed

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +34 -0
README.md ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Geraldine/FineZephir-sft-instruct-ead-16bit
3
+ language:
4
+ - en
5
+ license: apache-2.0
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - text-generation-inference
9
+ - transformers
10
+ - unsloth
11
+ - mistral
12
+ - trl
13
+ - sft
14
+ - openvino
15
+ - openvino-export
16
+ ---
17
+
18
+ This model was converted to OpenVINO from [`Geraldine/FineZephir-sft-instruct-ead-16bit`](https://huggingface.co/Geraldine/FineZephir-sft-instruct-ead-16bit) using [optimum-intel](https://github.com/huggingface/optimum-intel)
19
+ via the [export](https://huggingface.co/spaces/echarlaix/openvino-export) space.
20
+
21
+ First make sure you have optimum-intel installed:
22
+
23
+ ```bash
24
+ pip install optimum[openvino]
25
+ ```
26
+
27
+ To load your model you can do as follows:
28
+
29
+ ```python
30
+ from optimum.intel import OVModelForCausalLM
31
+
32
+ model_id = "Geraldine/FineZephir-sft-instruct-ead-16bit-openvino"
33
+ model = OVModelForCausalLM.from_pretrained(model_id)
34
+ ```