Upload 16 files

LICENSE.txt

@@ -0,0 +1,201 @@
+                                 Apache License
+                           Version 2.0, January 2004
+                        http://www.apache.org/licenses/
+
+   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity. For the purposes of this definition,
+      "control" means (i) the power, direct or indirect, to cause the
+      direction or management of such entity, whether by contract or
+      otherwise, or (ii) ownership of fifty percent (50%) or more of the
+      outstanding shares, or (iii) beneficial ownership of such entity.
+
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+      "Work" shall mean the work of authorship, whether in Source or
+      Object form, made available under the License, as indicated by a
+      copyright notice that is included in or attached to the work
+      (an example is provided in the Appendix below).
+
+      "Derivative Works" shall mean any work, whether in Source or Object
+      form, that is based on (or derived from) the Work and for which the
+      editorial revisions, annotations, elaborations, or other modifications
+      represent, as a whole, an original work of authorship. For the purposes
+      of this License, Derivative Works shall not include works that remain
+      separable from, or merely link (or bind by name) to the interfaces of,
+      the Work and Derivative Works thereof.
+
+      "Contribution" shall mean any work of authorship, including
+      the original version of the Work and any modifications or additions
+      to that Work or Derivative Works thereof, that is intentionally
+      submitted to Licensor for inclusion in the Work by the copyright owner
+      or by an individual or Legal Entity authorized to submit on behalf of
+      the copyright owner. For the purposes of this definition, "submitted"
+      means any form of electronic, verbal, or written communication sent
+      to the Licensor or its representatives, including but not limited to
+      communication on electronic mailing lists, source code control systems,
+      and issue tracking systems that are managed by, or on behalf of, the
+      Licensor for the purpose of discussing and improving the Work, but
+      excluding communication that is conspicuously marked or otherwise
+      designated in writing by the copyright owner as "Not a Contribution."
+
+      "Contributor" shall mean Licensor and any individual or Legal Entity
+      on behalf of whom a Contribution has been received by Licensor and
+      subsequently incorporated within the Work.
+
+   2. Grant of Copyright License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      copyright license to reproduce, prepare Derivative Works of,
+      publicly display, publicly perform, sublicense, and distribute the
+      Work and such Derivative Works in Source or Object form.
+
+   3. Grant of Patent License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      (except as stated in this section) patent license to make, have made,
+      use, offer to sell, sell, import, and otherwise transfer the Work,
+      where such license applies only to those patent claims licensable
+      by such Contributor that are necessarily infringed by their
+      Contribution(s) alone or by combination of their Contribution(s)
+      with the Work to which such Contribution(s) was submitted. If You
+      institute patent litigation against any entity (including a
+      cross-claim or counterclaim in a lawsuit) alleging that the Work
+      or a Contribution incorporated within the Work constitutes direct
+      or contributory patent infringement, then any patent licenses
+      granted to You under this License for that Work shall terminate
+      as of the date such litigation is filed.
+
+   4. Redistribution. You may reproduce and distribute copies of the
+      Work or Derivative Works thereof in any medium, with or without
+      modifications, and in Source or Object form, provided that You
+      meet the following conditions:
+
+      (a) You must give any other recipients of the Work or
+          Derivative Works a copy of this License; and
+
+      (b) You must cause any modified files to carry prominent notices
+          stating that You changed the files; and
+
+      (c) You must retain, in the Source form of any Derivative Works
+          that You distribute, all copyright, patent, trademark, and
+          attribution notices from the Source form of the Work,
+          excluding those notices that do not pertain to any part of
+          the Derivative Works; and
+
+      (d) If the Work includes a "NOTICE" text file as part of its
+          distribution, then any Derivative Works that You distribute must
+          include a readable copy of the attribution notices contained
+          within such NOTICE file, excluding those notices that do not
+          pertain to any part of the Derivative Works, in at least one
+          of the following places: within a NOTICE text file distributed
+          as part of the Derivative Works; within the Source form or
+          documentation, if provided along with the Derivative Works; or,
+          within a display generated by the Derivative Works, if and
+          wherever such third-party notices normally appear. The contents
+          of the NOTICE file are for informational purposes only and
+          do not modify the License. You may add Your own attribution
+          notices within Derivative Works that You distribute, alongside
+          or as an addendum to the NOTICE text from the Work, provided
+          that such additional attribution notices cannot be construed
+          as modifying the License.
+
+      You may add Your own copyright statement to Your modifications and
+      may provide additional or different license terms and conditions
+      for use, reproduction, or distribution of Your modifications, or
+      for any such Derivative Works as a whole, provided Your use,
+      reproduction, and distribution of the Work otherwise complies with
+      the conditions stated in this License.
+
+   5. Submission of Contributions. Unless You explicitly state otherwise,
+      any Contribution intentionally submitted for inclusion in the Work
+      by You to the Licensor shall be under the terms and conditions of
+      this License, without any additional terms or conditions.
+      Notwithstanding the above, nothing herein shall supersede or modify
+      the terms of any separate license agreement you may have executed
+      with Licensor regarding such Contributions.
+
+   6. Trademarks. This License does not grant permission to use the trade
+      names, trademarks, service marks, or product names of the Licensor,
+      except as required for reasonable and customary use in describing the
+      origin of the Work and reproducing the content of the NOTICE file.
+
+   7. Disclaimer of Warranty. Unless required by applicable law or
+      agreed to in writing, Licensor provides the Work (and each
+      Contributor provides its Contributions) on an "AS IS" BASIS,
+      WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+      implied, including, without limitation, any warranties or conditions
+      of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
+      PARTICULAR PURPOSE. You are solely responsible for determining the
+      appropriateness of using or redistributing the Work and assume any
+      risks associated with Your exercise of permissions under this License.
+
+   8. Limitation of Liability. In no event and under no legal theory,
+      whether in tort (including negligence), contract, or otherwise,
+      unless required by applicable law (such as deliberate and grossly
+      negligent acts) or agreed to in writing, shall any Contributor be
+      liable to You for damages, including any direct, indirect, special,
+      incidental, or consequential damages of any character arising as a
+      result of this License or out of the use or inability to use the
+      Work (including but not limited to damages for loss of goodwill,
+      work stoppage, computer failure or malfunction, or any and all
+      other commercial damages or losses), even if such Contributor
+      has been advised of the possibility of such damages.
+
+   9. Accepting Warranty or Additional Liability. While redistributing
+      the Work or Derivative Works thereof, You may choose to offer,
+      and charge a fee for, acceptance of support, warranty, indemnity,
+      or other liability obligations and/or rights consistent with this
+      License. However, in accepting such obligations, You may act only
+      on Your own behalf and on Your sole responsibility, not on behalf
+      of any other Contributor, and only if You agree to indemnify,
+      defend, and hold each Contributor harmless for any liability
+      incurred by, or claims asserted against, such Contributor by reason
+      of your accepting any such warranty or additional liability.
+
+   END OF TERMS AND CONDITIONS
+
+   APPENDIX: How to apply the Apache License to your work.
+
+      To apply the Apache License to your work, attach the following
+      boilerplate notice, with the fields enclosed by brackets "[]"
+      replaced with your own identifying information. (Don't include
+      the brackets!)  The text should be enclosed in the appropriate
+      comment syntax for the file format. We also recommend that a
+      file or class name and description of purpose be included on the
+      same "printed page" as the copyright notice for easier
+      identification within third-party archives.
+
+   Copyright 2023-2024 by AI Bloks for LLMWare 
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+       http://www.apache.org/licenses/LICENSE-2.0
+
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.

README.md

@@ -1,3 +1,37 @@
----
-license: apache-2.0
----
+---
+license: apache-2.0
+inference: false 
+tags: [green, llmware-fx, p3, ov]
+---
+
+# slim-extract-phi-3-ov
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+**slim-extract-phi-3-ov** is an OpenVino int4 quantized version of SLIM Extract Phi-3, providing a very fast, very small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.    
+
+[**slim-extract-phi-3**](https://huggingface.co/llmware/slim-extract-phi-3) is a specialized function-calling model designed to extract information from complex documents.  
+
+Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino) 
+
+Looking for AI PC solutions and demos, contact us at [llmware](https://www.llmware.ai)    
+
+
+### Model Description
+
+- **Developed by:** llmware  
+- **Model type:** tinyllama  
+- **Parameters:** 1.1 billion
+- **Model Parent:** llmware/bling-tiny-llama-v0  
+- **Language(s) (NLP):** English  
+- **License:** Apache 2.0  
+- **Uses:** Fact-based question-answering  
+- **RAG Benchmark Accuracy Score:** 86.5  
+- **Quantization:** int4  
+  
+
+## Model Card Contact
+
+[llmware on hf](https://www.huggingface.co/llmware)  
+
+[llmware website](https://www.llmware.ai)  

added_tokens.json

@@ -0,0 +1,40 @@
+{
+  "<|/code|>": 32014,
+  "<|/data|>": 32033,
+  "<|/inst|>": 32037,
+  "<|/query|>": 32031,
+  "<|/sys|>": 32035,
+  "<|assistant_mask|>": 32017,
+  "<|assistant|>": 32001,
+  "<|calc|>": 32012,
+  "<|code|>": 32013,
+  "<|continue|>": 32009,
+  "<|data|>": 32032,
+  "<|diff_marker|>": 32025,
+  "<|disc_sep|>": 32029,
+  "<|disc_start|>": 32028,
+  "<|disc_thread|><|query|>": 32030,
+  "<|endoftext|>": 32000,
+  "<|end|>": 32007,
+  "<|fim_middle|>": 32021,
+  "<|fim_prefix|>": 32020,
+  "<|fim_suffix|>": 32022,
+  "<|function_call|>": 32005,
+  "<|function_list|>": 32011,
+  "<|function_output|>": 32003,
+  "<|ghissue|>": 32026,
+  "<|ghreview|>": 32027,
+  "<|inst|>": 32036,
+  "<|ipynb_marker|>": 32024,
+  "<|message|>": 32019,
+  "<|meta_start|>": 32023,
+  "<|raw|>": 32008,
+  "<|resource|>": 32016,
+  "<|start|>": 32018,
+  "<|step|>": 32002,
+  "<|summary|>": 32015,
+  "<|system|>": 32006,
+  "<|sys|>": 32034,
+  "<|tag|>": 32004,
+  "<|user|>": 32010
+}

config.json

@@ -0,0 +1,42 @@
+{
+  "_name_or_path": "llmware/slim-extract-phi-3",
+  "aib_version": "model_archive_072424_phi3_extract_eot_5",
+  "architectures": [
+    "Phi3ForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "auto_map": {
+    "AutoConfig": "microsoft/Phi-3-mini-4k-instruct--configuration_phi3.Phi3Config",
+    "AutoModelForCausalLM": "microsoft/Phi-3-mini-4k-instruct--modeling_phi3.Phi3ForCausalLM"
+  },
+  "bos_token_id": 1,
+  "embd_pdrop": 0.0,
+  "eos_token_id": 32000,
+  "hidden_act": "silu",
+  "hidden_size": 3072,
+  "initializer_range": 0.02,
+  "intermediate_size": 8192,
+  "max_position_embeddings": 4096,
+  "model_type": "phi3",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 32,
+  "original_max_position_embeddings": 4096,
+  "pad_token_id": 32000,
+  "resid_pdrop": 0.0,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": null,
+  "rope_theta": 10000.0,
+  "sliding_window": 2047,
+  "tie_word_embeddings": false,
+  "trained": "custom training",
+  "training_comments": "phi3-38-extract-eot-072424-5",
+  "training_dataset": [
+    "extract2_new_031724_eot_2_9442.jsonl"
+  ],
+  "training_timestamp": "Wed Jul 24 11:12:19 2024",
+  "transformers_version": "4.41.2",
+  "use_cache": true,
+  "vocab_size": 32064
+}

generation_config.json

@@ -0,0 +1,10 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 1,
+  "eos_token_id": [
+    32000,
+    32007
+  ],
+  "pad_token_id": 32000,
+  "transformers_version": "4.41.2"
+}

hash_record_sha256.json

@@ -0,0 +1,50 @@
+{
+ "10158455398104230730.cl_cache": "aa7b063d9d0f89556595dc0db7112f57fc72730dc223a11188ce0791a4a049e4",
+ "10356021205630361428.cl_cache": "a302b123b0533d3c3940cc8eb18e16b1361fcda8ed0720ed6c5752ec165049b4",
+ "11960430187801635767.cl_cache": "fd86af045b8b57fbf9c98f1ea269cb4d6927d97d5649e96f34c1229ae0bdb139",
+ "12220008416992186874.cl_cache": "086083969166e2236641c10f1dda3bd58cb91355f43515b9ae57b7816a5c3d68",
+ "12491022070653493942.cl_cache": "aec88a4d1c8345dce169a8140d58dcdec90f115e218d1189eff0df5d1a691d3f",
+ "12653708375522326167.blob": "7f411673303128cb40aaed9f8dc7089bb3976750364c1cfc3a4a657df84a0529",
+ "13478782897627348977.cl_cache": "bc36e50f9592c08fe079518e487af5b0107dfe2d4d19812d844c439121414004",
+ "13554085573973268955.cl_cache": "e2b3d7aeafb4ea7434de70cfb843faea2eda0a8fe6875288ea1eff85a6373fba",
+ "1369503952285004803.cl_cache": "b1e3396b616d4eb7267b0d8ffa9794cdc09d70c8660fa19ddd894e0fa260c75f",
+ "13996787936830972335.cl_cache": "9d78146c0fa50919d32e42868a4af02c24bd63ebc16dd564126cb6b77d649ec8",
+ "16013559403963528396.cl_cache": "db356ca8754384e288c5b0feb2d84420ace8f747bf1f1e8e75706dafad1ec5ab",
+ "16763274895828577765.cl_cache": "7edf6dcbe72704e0ba75f5477bd25486bc2dd43f295b94b59db69a140adec81f",
+ "17057819248123174357.cl_cache": "48a8394e4230da0c34c69f77a4fb3a17b3d7df627092199615bb897223bc532e",
+ "17241201940673546154.cl_cache": "89c7f3c99a027936fb9144073338922f79497b934615ca494777fd7f5d784bfb",
+ "1790420631157243714.cl_cache": "f962822abb9b3674b98a368487ed556f0d066cac530b9b3716d771c527acc69e",
+ "17912415656894965490.cl_cache": "c23621773c88c749f8d5e974354f9853bd986174de5335e583c060962d00ee9b",
+ "18425406304142639651.cl_cache": "749f3a8df9a6164f2343880e4ceacf15381d5278b043550f0dcb3bd33d14e699",
+ "1961299979340114348.cl_cache": "d2046d92627a6bbbef9ee77f23fca547388eb2e5b24e69789c4f0350e7ecaf42",
+ "2490283793109781502.cl_cache": "ad809d6d011ea8162e1f5ad69ef36092c97ac8c5228dd3def499edc9c4e257df",
+ "2988057519490477592.cl_cache": "4c800b66f11182f6a083559b8083e159ea5c705c661dc32a97f2d3888dcad06a",
+ "3035564998975493395.cl_cache": "05c5f116b58f3f0052f1befdd83b5a45a2c5a601f6a530806ea058cf896e7a71",
+ "3202048464753725830.cl_cache": "e4dccfa9d8be55707a3261025ac3a48db02a47be7069200e00dc43920b0eb7a7",
+ "3657412230478188205.cl_cache": "467ee9ec2468914abbbd7c07c48dd603086e8d746b8e4d10d7d57c3124324de8",
+ "5017985870279549188.cl_cache": "d5e499a08991ab55d3b8b1b2c24d7fe58ed4a53e0c195513877880ec931b3b2f",
+ "5245770289428366785.cl_cache": "72a72749aee9b297fa2ba37eb5a36e7f31343fa108b95c278e372364ce22beba",
+ "5411758822553378190.cl_cache": "b71c616a76178e82ddea79c815daa386236fc8c1506118c3451322580db09bce",
+ "573295667991143319.cl_cache": "80efeeadad35ae1a58978f9e058c69cadbc36323b6223b439341e7932c56e2d1",
+ "7108403470358601067.cl_cache": "17013330e02b1db49aaf29f2f7f33cd5d7e35a011d8f9615380016104e1e1cd2",
+ "7734636128102750636.cl_cache": "655f4026a589e9af1f2d3939198d79c985a4622eac9cecd057c1d4e4462ae370",
+ "7828399907612310370.cl_cache": "330e4cbc9733e35ac4bc738ad4fe14b8389bc13f17342dc46a35db5f86030229",
+ "7975488413534497659.cl_cache": "12c108fdfd5af94901bbda32653526e4999a3230bd9ef4491dd18af8ed7758a5",
+ "8452604528763337239.cl_cache": "c5135e867986393344391cf1ed34e3905b5d85ee1409ed5402c730b817cc00ac",
+ "9084728301640608858.cl_cache": "3add911fcf5d6c908b85c054ace22fb3cc98f912460f6f696c0d8dc68237f237",
+ "9986486564802383596.cl_cache": "6a08cf57bb90089f47b159ab4a519cbec86257fe34be1c9e47d2fc61120e3cd3",
+ "added_tokens.json": "7af7f1ff8a66841fa0bf4e1b4350d71caf111799c91bdd42272dca5545241796",
+ "config.json": "fd7639a9c26aa7ae46298e449b0d3c947b4721c8799780d0c6b0c6b21562b716",
+ "generation_config.json": "bea05b249fe75006b6cb734c0bee478c20b3db68962bd90a442c574af31a9ffa",
+ "openvino_detokenizer.bin": "f11b42a41c9694e27832929f9dc97f663d7e811f705e219dec3361a9521a4009",
+ "openvino_detokenizer.xml": "3672e5730d0dac0ea70345533ea9b849a4c3cffac90a537cad50857c714a364a",
+ "openvino_model.bin": "22727e37d8d01690f2ce9a354f65fb19404cdfbf0489f343ab9b46c9c49b2c9b",
+ "openvino_model.xml": "7fe37b353299e8d29f748a12a2a77ed8d4c593f8256307050377202e2dd6d066",
+ "openvino_tokenizer.bin": "373cb59c30a5a5679a23cdfd128c2048e1a574dc0384d1f0316ec717481fd87c",
+ "openvino_tokenizer.xml": "ecf33d36a0f3211b17ee87e839d03f28bfee0df03c537ff28a9eff2eda80e028",
+ "special_tokens_map.json": "84efd40e1c3094f99f07b8a51e57faad59711164938f18a1f6b2c567fc82e4a7",
+ "tokenizer.json": "ef8af2aa4fb2460f062916c8c4c1a20a5076f7613d31b0e3166ccbae68894e68",
+ "tokenizer.model": "9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347",
+ "tokenizer_config.json": "aa672fe65c22e74675e39f8d052b961534729bbfb834cae8a4ea136d87486cf5",
+ "time_stamp": "2024-07-30_133041"
+}

openvino_detokenizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f11b42a41c9694e27832929f9dc97f663d7e811f705e219dec3361a9521a4009
+size 500584

openvino_detokenizer.xml

@@ -0,0 +1,97 @@
+<?xml version="1.0"?>
+<net name="detokenizer" version="11">
+	<layers>
+		<layer id="0" name="Parameter_221835" type="Parameter" version="opset1">
+			<data shape="?,?" element_type="i64" />
+			<output>
+				<port id="0" precision="I64" names="Parameter_221835">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="1" name="Constant_221815" type="Const" version="opset1">
+			<data element_type="u8" shape="500584" offset="0" size="500584" />
+			<output>
+				<port id="0" precision="U8">
+					<dim>500584</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="2" name="Convert_221845" type="Convert" version="opset1">
+			<data destination_type="i32" />
+			<input>
+				<port id="0" precision="I64">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="1" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="3" name="SentencepieceDetokenizer_221836" type="SentencepieceDetokenizer" version="extension">
+			<input>
+				<port id="0" precision="U8">
+					<dim>500584</dim>
+				</port>
+				<port id="1" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="2" precision="I32">
+					<dim>-1</dim>
+				</port>
+				<port id="3" precision="I32">
+					<dim>-1</dim>
+				</port>
+				<port id="4" precision="U8">
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="4" name="StringTensorPack_221837" type="StringTensorPack" version="extension">
+			<data mode="begins_ends" />
+			<input>
+				<port id="0" precision="I32">
+					<dim>-1</dim>
+				</port>
+				<port id="1" precision="I32">
+					<dim>-1</dim>
+				</port>
+				<port id="2" precision="U8">
+					<dim>-1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="3" precision="STRING" names="string_output">
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="5" name="Result_221838" type="Result" version="opset1">
+			<input>
+				<port id="0" precision="STRING">
+					<dim>-1</dim>
+				</port>
+			</input>
+		</layer>
+	</layers>
+	<edges>
+		<edge from-layer="0" from-port="0" to-layer="2" to-port="0" />
+		<edge from-layer="1" from-port="0" to-layer="3" to-port="0" />
+		<edge from-layer="2" from-port="1" to-layer="3" to-port="1" />
+		<edge from-layer="3" from-port="2" to-layer="4" to-port="0" />
+		<edge from-layer="3" from-port="3" to-layer="4" to-port="1" />
+		<edge from-layer="3" from-port="4" to-layer="4" to-port="2" />
+		<edge from-layer="4" from-port="3" to-layer="5" to-port="0" />
+	</edges>
+	<rt_info>
+		<eos_token_id value="32000" />
+	</rt_info>
+</net>

openvino_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:22727e37d8d01690f2ce9a354f65fb19404cdfbf0489f343ab9b46c9c49b2c9b
+size 2432074256

openvino_tokenizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:373cb59c30a5a5679a23cdfd128c2048e1a574dc0384d1f0316ec717481fd87c
+size 500520

openvino_tokenizer.xml

@@ -0,0 +1,231 @@
+<?xml version="1.0"?>
+<net name="tokenizer" version="11">
+	<layers>
+		<layer id="0" name="string_input" type="Parameter" version="opset1">
+			<data shape="?" element_type="string" />
+			<output>
+				<port id="0" precision="STRING" names="string_input">
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="1" name="Constant_221821" type="Const" version="opset1">
+			<data element_type="i32" shape="" offset="0" size="4" />
+			<output>
+				<port id="0" precision="I32" />
+			</output>
+		</layer>
+		<layer id="2" name="Constant_221814" type="Const" version="opset1">
+			<data element_type="u8" shape="500508" offset="4" size="500508" />
+			<output>
+				<port id="0" precision="U8">
+					<dim>500508</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="3" name="SentencepieceTokenizer_221817" type="SentencepieceTokenizer" version="extension">
+			<data nbest_size="0" alpha="0" add_bos="true" add_eos="false" reverse="false" />
+			<input>
+				<port id="0" precision="U8">
+					<dim>500508</dim>
+				</port>
+				<port id="1" precision="STRING">
+					<dim>-1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="2" precision="I64">
+					<dim>-1</dim>
+					<dim>2</dim>
+				</port>
+				<port id="3" precision="I32">
+					<dim>-1</dim>
+				</port>
+				<port id="4" precision="I64">
+					<dim>2</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="4" name="Broadcast_221822" type="Broadcast" version="opset3">
+			<data mode="numpy" />
+			<input>
+				<port id="0" precision="I32" />
+				<port id="1" precision="I64">
+					<dim>2</dim>
+				</port>
+			</input>
+			<output>
+				<port id="2" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="5" name="Constant_221823" type="Const" version="opset1">
+			<data element_type="i32" shape="" offset="500512" size="4" />
+			<output>
+				<port id="0" precision="I32" />
+			</output>
+		</layer>
+		<layer id="6" name="ShapeOf_221824" type="ShapeOf" version="opset3">
+			<data output_type="i64" />
+			<input>
+				<port id="0" precision="I32">
+					<dim>-1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="1" precision="I64">
+					<dim>1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="7" name="Broadcast_221825" type="Broadcast" version="opset3">
+			<data mode="numpy" />
+			<input>
+				<port id="0" precision="I32" />
+				<port id="1" precision="I64">
+					<dim>1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="2" precision="I32">
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="8" name="ScatterNDUpdate_221829" type="ScatterNDUpdate" version="opset4">
+			<input>
+				<port id="0" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+				<port id="1" precision="I64">
+					<dim>-1</dim>
+					<dim>2</dim>
+				</port>
+				<port id="2" precision="I32">
+					<dim>-1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="3" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="9" name="ScatterNDUpdate_221829" type="Convert" version="opset1">
+			<data destination_type="i64" />
+			<input>
+				<port id="0" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="1" precision="I64" names="attention_mask">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="11" name="Constant_221818" type="Const" version="opset1">
+			<data element_type="i32" shape="" offset="500516" size="4" />
+			<output>
+				<port id="0" precision="I32" />
+			</output>
+		</layer>
+		<layer id="12" name="Broadcast_221819" type="Broadcast" version="opset3">
+			<data mode="numpy" />
+			<input>
+				<port id="0" precision="I32" />
+				<port id="1" precision="I64">
+					<dim>2</dim>
+				</port>
+			</input>
+			<output>
+				<port id="2" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="13" name="ScatterNDUpdate_221820" type="ScatterNDUpdate" version="opset4">
+			<input>
+				<port id="0" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+				<port id="1" precision="I64">
+					<dim>-1</dim>
+					<dim>2</dim>
+				</port>
+				<port id="2" precision="I32">
+					<dim>-1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="3" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="14" name="ScatterNDUpdate_221820" type="Convert" version="opset1">
+			<data destination_type="i64" />
+			<input>
+				<port id="0" precision="I32">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</input>
+			<output>
+				<port id="1" precision="I64" names="input_ids">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</output>
+		</layer>
+		<layer id="15" name="Result_221830" type="Result" version="opset1">
+			<input>
+				<port id="0" precision="I64">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</input>
+		</layer>
+		<layer id="10" name="Result_221831" type="Result" version="opset1">
+			<input>
+				<port id="0" precision="I64">
+					<dim>-1</dim>
+					<dim>-1</dim>
+				</port>
+			</input>
+		</layer>
+	</layers>
+	<edges>
+		<edge from-layer="0" from-port="0" to-layer="3" to-port="1" />
+		<edge from-layer="1" from-port="0" to-layer="4" to-port="0" />
+		<edge from-layer="2" from-port="0" to-layer="3" to-port="0" />
+		<edge from-layer="3" from-port="4" to-layer="4" to-port="1" />
+		<edge from-layer="3" from-port="3" to-layer="6" to-port="0" />
+		<edge from-layer="3" from-port="2" to-layer="8" to-port="1" />
+		<edge from-layer="3" from-port="4" to-layer="12" to-port="1" />
+		<edge from-layer="3" from-port="2" to-layer="13" to-port="1" />
+		<edge from-layer="3" from-port="3" to-layer="13" to-port="2" />
+		<edge from-layer="4" from-port="2" to-layer="8" to-port="0" />
+		<edge from-layer="5" from-port="0" to-layer="7" to-port="0" />
+		<edge from-layer="6" from-port="1" to-layer="7" to-port="1" />
+		<edge from-layer="7" from-port="2" to-layer="8" to-port="2" />
+		<edge from-layer="8" from-port="3" to-layer="9" to-port="0" />
+		<edge from-layer="9" from-port="1" to-layer="10" to-port="0" />
+		<edge from-layer="11" from-port="0" to-layer="12" to-port="0" />
+		<edge from-layer="12" from-port="2" to-layer="13" to-port="0" />
+		<edge from-layer="13" from-port="3" to-layer="14" to-port="0" />
+		<edge from-layer="14" from-port="1" to-layer="15" to-port="0" />
+	</edges>
+	<rt_info>
+		<eos_token_id value="32000" />
+	</rt_info>
+</net>

special_tokens_map.json

@@ -0,0 +1,33 @@
+{
+  "additional_special_tokens": [
+    "<|/inst|>"
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
+size 499723

tokenizer_config.json

@@ -0,0 +1,349 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": false
+    },
+    "32000": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32001": {
+      "content": "<|assistant|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32002": {
+      "content": "<|step|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32003": {
+      "content": "<|function_output|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32004": {
+      "content": "<|tag|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32005": {
+      "content": "<|function_call|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32006": {
+      "content": "<|system|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32007": {
+      "content": "<|end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32008": {
+      "content": "<|raw|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32009": {
+      "content": "<|continue|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32010": {
+      "content": "<|user|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32011": {
+      "content": "<|function_list|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32012": {
+      "content": "<|calc|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32013": {
+      "content": "<|code|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32014": {
+      "content": "<|/code|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32015": {
+      "content": "<|summary|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32016": {
+      "content": "<|resource|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32017": {
+      "content": "<|assistant_mask|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32018": {
+      "content": "<|start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32019": {
+      "content": "<|message|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32020": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32021": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32022": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32023": {
+      "content": "<|meta_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32024": {
+      "content": "<|ipynb_marker|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32025": {
+      "content": "<|diff_marker|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32026": {
+      "content": "<|ghissue|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32027": {
+      "content": "<|ghreview|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32028": {
+      "content": "<|disc_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32029": {
+      "content": "<|disc_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32030": {
+      "content": "<|disc_thread|><|query|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32031": {
+      "content": "<|/query|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32032": {
+      "content": "<|data|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32033": {
+      "content": "<|/data|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32034": {
+      "content": "<|sys|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32035": {
+      "content": "<|/sys|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32036": {
+      "content": "<|inst|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32037": {
+      "content": "<|/inst|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<|/inst|>"
+  ],
+  "bos_token": "<s>",
+  "chat_template": "{{ bos_token }}{% for message in messages %}{{'<|' + message['role'] + '|>' + '\n' + message['content'] + '<|end|>\n' }}{% endfor %}{% if add_generation_prompt %}{{ '<|assistant|>\n' }}{% else %}{{ eos_token }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "legacy": false,
+  "model_max_length": 4096,
+  "pad_token": "<|endoftext|>",
+  "padding_side": "left",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}