osanseviero
commited on
Commit
•
0592a76
1
Parent(s):
f406569
Update spaCy pipeline
Browse files- .gitattributes +4 -0
- LICENSE +359 -0
- LICENSES_SOURCES +371 -0
- README.md +59 -0
- accuracy.json +7 -0
- config.cfg +135 -0
- meta.json +51 -0
- senter/cfg +3 -0
- senter/model +0 -0
- tokenizer +3 -0
- vocab/key2row +1 -0
- vocab/lookups.bin +3 -0
- vocab/strings.json +3 -0
- vocab/vectors +3 -0
- xx_sent_ud_sm-any-py3-none-any.whl +3 -0
.gitattributes
CHANGED
@@ -14,3 +14,7 @@
|
|
14 |
*.pb filter=lfs diff=lfs merge=lfs -text
|
15 |
*.pt filter=lfs diff=lfs merge=lfs -text
|
16 |
*.pth filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
14 |
*.pb filter=lfs diff=lfs merge=lfs -text
|
15 |
*.pt filter=lfs diff=lfs merge=lfs -text
|
16 |
*.pth filter=lfs diff=lfs merge=lfs -text
|
17 |
+
*.whl filter=lfs diff=lfs merge=lfs -text
|
18 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
19 |
+
*strings.json filter=lfs diff=lfs merge=lfs -text
|
20 |
+
vectors filter=lfs diff=lfs merge=lfs -text
|
LICENSE
ADDED
@@ -0,0 +1,359 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Creative Commons Legal Code
|
2 |
+
|
3 |
+
Attribution-ShareAlike 3.0 Unported
|
4 |
+
|
5 |
+
CREATIVE COMMONS CORPORATION IS NOT A LAW FIRM AND DOES NOT PROVIDE
|
6 |
+
LEGAL SERVICES. DISTRIBUTION OF THIS LICENSE DOES NOT CREATE AN
|
7 |
+
ATTORNEY-CLIENT RELATIONSHIP. CREATIVE COMMONS PROVIDES THIS
|
8 |
+
INFORMATION ON AN "AS-IS" BASIS. CREATIVE COMMONS MAKES NO WARRANTIES
|
9 |
+
REGARDING THE INFORMATION PROVIDED, AND DISCLAIMS LIABILITY FOR
|
10 |
+
DAMAGES RESULTING FROM ITS USE.
|
11 |
+
|
12 |
+
License
|
13 |
+
|
14 |
+
THE WORK (AS DEFINED BELOW) IS PROVIDED UNDER THE TERMS OF THIS CREATIVE
|
15 |
+
COMMONS PUBLIC LICENSE ("CCPL" OR "LICENSE"). THE WORK IS PROTECTED BY
|
16 |
+
COPYRIGHT AND/OR OTHER APPLICABLE LAW. ANY USE OF THE WORK OTHER THAN AS
|
17 |
+
AUTHORIZED UNDER THIS LICENSE OR COPYRIGHT LAW IS PROHIBITED.
|
18 |
+
|
19 |
+
BY EXERCISING ANY RIGHTS TO THE WORK PROVIDED HERE, YOU ACCEPT AND AGREE
|
20 |
+
TO BE BOUND BY THE TERMS OF THIS LICENSE. TO THE EXTENT THIS LICENSE MAY
|
21 |
+
BE CONSIDERED TO BE A CONTRACT, THE LICENSOR GRANTS YOU THE RIGHTS
|
22 |
+
CONTAINED HERE IN CONSIDERATION OF YOUR ACCEPTANCE OF SUCH TERMS AND
|
23 |
+
CONDITIONS.
|
24 |
+
|
25 |
+
1. Definitions
|
26 |
+
|
27 |
+
a. "Adaptation" means a work based upon the Work, or upon the Work and
|
28 |
+
other pre-existing works, such as a translation, adaptation,
|
29 |
+
derivative work, arrangement of music or other alterations of a
|
30 |
+
literary or artistic work, or phonogram or performance and includes
|
31 |
+
cinematographic adaptations or any other form in which the Work may be
|
32 |
+
recast, transformed, or adapted including in any form recognizably
|
33 |
+
derived from the original, except that a work that constitutes a
|
34 |
+
Collection will not be considered an Adaptation for the purpose of
|
35 |
+
this License. For the avoidance of doubt, where the Work is a musical
|
36 |
+
work, performance or phonogram, the synchronization of the Work in
|
37 |
+
timed-relation with a moving image ("synching") will be considered an
|
38 |
+
Adaptation for the purpose of this License.
|
39 |
+
b. "Collection" means a collection of literary or artistic works, such as
|
40 |
+
encyclopedias and anthologies, or performances, phonograms or
|
41 |
+
broadcasts, or other works or subject matter other than works listed
|
42 |
+
in Section 1(f) below, which, by reason of the selection and
|
43 |
+
arrangement of their contents, constitute intellectual creations, in
|
44 |
+
which the Work is included in its entirety in unmodified form along
|
45 |
+
with one or more other contributions, each constituting separate and
|
46 |
+
independent works in themselves, which together are assembled into a
|
47 |
+
collective whole. A work that constitutes a Collection will not be
|
48 |
+
considered an Adaptation (as defined below) for the purposes of this
|
49 |
+
License.
|
50 |
+
c. "Creative Commons Compatible License" means a license that is listed
|
51 |
+
at https://creativecommons.org/compatiblelicenses that has been
|
52 |
+
approved by Creative Commons as being essentially equivalent to this
|
53 |
+
License, including, at a minimum, because that license: (i) contains
|
54 |
+
terms that have the same purpose, meaning and effect as the License
|
55 |
+
Elements of this License; and, (ii) explicitly permits the relicensing
|
56 |
+
of adaptations of works made available under that license under this
|
57 |
+
License or a Creative Commons jurisdiction license with the same
|
58 |
+
License Elements as this License.
|
59 |
+
d. "Distribute" means to make available to the public the original and
|
60 |
+
copies of the Work or Adaptation, as appropriate, through sale or
|
61 |
+
other transfer of ownership.
|
62 |
+
e. "License Elements" means the following high-level license attributes
|
63 |
+
as selected by Licensor and indicated in the title of this License:
|
64 |
+
Attribution, ShareAlike.
|
65 |
+
f. "Licensor" means the individual, individuals, entity or entities that
|
66 |
+
offer(s) the Work under the terms of this License.
|
67 |
+
g. "Original Author" means, in the case of a literary or artistic work,
|
68 |
+
the individual, individuals, entity or entities who created the Work
|
69 |
+
or if no individual or entity can be identified, the publisher; and in
|
70 |
+
addition (i) in the case of a performance the actors, singers,
|
71 |
+
musicians, dancers, and other persons who act, sing, deliver, declaim,
|
72 |
+
play in, interpret or otherwise perform literary or artistic works or
|
73 |
+
expressions of folklore; (ii) in the case of a phonogram the producer
|
74 |
+
being the person or legal entity who first fixes the sounds of a
|
75 |
+
performance or other sounds; and, (iii) in the case of broadcasts, the
|
76 |
+
organization that transmits the broadcast.
|
77 |
+
h. "Work" means the literary and/or artistic work offered under the terms
|
78 |
+
of this License including without limitation any production in the
|
79 |
+
literary, scientific and artistic domain, whatever may be the mode or
|
80 |
+
form of its expression including digital form, such as a book,
|
81 |
+
pamphlet and other writing; a lecture, address, sermon or other work
|
82 |
+
of the same nature; a dramatic or dramatico-musical work; a
|
83 |
+
choreographic work or entertainment in dumb show; a musical
|
84 |
+
composition with or without words; a cinematographic work to which are
|
85 |
+
assimilated works expressed by a process analogous to cinematography;
|
86 |
+
a work of drawing, painting, architecture, sculpture, engraving or
|
87 |
+
lithography; a photographic work to which are assimilated works
|
88 |
+
expressed by a process analogous to photography; a work of applied
|
89 |
+
art; an illustration, map, plan, sketch or three-dimensional work
|
90 |
+
relative to geography, topography, architecture or science; a
|
91 |
+
performance; a broadcast; a phonogram; a compilation of data to the
|
92 |
+
extent it is protected as a copyrightable work; or a work performed by
|
93 |
+
a variety or circus performer to the extent it is not otherwise
|
94 |
+
considered a literary or artistic work.
|
95 |
+
i. "You" means an individual or entity exercising rights under this
|
96 |
+
License who has not previously violated the terms of this License with
|
97 |
+
respect to the Work, or who has received express permission from the
|
98 |
+
Licensor to exercise rights under this License despite a previous
|
99 |
+
violation.
|
100 |
+
j. "Publicly Perform" means to perform public recitations of the Work and
|
101 |
+
to communicate to the public those public recitations, by any means or
|
102 |
+
process, including by wire or wireless means or public digital
|
103 |
+
performances; to make available to the public Works in such a way that
|
104 |
+
members of the public may access these Works from a place and at a
|
105 |
+
place individually chosen by them; to perform the Work to the public
|
106 |
+
by any means or process and the communication to the public of the
|
107 |
+
performances of the Work, including by public digital performance; to
|
108 |
+
broadcast and rebroadcast the Work by any means including signs,
|
109 |
+
sounds or images.
|
110 |
+
k. "Reproduce" means to make copies of the Work by any means including
|
111 |
+
without limitation by sound or visual recordings and the right of
|
112 |
+
fixation and reproducing fixations of the Work, including storage of a
|
113 |
+
protected performance or phonogram in digital form or other electronic
|
114 |
+
medium.
|
115 |
+
|
116 |
+
2. Fair Dealing Rights. Nothing in this License is intended to reduce,
|
117 |
+
limit, or restrict any uses free from copyright or rights arising from
|
118 |
+
limitations or exceptions that are provided for in connection with the
|
119 |
+
copyright protection under copyright law or other applicable laws.
|
120 |
+
|
121 |
+
3. License Grant. Subject to the terms and conditions of this License,
|
122 |
+
Licensor hereby grants You a worldwide, royalty-free, non-exclusive,
|
123 |
+
perpetual (for the duration of the applicable copyright) license to
|
124 |
+
exercise the rights in the Work as stated below:
|
125 |
+
|
126 |
+
a. to Reproduce the Work, to incorporate the Work into one or more
|
127 |
+
Collections, and to Reproduce the Work as incorporated in the
|
128 |
+
Collections;
|
129 |
+
b. to create and Reproduce Adaptations provided that any such Adaptation,
|
130 |
+
including any translation in any medium, takes reasonable steps to
|
131 |
+
clearly label, demarcate or otherwise identify that changes were made
|
132 |
+
to the original Work. For example, a translation could be marked "The
|
133 |
+
original work was translated from English to Spanish," or a
|
134 |
+
modification could indicate "The original work has been modified.";
|
135 |
+
c. to Distribute and Publicly Perform the Work including as incorporated
|
136 |
+
in Collections; and,
|
137 |
+
d. to Distribute and Publicly Perform Adaptations.
|
138 |
+
e. For the avoidance of doubt:
|
139 |
+
|
140 |
+
i. Non-waivable Compulsory License Schemes. In those jurisdictions in
|
141 |
+
which the right to collect royalties through any statutory or
|
142 |
+
compulsory licensing scheme cannot be waived, the Licensor
|
143 |
+
reserves the exclusive right to collect such royalties for any
|
144 |
+
exercise by You of the rights granted under this License;
|
145 |
+
ii. Waivable Compulsory License Schemes. In those jurisdictions in
|
146 |
+
which the right to collect royalties through any statutory or
|
147 |
+
compulsory licensing scheme can be waived, the Licensor waives the
|
148 |
+
exclusive right to collect such royalties for any exercise by You
|
149 |
+
of the rights granted under this License; and,
|
150 |
+
iii. Voluntary License Schemes. The Licensor waives the right to
|
151 |
+
collect royalties, whether individually or, in the event that the
|
152 |
+
Licensor is a member of a collecting society that administers
|
153 |
+
voluntary licensing schemes, via that society, from any exercise
|
154 |
+
by You of the rights granted under this License.
|
155 |
+
|
156 |
+
The above rights may be exercised in all media and formats whether now
|
157 |
+
known or hereafter devised. The above rights include the right to make
|
158 |
+
such modifications as are technically necessary to exercise the rights in
|
159 |
+
other media and formats. Subject to Section 8(f), all rights not expressly
|
160 |
+
granted by Licensor are hereby reserved.
|
161 |
+
|
162 |
+
4. Restrictions. The license granted in Section 3 above is expressly made
|
163 |
+
subject to and limited by the following restrictions:
|
164 |
+
|
165 |
+
a. You may Distribute or Publicly Perform the Work only under the terms
|
166 |
+
of this License. You must include a copy of, or the Uniform Resource
|
167 |
+
Identifier (URI) for, this License with every copy of the Work You
|
168 |
+
Distribute or Publicly Perform. You may not offer or impose any terms
|
169 |
+
on the Work that restrict the terms of this License or the ability of
|
170 |
+
the recipient of the Work to exercise the rights granted to that
|
171 |
+
recipient under the terms of the License. You may not sublicense the
|
172 |
+
Work. You must keep intact all notices that refer to this License and
|
173 |
+
to the disclaimer of warranties with every copy of the Work You
|
174 |
+
Distribute or Publicly Perform. When You Distribute or Publicly
|
175 |
+
Perform the Work, You may not impose any effective technological
|
176 |
+
measures on the Work that restrict the ability of a recipient of the
|
177 |
+
Work from You to exercise the rights granted to that recipient under
|
178 |
+
the terms of the License. This Section 4(a) applies to the Work as
|
179 |
+
incorporated in a Collection, but this does not require the Collection
|
180 |
+
apart from the Work itself to be made subject to the terms of this
|
181 |
+
License. If You create a Collection, upon notice from any Licensor You
|
182 |
+
must, to the extent practicable, remove from the Collection any credit
|
183 |
+
as required by Section 4(c), as requested. If You create an
|
184 |
+
Adaptation, upon notice from any Licensor You must, to the extent
|
185 |
+
practicable, remove from the Adaptation any credit as required by
|
186 |
+
Section 4(c), as requested.
|
187 |
+
b. You may Distribute or Publicly Perform an Adaptation only under the
|
188 |
+
terms of: (i) this License; (ii) a later version of this License with
|
189 |
+
the same License Elements as this License; (iii) a Creative Commons
|
190 |
+
jurisdiction license (either this or a later license version) that
|
191 |
+
contains the same License Elements as this License (e.g.,
|
192 |
+
Attribution-ShareAlike 3.0 US)); (iv) a Creative Commons Compatible
|
193 |
+
License. If you license the Adaptation under one of the licenses
|
194 |
+
mentioned in (iv), you must comply with the terms of that license. If
|
195 |
+
you license the Adaptation under the terms of any of the licenses
|
196 |
+
mentioned in (i), (ii) or (iii) (the "Applicable License"), you must
|
197 |
+
comply with the terms of the Applicable License generally and the
|
198 |
+
following provisions: (I) You must include a copy of, or the URI for,
|
199 |
+
the Applicable License with every copy of each Adaptation You
|
200 |
+
Distribute or Publicly Perform; (II) You may not offer or impose any
|
201 |
+
terms on the Adaptation that restrict the terms of the Applicable
|
202 |
+
License or the ability of the recipient of the Adaptation to exercise
|
203 |
+
the rights granted to that recipient under the terms of the Applicable
|
204 |
+
License; (III) You must keep intact all notices that refer to the
|
205 |
+
Applicable License and to the disclaimer of warranties with every copy
|
206 |
+
of the Work as included in the Adaptation You Distribute or Publicly
|
207 |
+
Perform; (IV) when You Distribute or Publicly Perform the Adaptation,
|
208 |
+
You may not impose any effective technological measures on the
|
209 |
+
Adaptation that restrict the ability of a recipient of the Adaptation
|
210 |
+
from You to exercise the rights granted to that recipient under the
|
211 |
+
terms of the Applicable License. This Section 4(b) applies to the
|
212 |
+
Adaptation as incorporated in a Collection, but this does not require
|
213 |
+
the Collection apart from the Adaptation itself to be made subject to
|
214 |
+
the terms of the Applicable License.
|
215 |
+
c. If You Distribute, or Publicly Perform the Work or any Adaptations or
|
216 |
+
Collections, You must, unless a request has been made pursuant to
|
217 |
+
Section 4(a), keep intact all copyright notices for the Work and
|
218 |
+
provide, reasonable to the medium or means You are utilizing: (i) the
|
219 |
+
name of the Original Author (or pseudonym, if applicable) if supplied,
|
220 |
+
and/or if the Original Author and/or Licensor designate another party
|
221 |
+
or parties (e.g., a sponsor institute, publishing entity, journal) for
|
222 |
+
attribution ("Attribution Parties") in Licensor's copyright notice,
|
223 |
+
terms of service or by other reasonable means, the name of such party
|
224 |
+
or parties; (ii) the title of the Work if supplied; (iii) to the
|
225 |
+
extent reasonably practicable, the URI, if any, that Licensor
|
226 |
+
specifies to be associated with the Work, unless such URI does not
|
227 |
+
refer to the copyright notice or licensing information for the Work;
|
228 |
+
and (iv) , consistent with Ssection 3(b), in the case of an
|
229 |
+
Adaptation, a credit identifying the use of the Work in the Adaptation
|
230 |
+
(e.g., "French translation of the Work by Original Author," or
|
231 |
+
"Screenplay based on original Work by Original Author"). The credit
|
232 |
+
required by this Section 4(c) may be implemented in any reasonable
|
233 |
+
manner; provided, however, that in the case of a Adaptation or
|
234 |
+
Collection, at a minimum such credit will appear, if a credit for all
|
235 |
+
contributing authors of the Adaptation or Collection appears, then as
|
236 |
+
part of these credits and in a manner at least as prominent as the
|
237 |
+
credits for the other contributing authors. For the avoidance of
|
238 |
+
doubt, You may only use the credit required by this Section for the
|
239 |
+
purpose of attribution in the manner set out above and, by exercising
|
240 |
+
Your rights under this License, You may not implicitly or explicitly
|
241 |
+
assert or imply any connection with, sponsorship or endorsement by the
|
242 |
+
Original Author, Licensor and/or Attribution Parties, as appropriate,
|
243 |
+
of You or Your use of the Work, without the separate, express prior
|
244 |
+
written permission of the Original Author, Licensor and/or Attribution
|
245 |
+
Parties.
|
246 |
+
d. Except as otherwise agreed in writing by the Licensor or as may be
|
247 |
+
otherwise permitted by applicable law, if You Reproduce, Distribute or
|
248 |
+
Publicly Perform the Work either by itself or as part of any
|
249 |
+
Adaptations or Collections, You must not distort, mutilate, modify or
|
250 |
+
take other derogatory action in relation to the Work which would be
|
251 |
+
prejudicial to the Original Author's honor or reputation. Licensor
|
252 |
+
agrees that in those jurisdictions (e.g. Japan), in which any exercise
|
253 |
+
of the right granted in Section 3(b) of this License (the right to
|
254 |
+
make Adaptations) would be deemed to be a distortion, mutilation,
|
255 |
+
modification or other derogatory action prejudicial to the Original
|
256 |
+
Author's honor and reputation, the Licensor will waive or not assert,
|
257 |
+
as appropriate, this Section, to the fullest extent permitted by the
|
258 |
+
applicable national law, to enable You to reasonably exercise Your
|
259 |
+
right under Section 3(b) of this License (right to make Adaptations)
|
260 |
+
but not otherwise.
|
261 |
+
|
262 |
+
5. Representations, Warranties and Disclaimer
|
263 |
+
|
264 |
+
UNLESS OTHERWISE MUTUALLY AGREED TO BY THE PARTIES IN WRITING, LICENSOR
|
265 |
+
OFFERS THE WORK AS-IS AND MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY
|
266 |
+
KIND CONCERNING THE WORK, EXPRESS, IMPLIED, STATUTORY OR OTHERWISE,
|
267 |
+
INCLUDING, WITHOUT LIMITATION, WARRANTIES OF TITLE, MERCHANTIBILITY,
|
268 |
+
FITNESS FOR A PARTICULAR PURPOSE, NONINFRINGEMENT, OR THE ABSENCE OF
|
269 |
+
LATENT OR OTHER DEFECTS, ACCURACY, OR THE PRESENCE OF ABSENCE OF ERRORS,
|
270 |
+
WHETHER OR NOT DISCOVERABLE. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION
|
271 |
+
OF IMPLIED WARRANTIES, SO SUCH EXCLUSION MAY NOT APPLY TO YOU.
|
272 |
+
|
273 |
+
6. Limitation on Liability. EXCEPT TO THE EXTENT REQUIRED BY APPLICABLE
|
274 |
+
LAW, IN NO EVENT WILL LICENSOR BE LIABLE TO YOU ON ANY LEGAL THEORY FOR
|
275 |
+
ANY SPECIAL, INCIDENTAL, CONSEQUENTIAL, PUNITIVE OR EXEMPLARY DAMAGES
|
276 |
+
ARISING OUT OF THIS LICENSE OR THE USE OF THE WORK, EVEN IF LICENSOR HAS
|
277 |
+
BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
|
278 |
+
|
279 |
+
7. Termination
|
280 |
+
|
281 |
+
a. This License and the rights granted hereunder will terminate
|
282 |
+
automatically upon any breach by You of the terms of this License.
|
283 |
+
Individuals or entities who have received Adaptations or Collections
|
284 |
+
from You under this License, however, will not have their licenses
|
285 |
+
terminated provided such individuals or entities remain in full
|
286 |
+
compliance with those licenses. Sections 1, 2, 5, 6, 7, and 8 will
|
287 |
+
survive any termination of this License.
|
288 |
+
b. Subject to the above terms and conditions, the license granted here is
|
289 |
+
perpetual (for the duration of the applicable copyright in the Work).
|
290 |
+
Notwithstanding the above, Licensor reserves the right to release the
|
291 |
+
Work under different license terms or to stop distributing the Work at
|
292 |
+
any time; provided, however that any such election will not serve to
|
293 |
+
withdraw this License (or any other license that has been, or is
|
294 |
+
required to be, granted under the terms of this License), and this
|
295 |
+
License will continue in full force and effect unless terminated as
|
296 |
+
stated above.
|
297 |
+
|
298 |
+
8. Miscellaneous
|
299 |
+
|
300 |
+
a. Each time You Distribute or Publicly Perform the Work or a Collection,
|
301 |
+
the Licensor offers to the recipient a license to the Work on the same
|
302 |
+
terms and conditions as the license granted to You under this License.
|
303 |
+
b. Each time You Distribute or Publicly Perform an Adaptation, Licensor
|
304 |
+
offers to the recipient a license to the original Work on the same
|
305 |
+
terms and conditions as the license granted to You under this License.
|
306 |
+
c. If any provision of this License is invalid or unenforceable under
|
307 |
+
applicable law, it shall not affect the validity or enforceability of
|
308 |
+
the remainder of the terms of this License, and without further action
|
309 |
+
by the parties to this agreement, such provision shall be reformed to
|
310 |
+
the minimum extent necessary to make such provision valid and
|
311 |
+
enforceable.
|
312 |
+
d. No term or provision of this License shall be deemed waived and no
|
313 |
+
breach consented to unless such waiver or consent shall be in writing
|
314 |
+
and signed by the party to be charged with such waiver or consent.
|
315 |
+
e. This License constitutes the entire agreement between the parties with
|
316 |
+
respect to the Work licensed here. There are no understandings,
|
317 |
+
agreements or representations with respect to the Work not specified
|
318 |
+
here. Licensor shall not be bound by any additional provisions that
|
319 |
+
may appear in any communication from You. This License may not be
|
320 |
+
modified without the mutual written agreement of the Licensor and You.
|
321 |
+
f. The rights granted under, and the subject matter referenced, in this
|
322 |
+
License were drafted utilizing the terminology of the Berne Convention
|
323 |
+
for the Protection of Literary and Artistic Works (as amended on
|
324 |
+
September 28, 1979), the Rome Convention of 1961, the WIPO Copyright
|
325 |
+
Treaty of 1996, the WIPO Performances and Phonograms Treaty of 1996
|
326 |
+
and the Universal Copyright Convention (as revised on July 24, 1971).
|
327 |
+
These rights and subject matter take effect in the relevant
|
328 |
+
jurisdiction in which the License terms are sought to be enforced
|
329 |
+
according to the corresponding provisions of the implementation of
|
330 |
+
those treaty provisions in the applicable national law. If the
|
331 |
+
standard suite of rights granted under applicable copyright law
|
332 |
+
includes additional rights not granted under this License, such
|
333 |
+
additional rights are deemed to be included in the License; this
|
334 |
+
License is not intended to restrict the license of any rights under
|
335 |
+
applicable law.
|
336 |
+
|
337 |
+
|
338 |
+
Creative Commons Notice
|
339 |
+
|
340 |
+
Creative Commons is not a party to this License, and makes no warranty
|
341 |
+
whatsoever in connection with the Work. Creative Commons will not be
|
342 |
+
liable to You or any party on any legal theory for any damages
|
343 |
+
whatsoever, including without limitation any general, special,
|
344 |
+
incidental or consequential damages arising in connection to this
|
345 |
+
license. Notwithstanding the foregoing two (2) sentences, if Creative
|
346 |
+
Commons has expressly identified itself as the Licensor hereunder, it
|
347 |
+
shall have all rights and obligations of Licensor.
|
348 |
+
|
349 |
+
Except for the limited purpose of indicating to the public that the
|
350 |
+
Work is licensed under the CCPL, Creative Commons does not authorize
|
351 |
+
the use by either party of the trademark "Creative Commons" or any
|
352 |
+
related trademark or logo of Creative Commons without the prior
|
353 |
+
written consent of Creative Commons. Any permitted use will be in
|
354 |
+
compliance with Creative Commons' then-current trademark usage
|
355 |
+
guidelines, as may be published on its website or otherwise made
|
356 |
+
available upon request from time to time. For the avoidance of doubt,
|
357 |
+
this trademark restriction does not form part of the License.
|
358 |
+
|
359 |
+
Creative Commons may be contacted at https://creativecommons.org/.
|
LICENSES_SOURCES
ADDED
@@ -0,0 +1,371 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# Universal Dependencies v2.5 (UD_Afrikaans-AfriBooms, UD_Croatian-SET, UD_Czech-CAC, UD_Czech-CLTT, UD_Danish-DDT, UD_Dutch-Alpino, UD_Dutch-LassySmall, UD_English-EWT, UD_Finnish-FTB, UD_Finnish-TDT, UD_French-GSD, UD_French-Spoken, UD_German-GSD, UD_Indonesian-GSD, UD_Irish-IDT, UD_Italian-TWITTIRO, UD_Korean-GSD, UD_Korean-Kaist, UD_Latvian-LVTB, UD_Lithuanian-ALKSNIS, UD_Lithuanian-HSE, UD_Marathi-UFAL, UD_Norwegian-Bokmaal, UD_Norwegian-Nynorsk, UD_Norwegian-NynorskLIA, UD_Persian-Seraji, UD_Portuguese-Bosque, UD_Portuguese-GSD, UD_Romanian-Nonstandard, UD_Romanian-RRT, UD_Russian-GSD, UD_Russian-Taiga, UD_Serbian-SET, UD_Slovak-SNK, UD_Spanish-GSD, UD_Swedish-Talbanken, UD_Telugu-MTG, UD_Vietnamese-VTB)
|
2 |
+
|
3 |
+
* Author: Zeman, Daniel; Nivre, Joakim; Abrams, Mitchell; et al.
|
4 |
+
* URL: https://universaldependencies.org/
|
5 |
+
* License: CC BY-SA 3.0
|
6 |
+
|
7 |
+
```
|
8 |
+
Creative Commons Legal Code
|
9 |
+
|
10 |
+
Attribution-ShareAlike 3.0 Unported
|
11 |
+
|
12 |
+
CREATIVE COMMONS CORPORATION IS NOT A LAW FIRM AND DOES NOT PROVIDE
|
13 |
+
LEGAL SERVICES. DISTRIBUTION OF THIS LICENSE DOES NOT CREATE AN
|
14 |
+
ATTORNEY-CLIENT RELATIONSHIP. CREATIVE COMMONS PROVIDES THIS
|
15 |
+
INFORMATION ON AN "AS-IS" BASIS. CREATIVE COMMONS MAKES NO WARRANTIES
|
16 |
+
REGARDING THE INFORMATION PROVIDED, AND DISCLAIMS LIABILITY FOR
|
17 |
+
DAMAGES RESULTING FROM ITS USE.
|
18 |
+
|
19 |
+
License
|
20 |
+
|
21 |
+
THE WORK (AS DEFINED BELOW) IS PROVIDED UNDER THE TERMS OF THIS CREATIVE
|
22 |
+
COMMONS PUBLIC LICENSE ("CCPL" OR "LICENSE"). THE WORK IS PROTECTED BY
|
23 |
+
COPYRIGHT AND/OR OTHER APPLICABLE LAW. ANY USE OF THE WORK OTHER THAN AS
|
24 |
+
AUTHORIZED UNDER THIS LICENSE OR COPYRIGHT LAW IS PROHIBITED.
|
25 |
+
|
26 |
+
BY EXERCISING ANY RIGHTS TO THE WORK PROVIDED HERE, YOU ACCEPT AND AGREE
|
27 |
+
TO BE BOUND BY THE TERMS OF THIS LICENSE. TO THE EXTENT THIS LICENSE MAY
|
28 |
+
BE CONSIDERED TO BE A CONTRACT, THE LICENSOR GRANTS YOU THE RIGHTS
|
29 |
+
CONTAINED HERE IN CONSIDERATION OF YOUR ACCEPTANCE OF SUCH TERMS AND
|
30 |
+
CONDITIONS.
|
31 |
+
|
32 |
+
1. Definitions
|
33 |
+
|
34 |
+
a. "Adaptation" means a work based upon the Work, or upon the Work and
|
35 |
+
other pre-existing works, such as a translation, adaptation,
|
36 |
+
derivative work, arrangement of music or other alterations of a
|
37 |
+
literary or artistic work, or phonogram or performance and includes
|
38 |
+
cinematographic adaptations or any other form in which the Work may be
|
39 |
+
recast, transformed, or adapted including in any form recognizably
|
40 |
+
derived from the original, except that a work that constitutes a
|
41 |
+
Collection will not be considered an Adaptation for the purpose of
|
42 |
+
this License. For the avoidance of doubt, where the Work is a musical
|
43 |
+
work, performance or phonogram, the synchronization of the Work in
|
44 |
+
timed-relation with a moving image ("synching") will be considered an
|
45 |
+
Adaptation for the purpose of this License.
|
46 |
+
b. "Collection" means a collection of literary or artistic works, such as
|
47 |
+
encyclopedias and anthologies, or performances, phonograms or
|
48 |
+
broadcasts, or other works or subject matter other than works listed
|
49 |
+
in Section 1(f) below, which, by reason of the selection and
|
50 |
+
arrangement of their contents, constitute intellectual creations, in
|
51 |
+
which the Work is included in its entirety in unmodified form along
|
52 |
+
with one or more other contributions, each constituting separate and
|
53 |
+
independent works in themselves, which together are assembled into a
|
54 |
+
collective whole. A work that constitutes a Collection will not be
|
55 |
+
considered an Adaptation (as defined below) for the purposes of this
|
56 |
+
License.
|
57 |
+
c. "Creative Commons Compatible License" means a license that is listed
|
58 |
+
at https://creativecommons.org/compatiblelicenses that has been
|
59 |
+
approved by Creative Commons as being essentially equivalent to this
|
60 |
+
License, including, at a minimum, because that license: (i) contains
|
61 |
+
terms that have the same purpose, meaning and effect as the License
|
62 |
+
Elements of this License; and, (ii) explicitly permits the relicensing
|
63 |
+
of adaptations of works made available under that license under this
|
64 |
+
License or a Creative Commons jurisdiction license with the same
|
65 |
+
License Elements as this License.
|
66 |
+
d. "Distribute" means to make available to the public the original and
|
67 |
+
copies of the Work or Adaptation, as appropriate, through sale or
|
68 |
+
other transfer of ownership.
|
69 |
+
e. "License Elements" means the following high-level license attributes
|
70 |
+
as selected by Licensor and indicated in the title of this License:
|
71 |
+
Attribution, ShareAlike.
|
72 |
+
f. "Licensor" means the individual, individuals, entity or entities that
|
73 |
+
offer(s) the Work under the terms of this License.
|
74 |
+
g. "Original Author" means, in the case of a literary or artistic work,
|
75 |
+
the individual, individuals, entity or entities who created the Work
|
76 |
+
or if no individual or entity can be identified, the publisher; and in
|
77 |
+
addition (i) in the case of a performance the actors, singers,
|
78 |
+
musicians, dancers, and other persons who act, sing, deliver, declaim,
|
79 |
+
play in, interpret or otherwise perform literary or artistic works or
|
80 |
+
expressions of folklore; (ii) in the case of a phonogram the producer
|
81 |
+
being the person or legal entity who first fixes the sounds of a
|
82 |
+
performance or other sounds; and, (iii) in the case of broadcasts, the
|
83 |
+
organization that transmits the broadcast.
|
84 |
+
h. "Work" means the literary and/or artistic work offered under the terms
|
85 |
+
of this License including without limitation any production in the
|
86 |
+
literary, scientific and artistic domain, whatever may be the mode or
|
87 |
+
form of its expression including digital form, such as a book,
|
88 |
+
pamphlet and other writing; a lecture, address, sermon or other work
|
89 |
+
of the same nature; a dramatic or dramatico-musical work; a
|
90 |
+
choreographic work or entertainment in dumb show; a musical
|
91 |
+
composition with or without words; a cinematographic work to which are
|
92 |
+
assimilated works expressed by a process analogous to cinematography;
|
93 |
+
a work of drawing, painting, architecture, sculpture, engraving or
|
94 |
+
lithography; a photographic work to which are assimilated works
|
95 |
+
expressed by a process analogous to photography; a work of applied
|
96 |
+
art; an illustration, map, plan, sketch or three-dimensional work
|
97 |
+
relative to geography, topography, architecture or science; a
|
98 |
+
performance; a broadcast; a phonogram; a compilation of data to the
|
99 |
+
extent it is protected as a copyrightable work; or a work performed by
|
100 |
+
a variety or circus performer to the extent it is not otherwise
|
101 |
+
considered a literary or artistic work.
|
102 |
+
i. "You" means an individual or entity exercising rights under this
|
103 |
+
License who has not previously violated the terms of this License with
|
104 |
+
respect to the Work, or who has received express permission from the
|
105 |
+
Licensor to exercise rights under this License despite a previous
|
106 |
+
violation.
|
107 |
+
j. "Publicly Perform" means to perform public recitations of the Work and
|
108 |
+
to communicate to the public those public recitations, by any means or
|
109 |
+
process, including by wire or wireless means or public digital
|
110 |
+
performances; to make available to the public Works in such a way that
|
111 |
+
members of the public may access these Works from a place and at a
|
112 |
+
place individually chosen by them; to perform the Work to the public
|
113 |
+
by any means or process and the communication to the public of the
|
114 |
+
performances of the Work, including by public digital performance; to
|
115 |
+
broadcast and rebroadcast the Work by any means including signs,
|
116 |
+
sounds or images.
|
117 |
+
k. "Reproduce" means to make copies of the Work by any means including
|
118 |
+
without limitation by sound or visual recordings and the right of
|
119 |
+
fixation and reproducing fixations of the Work, including storage of a
|
120 |
+
protected performance or phonogram in digital form or other electronic
|
121 |
+
medium.
|
122 |
+
|
123 |
+
2. Fair Dealing Rights. Nothing in this License is intended to reduce,
|
124 |
+
limit, or restrict any uses free from copyright or rights arising from
|
125 |
+
limitations or exceptions that are provided for in connection with the
|
126 |
+
copyright protection under copyright law or other applicable laws.
|
127 |
+
|
128 |
+
3. License Grant. Subject to the terms and conditions of this License,
|
129 |
+
Licensor hereby grants You a worldwide, royalty-free, non-exclusive,
|
130 |
+
perpetual (for the duration of the applicable copyright) license to
|
131 |
+
exercise the rights in the Work as stated below:
|
132 |
+
|
133 |
+
a. to Reproduce the Work, to incorporate the Work into one or more
|
134 |
+
Collections, and to Reproduce the Work as incorporated in the
|
135 |
+
Collections;
|
136 |
+
b. to create and Reproduce Adaptations provided that any such Adaptation,
|
137 |
+
including any translation in any medium, takes reasonable steps to
|
138 |
+
clearly label, demarcate or otherwise identify that changes were made
|
139 |
+
to the original Work. For example, a translation could be marked "The
|
140 |
+
original work was translated from English to Spanish," or a
|
141 |
+
modification could indicate "The original work has been modified.";
|
142 |
+
c. to Distribute and Publicly Perform the Work including as incorporated
|
143 |
+
in Collections; and,
|
144 |
+
d. to Distribute and Publicly Perform Adaptations.
|
145 |
+
e. For the avoidance of doubt:
|
146 |
+
|
147 |
+
i. Non-waivable Compulsory License Schemes. In those jurisdictions in
|
148 |
+
which the right to collect royalties through any statutory or
|
149 |
+
compulsory licensing scheme cannot be waived, the Licensor
|
150 |
+
reserves the exclusive right to collect such royalties for any
|
151 |
+
exercise by You of the rights granted under this License;
|
152 |
+
ii. Waivable Compulsory License Schemes. In those jurisdictions in
|
153 |
+
which the right to collect royalties through any statutory or
|
154 |
+
compulsory licensing scheme can be waived, the Licensor waives the
|
155 |
+
exclusive right to collect such royalties for any exercise by You
|
156 |
+
of the rights granted under this License; and,
|
157 |
+
iii. Voluntary License Schemes. The Licensor waives the right to
|
158 |
+
collect royalties, whether individually or, in the event that the
|
159 |
+
Licensor is a member of a collecting society that administers
|
160 |
+
voluntary licensing schemes, via that society, from any exercise
|
161 |
+
by You of the rights granted under this License.
|
162 |
+
|
163 |
+
The above rights may be exercised in all media and formats whether now
|
164 |
+
known or hereafter devised. The above rights include the right to make
|
165 |
+
such modifications as are technically necessary to exercise the rights in
|
166 |
+
other media and formats. Subject to Section 8(f), all rights not expressly
|
167 |
+
granted by Licensor are hereby reserved.
|
168 |
+
|
169 |
+
4. Restrictions. The license granted in Section 3 above is expressly made
|
170 |
+
subject to and limited by the following restrictions:
|
171 |
+
|
172 |
+
a. You may Distribute or Publicly Perform the Work only under the terms
|
173 |
+
of this License. You must include a copy of, or the Uniform Resource
|
174 |
+
Identifier (URI) for, this License with every copy of the Work You
|
175 |
+
Distribute or Publicly Perform. You may not offer or impose any terms
|
176 |
+
on the Work that restrict the terms of this License or the ability of
|
177 |
+
the recipient of the Work to exercise the rights granted to that
|
178 |
+
recipient under the terms of the License. You may not sublicense the
|
179 |
+
Work. You must keep intact all notices that refer to this License and
|
180 |
+
to the disclaimer of warranties with every copy of the Work You
|
181 |
+
Distribute or Publicly Perform. When You Distribute or Publicly
|
182 |
+
Perform the Work, You may not impose any effective technological
|
183 |
+
measures on the Work that restrict the ability of a recipient of the
|
184 |
+
Work from You to exercise the rights granted to that recipient under
|
185 |
+
the terms of the License. This Section 4(a) applies to the Work as
|
186 |
+
incorporated in a Collection, but this does not require the Collection
|
187 |
+
apart from the Work itself to be made subject to the terms of this
|
188 |
+
License. If You create a Collection, upon notice from any Licensor You
|
189 |
+
must, to the extent practicable, remove from the Collection any credit
|
190 |
+
as required by Section 4(c), as requested. If You create an
|
191 |
+
Adaptation, upon notice from any Licensor You must, to the extent
|
192 |
+
practicable, remove from the Adaptation any credit as required by
|
193 |
+
Section 4(c), as requested.
|
194 |
+
b. You may Distribute or Publicly Perform an Adaptation only under the
|
195 |
+
terms of: (i) this License; (ii) a later version of this License with
|
196 |
+
the same License Elements as this License; (iii) a Creative Commons
|
197 |
+
jurisdiction license (either this or a later license version) that
|
198 |
+
contains the same License Elements as this License (e.g.,
|
199 |
+
Attribution-ShareAlike 3.0 US)); (iv) a Creative Commons Compatible
|
200 |
+
License. If you license the Adaptation under one of the licenses
|
201 |
+
mentioned in (iv), you must comply with the terms of that license. If
|
202 |
+
you license the Adaptation under the terms of any of the licenses
|
203 |
+
mentioned in (i), (ii) or (iii) (the "Applicable License"), you must
|
204 |
+
comply with the terms of the Applicable License generally and the
|
205 |
+
following provisions: (I) You must include a copy of, or the URI for,
|
206 |
+
the Applicable License with every copy of each Adaptation You
|
207 |
+
Distribute or Publicly Perform; (II) You may not offer or impose any
|
208 |
+
terms on the Adaptation that restrict the terms of the Applicable
|
209 |
+
License or the ability of the recipient of the Adaptation to exercise
|
210 |
+
the rights granted to that recipient under the terms of the Applicable
|
211 |
+
License; (III) You must keep intact all notices that refer to the
|
212 |
+
Applicable License and to the disclaimer of warranties with every copy
|
213 |
+
of the Work as included in the Adaptation You Distribute or Publicly
|
214 |
+
Perform; (IV) when You Distribute or Publicly Perform the Adaptation,
|
215 |
+
You may not impose any effective technological measures on the
|
216 |
+
Adaptation that restrict the ability of a recipient of the Adaptation
|
217 |
+
from You to exercise the rights granted to that recipient under the
|
218 |
+
terms of the Applicable License. This Section 4(b) applies to the
|
219 |
+
Adaptation as incorporated in a Collection, but this does not require
|
220 |
+
the Collection apart from the Adaptation itself to be made subject to
|
221 |
+
the terms of the Applicable License.
|
222 |
+
c. If You Distribute, or Publicly Perform the Work or any Adaptations or
|
223 |
+
Collections, You must, unless a request has been made pursuant to
|
224 |
+
Section 4(a), keep intact all copyright notices for the Work and
|
225 |
+
provide, reasonable to the medium or means You are utilizing: (i) the
|
226 |
+
name of the Original Author (or pseudonym, if applicable) if supplied,
|
227 |
+
and/or if the Original Author and/or Licensor designate another party
|
228 |
+
or parties (e.g., a sponsor institute, publishing entity, journal) for
|
229 |
+
attribution ("Attribution Parties") in Licensor's copyright notice,
|
230 |
+
terms of service or by other reasonable means, the name of such party
|
231 |
+
or parties; (ii) the title of the Work if supplied; (iii) to the
|
232 |
+
extent reasonably practicable, the URI, if any, that Licensor
|
233 |
+
specifies to be associated with the Work, unless such URI does not
|
234 |
+
refer to the copyright notice or licensing information for the Work;
|
235 |
+
and (iv) , consistent with Ssection 3(b), in the case of an
|
236 |
+
Adaptation, a credit identifying the use of the Work in the Adaptation
|
237 |
+
(e.g., "French translation of the Work by Original Author," or
|
238 |
+
"Screenplay based on original Work by Original Author"). The credit
|
239 |
+
required by this Section 4(c) may be implemented in any reasonable
|
240 |
+
manner; provided, however, that in the case of a Adaptation or
|
241 |
+
Collection, at a minimum such credit will appear, if a credit for all
|
242 |
+
contributing authors of the Adaptation or Collection appears, then as
|
243 |
+
part of these credits and in a manner at least as prominent as the
|
244 |
+
credits for the other contributing authors. For the avoidance of
|
245 |
+
doubt, You may only use the credit required by this Section for the
|
246 |
+
purpose of attribution in the manner set out above and, by exercising
|
247 |
+
Your rights under this License, You may not implicitly or explicitly
|
248 |
+
assert or imply any connection with, sponsorship or endorsement by the
|
249 |
+
Original Author, Licensor and/or Attribution Parties, as appropriate,
|
250 |
+
of You or Your use of the Work, without the separate, express prior
|
251 |
+
written permission of the Original Author, Licensor and/or Attribution
|
252 |
+
Parties.
|
253 |
+
d. Except as otherwise agreed in writing by the Licensor or as may be
|
254 |
+
otherwise permitted by applicable law, if You Reproduce, Distribute or
|
255 |
+
Publicly Perform the Work either by itself or as part of any
|
256 |
+
Adaptations or Collections, You must not distort, mutilate, modify or
|
257 |
+
take other derogatory action in relation to the Work which would be
|
258 |
+
prejudicial to the Original Author's honor or reputation. Licensor
|
259 |
+
agrees that in those jurisdictions (e.g. Japan), in which any exercise
|
260 |
+
of the right granted in Section 3(b) of this License (the right to
|
261 |
+
make Adaptations) would be deemed to be a distortion, mutilation,
|
262 |
+
modification or other derogatory action prejudicial to the Original
|
263 |
+
Author's honor and reputation, the Licensor will waive or not assert,
|
264 |
+
as appropriate, this Section, to the fullest extent permitted by the
|
265 |
+
applicable national law, to enable You to reasonably exercise Your
|
266 |
+
right under Section 3(b) of this License (right to make Adaptations)
|
267 |
+
but not otherwise.
|
268 |
+
|
269 |
+
5. Representations, Warranties and Disclaimer
|
270 |
+
|
271 |
+
UNLESS OTHERWISE MUTUALLY AGREED TO BY THE PARTIES IN WRITING, LICENSOR
|
272 |
+
OFFERS THE WORK AS-IS AND MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY
|
273 |
+
KIND CONCERNING THE WORK, EXPRESS, IMPLIED, STATUTORY OR OTHERWISE,
|
274 |
+
INCLUDING, WITHOUT LIMITATION, WARRANTIES OF TITLE, MERCHANTIBILITY,
|
275 |
+
FITNESS FOR A PARTICULAR PURPOSE, NONINFRINGEMENT, OR THE ABSENCE OF
|
276 |
+
LATENT OR OTHER DEFECTS, ACCURACY, OR THE PRESENCE OF ABSENCE OF ERRORS,
|
277 |
+
WHETHER OR NOT DISCOVERABLE. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION
|
278 |
+
OF IMPLIED WARRANTIES, SO SUCH EXCLUSION MAY NOT APPLY TO YOU.
|
279 |
+
|
280 |
+
6. Limitation on Liability. EXCEPT TO THE EXTENT REQUIRED BY APPLICABLE
|
281 |
+
LAW, IN NO EVENT WILL LICENSOR BE LIABLE TO YOU ON ANY LEGAL THEORY FOR
|
282 |
+
ANY SPECIAL, INCIDENTAL, CONSEQUENTIAL, PUNITIVE OR EXEMPLARY DAMAGES
|
283 |
+
ARISING OUT OF THIS LICENSE OR THE USE OF THE WORK, EVEN IF LICENSOR HAS
|
284 |
+
BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
|
285 |
+
|
286 |
+
7. Termination
|
287 |
+
|
288 |
+
a. This License and the rights granted hereunder will terminate
|
289 |
+
automatically upon any breach by You of the terms of this License.
|
290 |
+
Individuals or entities who have received Adaptations or Collections
|
291 |
+
from You under this License, however, will not have their licenses
|
292 |
+
terminated provided such individuals or entities remain in full
|
293 |
+
compliance with those licenses. Sections 1, 2, 5, 6, 7, and 8 will
|
294 |
+
survive any termination of this License.
|
295 |
+
b. Subject to the above terms and conditions, the license granted here is
|
296 |
+
perpetual (for the duration of the applicable copyright in the Work).
|
297 |
+
Notwithstanding the above, Licensor reserves the right to release the
|
298 |
+
Work under different license terms or to stop distributing the Work at
|
299 |
+
any time; provided, however that any such election will not serve to
|
300 |
+
withdraw this License (or any other license that has been, or is
|
301 |
+
required to be, granted under the terms of this License), and this
|
302 |
+
License will continue in full force and effect unless terminated as
|
303 |
+
stated above.
|
304 |
+
|
305 |
+
8. Miscellaneous
|
306 |
+
|
307 |
+
a. Each time You Distribute or Publicly Perform the Work or a Collection,
|
308 |
+
the Licensor offers to the recipient a license to the Work on the same
|
309 |
+
terms and conditions as the license granted to You under this License.
|
310 |
+
b. Each time You Distribute or Publicly Perform an Adaptation, Licensor
|
311 |
+
offers to the recipient a license to the original Work on the same
|
312 |
+
terms and conditions as the license granted to You under this License.
|
313 |
+
c. If any provision of this License is invalid or unenforceable under
|
314 |
+
applicable law, it shall not affect the validity or enforceability of
|
315 |
+
the remainder of the terms of this License, and without further action
|
316 |
+
by the parties to this agreement, such provision shall be reformed to
|
317 |
+
the minimum extent necessary to make such provision valid and
|
318 |
+
enforceable.
|
319 |
+
d. No term or provision of this License shall be deemed waived and no
|
320 |
+
breach consented to unless such waiver or consent shall be in writing
|
321 |
+
and signed by the party to be charged with such waiver or consent.
|
322 |
+
e. This License constitutes the entire agreement between the parties with
|
323 |
+
respect to the Work licensed here. There are no understandings,
|
324 |
+
agreements or representations with respect to the Work not specified
|
325 |
+
here. Licensor shall not be bound by any additional provisions that
|
326 |
+
may appear in any communication from You. This License may not be
|
327 |
+
modified without the mutual written agreement of the Licensor and You.
|
328 |
+
f. The rights granted under, and the subject matter referenced, in this
|
329 |
+
License were drafted utilizing the terminology of the Berne Convention
|
330 |
+
for the Protection of Literary and Artistic Works (as amended on
|
331 |
+
September 28, 1979), the Rome Convention of 1961, the WIPO Copyright
|
332 |
+
Treaty of 1996, the WIPO Performances and Phonograms Treaty of 1996
|
333 |
+
and the Universal Copyright Convention (as revised on July 24, 1971).
|
334 |
+
These rights and subject matter take effect in the relevant
|
335 |
+
jurisdiction in which the License terms are sought to be enforced
|
336 |
+
according to the corresponding provisions of the implementation of
|
337 |
+
those treaty provisions in the applicable national law. If the
|
338 |
+
standard suite of rights granted under applicable copyright law
|
339 |
+
includes additional rights not granted under this License, such
|
340 |
+
additional rights are deemed to be included in the License; this
|
341 |
+
License is not intended to restrict the license of any rights under
|
342 |
+
applicable law.
|
343 |
+
|
344 |
+
|
345 |
+
Creative Commons Notice
|
346 |
+
|
347 |
+
Creative Commons is not a party to this License, and makes no warranty
|
348 |
+
whatsoever in connection with the Work. Creative Commons will not be
|
349 |
+
liable to You or any party on any legal theory for any damages
|
350 |
+
whatsoever, including without limitation any general, special,
|
351 |
+
incidental or consequential damages arising in connection to this
|
352 |
+
license. Notwithstanding the foregoing two (2) sentences, if Creative
|
353 |
+
Commons has expressly identified itself as the Licensor hereunder, it
|
354 |
+
shall have all rights and obligations of Licensor.
|
355 |
+
|
356 |
+
Except for the limited purpose of indicating to the public that the
|
357 |
+
Work is licensed under the CCPL, Creative Commons does not authorize
|
358 |
+
the use by either party of the trademark "Creative Commons" or any
|
359 |
+
related trademark or logo of Creative Commons without the prior
|
360 |
+
written consent of Creative Commons. Any permitted use will be in
|
361 |
+
compliance with Creative Commons' then-current trademark usage
|
362 |
+
guidelines, as may be published on its website or otherwise made
|
363 |
+
available upon request from time to time. For the avoidance of doubt,
|
364 |
+
this trademark restriction does not form part of the License.
|
365 |
+
|
366 |
+
Creative Commons may be contacted at https://creativecommons.org/.
|
367 |
+
```
|
368 |
+
|
369 |
+
|
370 |
+
|
371 |
+
|
README.md
ADDED
@@ -0,0 +1,59 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- spacy
|
4 |
+
language:
|
5 |
+
- multilingual
|
6 |
+
license: CC-BY-SA-3.0
|
7 |
+
model-index:
|
8 |
+
- name: xx_sent_ud_sm
|
9 |
+
results:
|
10 |
+
- tasks:
|
11 |
+
name: SENTER
|
12 |
+
type: token-classification
|
13 |
+
metrics:
|
14 |
+
- name: Precision
|
15 |
+
type: precision
|
16 |
+
value: 0.9029477287
|
17 |
+
- name: Recall
|
18 |
+
type: recall
|
19 |
+
value: 0.8194977584
|
20 |
+
- name: F Score
|
21 |
+
type: f_score
|
22 |
+
value: 0.8592012289
|
23 |
+
---
|
24 |
+
### Details: https://spacy.io/models/xx#xx_sent_ud_sm
|
25 |
+
|
26 |
+
Multi-language pipeline optimized for CPU. Components: senter.
|
27 |
+
|
28 |
+
| Feature | Description |
|
29 |
+
| --- | --- |
|
30 |
+
| **Name** | `xx_sent_ud_sm` |
|
31 |
+
| **Version** | `3.1.0` |
|
32 |
+
| **spaCy** | `>=3.1.0,<3.2.0` |
|
33 |
+
| **Default Pipeline** | `senter` |
|
34 |
+
| **Components** | `senter` |
|
35 |
+
| **Vectors** | 0 keys, 0 unique vectors (0 dimensions) |
|
36 |
+
| **Sources** | [Universal Dependencies v2.5 (UD_Afrikaans-AfriBooms, UD_Croatian-SET, UD_Czech-CAC, UD_Czech-CLTT, UD_Danish-DDT, UD_Dutch-Alpino, UD_Dutch-LassySmall, UD_English-EWT, UD_Finnish-FTB, UD_Finnish-TDT, UD_French-GSD, UD_French-Spoken, UD_German-GSD, UD_Indonesian-GSD, UD_Irish-IDT, UD_Italian-TWITTIRO, UD_Korean-GSD, UD_Korean-Kaist, UD_Latvian-LVTB, UD_Lithuanian-ALKSNIS, UD_Lithuanian-HSE, UD_Marathi-UFAL, UD_Norwegian-Bokmaal, UD_Norwegian-Nynorsk, UD_Norwegian-NynorskLIA, UD_Persian-Seraji, UD_Portuguese-Bosque, UD_Portuguese-GSD, UD_Romanian-Nonstandard, UD_Romanian-RRT, UD_Russian-GSD, UD_Russian-Taiga, UD_Serbian-SET, UD_Slovak-SNK, UD_Spanish-GSD, UD_Swedish-Talbanken, UD_Telugu-MTG, UD_Vietnamese-VTB)](https://universaldependencies.org/) (Zeman, Daniel; Nivre, Joakim; Abrams, Mitchell; et al.) |
|
37 |
+
| **License** | `CC BY-SA 3.0` |
|
38 |
+
| **Author** | [Explosion](https://explosion.ai) |
|
39 |
+
|
40 |
+
### Label Scheme
|
41 |
+
|
42 |
+
<details>
|
43 |
+
|
44 |
+
<summary>View label scheme (2 labels for 1 components)</summary>
|
45 |
+
|
46 |
+
| Component | Labels |
|
47 |
+
| --- | --- |
|
48 |
+
| **`senter`** | `I`, `S` |
|
49 |
+
|
50 |
+
</details>
|
51 |
+
|
52 |
+
### Accuracy
|
53 |
+
|
54 |
+
| Type | Score |
|
55 |
+
| --- | --- |
|
56 |
+
| `TOKEN_ACC` | 99.29 |
|
57 |
+
| `SENTS_P` | 90.29 |
|
58 |
+
| `SENTS_R` | 81.95 |
|
59 |
+
| `SENTS_F` | 85.92 |
|
accuracy.json
ADDED
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"token_acc": 0.9928959078,
|
3 |
+
"sents_p": 0.9029477287,
|
4 |
+
"sents_r": 0.8194977584,
|
5 |
+
"sents_f": 0.8592012289,
|
6 |
+
"speed": 291597.0307804538
|
7 |
+
}
|
config.cfg
ADDED
@@ -0,0 +1,135 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
[paths]
|
2 |
+
train = "corpus/xx-sent-ud/train.spacy"
|
3 |
+
dev = "corpus/xx-sent-ud/dev.spacy"
|
4 |
+
vectors = null
|
5 |
+
raw = null
|
6 |
+
init_tok2vec = null
|
7 |
+
vocab_data = null
|
8 |
+
|
9 |
+
[system]
|
10 |
+
gpu_allocator = null
|
11 |
+
seed = 0
|
12 |
+
|
13 |
+
[nlp]
|
14 |
+
lang = "xx"
|
15 |
+
pipeline = ["senter"]
|
16 |
+
disabled = []
|
17 |
+
before_creation = null
|
18 |
+
after_creation = null
|
19 |
+
after_pipeline_creation = null
|
20 |
+
batch_size = 256
|
21 |
+
tokenizer = {"@tokenizers":"spacy.Tokenizer.v1"}
|
22 |
+
|
23 |
+
[components]
|
24 |
+
|
25 |
+
[components.senter]
|
26 |
+
factory = "senter"
|
27 |
+
|
28 |
+
[components.senter.model]
|
29 |
+
@architectures = "spacy.Tagger.v1"
|
30 |
+
nO = null
|
31 |
+
|
32 |
+
[components.senter.model.tok2vec]
|
33 |
+
@architectures = "spacy.Tok2Vec.v2"
|
34 |
+
|
35 |
+
[components.senter.model.tok2vec.embed]
|
36 |
+
@architectures = "spacy.MultiHashEmbed.v2"
|
37 |
+
width = ${components.senter.model.tok2vec.encode:width}
|
38 |
+
attrs = ["NORM","PREFIX","SUFFIX","SHAPE"]
|
39 |
+
rows = [1000,500,500,500]
|
40 |
+
include_static_vectors = false
|
41 |
+
|
42 |
+
[components.senter.model.tok2vec.encode]
|
43 |
+
@architectures = "spacy.MaxoutWindowEncoder.v2"
|
44 |
+
width = 16
|
45 |
+
depth = 2
|
46 |
+
window_size = 1
|
47 |
+
maxout_pieces = 2
|
48 |
+
|
49 |
+
[corpora]
|
50 |
+
|
51 |
+
[corpora.dev]
|
52 |
+
@readers = "spacy.Corpus.v1"
|
53 |
+
limit = 0
|
54 |
+
max_length = 0
|
55 |
+
path = ${paths:dev}
|
56 |
+
gold_preproc = false
|
57 |
+
augmenter = null
|
58 |
+
|
59 |
+
[corpora.train]
|
60 |
+
@readers = "spacy.Corpus.v1"
|
61 |
+
path = ${paths:train}
|
62 |
+
max_length = 5000
|
63 |
+
gold_preproc = false
|
64 |
+
limit = 0
|
65 |
+
|
66 |
+
[corpora.train.augmenter]
|
67 |
+
@augmenters = "spacy.lower_case.v1"
|
68 |
+
level = 0.1
|
69 |
+
|
70 |
+
[training]
|
71 |
+
train_corpus = "corpora.train"
|
72 |
+
dev_corpus = "corpora.dev"
|
73 |
+
seed = ${system:seed}
|
74 |
+
gpu_allocator = ${system:gpu_allocator}
|
75 |
+
dropout = 0.1
|
76 |
+
accumulate_gradient = 1
|
77 |
+
patience = 5000
|
78 |
+
max_epochs = 0
|
79 |
+
max_steps = 0
|
80 |
+
eval_frequency = 1000
|
81 |
+
frozen_components = []
|
82 |
+
before_to_disk = null
|
83 |
+
annotating_components = []
|
84 |
+
|
85 |
+
[training.batcher]
|
86 |
+
@batchers = "spacy.batch_by_words.v1"
|
87 |
+
discard_oversize = false
|
88 |
+
tolerance = 0.2
|
89 |
+
get_length = null
|
90 |
+
|
91 |
+
[training.batcher.size]
|
92 |
+
@schedules = "compounding.v1"
|
93 |
+
start = 100
|
94 |
+
stop = 1000
|
95 |
+
compound = 1.001
|
96 |
+
t = 0.0
|
97 |
+
|
98 |
+
[training.logger]
|
99 |
+
@loggers = "spacy.WandbLogger.v1"
|
100 |
+
project_name = "spacy-v3.0.0a2"
|
101 |
+
remove_config_values = []
|
102 |
+
|
103 |
+
[training.optimizer]
|
104 |
+
@optimizers = "Adam.v1"
|
105 |
+
beta1 = 0.9
|
106 |
+
beta2 = 0.999
|
107 |
+
L2_is_weight_decay = true
|
108 |
+
L2 = 0.01
|
109 |
+
grad_clip = 1.0
|
110 |
+
use_averages = true
|
111 |
+
eps = 0.00000001
|
112 |
+
learn_rate = 0.001
|
113 |
+
|
114 |
+
[training.score_weights]
|
115 |
+
sents_f = 1.0
|
116 |
+
sents_p = 0.0
|
117 |
+
sents_r = 0.0
|
118 |
+
|
119 |
+
[pretraining]
|
120 |
+
|
121 |
+
[initialize]
|
122 |
+
vocab_data = ${paths.vocab_data}
|
123 |
+
vectors = ${paths.vectors}
|
124 |
+
init_tok2vec = ${paths.init_tok2vec}
|
125 |
+
before_init = null
|
126 |
+
after_init = null
|
127 |
+
|
128 |
+
[initialize.components]
|
129 |
+
|
130 |
+
[initialize.lookups]
|
131 |
+
@misc = "spacy.LookupsDataLoader.v1"
|
132 |
+
lang = ${nlp.lang}
|
133 |
+
tables = []
|
134 |
+
|
135 |
+
[initialize.tokenizer]
|
meta.json
ADDED
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"lang":"xx",
|
3 |
+
"name":"sent_ud_sm",
|
4 |
+
"version":"3.1.0",
|
5 |
+
"description":"Multi-language pipeline optimized for CPU. Components: senter.",
|
6 |
+
"author":"Explosion",
|
7 |
+
"email":"contact@explosion.ai",
|
8 |
+
"url":"https://explosion.ai",
|
9 |
+
"license":"CC BY-SA 3.0",
|
10 |
+
"spacy_version":">=3.1.0,<3.2.0",
|
11 |
+
"spacy_git_version":"caba63b74",
|
12 |
+
"vectors":{
|
13 |
+
"width":0,
|
14 |
+
"vectors":0,
|
15 |
+
"keys":0,
|
16 |
+
"name":null
|
17 |
+
},
|
18 |
+
"labels":{
|
19 |
+
"senter":[
|
20 |
+
"I",
|
21 |
+
"S"
|
22 |
+
]
|
23 |
+
},
|
24 |
+
"pipeline":[
|
25 |
+
"senter"
|
26 |
+
],
|
27 |
+
"components":[
|
28 |
+
"senter"
|
29 |
+
],
|
30 |
+
"disabled":[
|
31 |
+
|
32 |
+
],
|
33 |
+
"performance":{
|
34 |
+
"token_acc":0.9928959078,
|
35 |
+
"sents_p":0.9029477287,
|
36 |
+
"sents_r":0.8194977584,
|
37 |
+
"sents_f":0.8592012289,
|
38 |
+
"speed":291597.0307804538
|
39 |
+
},
|
40 |
+
"sources":[
|
41 |
+
{
|
42 |
+
"name":"Universal Dependencies v2.5 (UD_Afrikaans-AfriBooms, UD_Croatian-SET, UD_Czech-CAC, UD_Czech-CLTT, UD_Danish-DDT, UD_Dutch-Alpino, UD_Dutch-LassySmall, UD_English-EWT, UD_Finnish-FTB, UD_Finnish-TDT, UD_French-GSD, UD_French-Spoken, UD_German-GSD, UD_Indonesian-GSD, UD_Irish-IDT, UD_Italian-TWITTIRO, UD_Korean-GSD, UD_Korean-Kaist, UD_Latvian-LVTB, UD_Lithuanian-ALKSNIS, UD_Lithuanian-HSE, UD_Marathi-UFAL, UD_Norwegian-Bokmaal, UD_Norwegian-Nynorsk, UD_Norwegian-NynorskLIA, UD_Persian-Seraji, UD_Portuguese-Bosque, UD_Portuguese-GSD, UD_Romanian-Nonstandard, UD_Romanian-RRT, UD_Russian-GSD, UD_Russian-Taiga, UD_Serbian-SET, UD_Slovak-SNK, UD_Spanish-GSD, UD_Swedish-Talbanken, UD_Telugu-MTG, UD_Vietnamese-VTB)",
|
43 |
+
"url":"https://universaldependencies.org/",
|
44 |
+
"license":"CC BY-SA 3.0",
|
45 |
+
"author":"Zeman, Daniel; Nivre, Joakim; Abrams, Mitchell; et al."
|
46 |
+
}
|
47 |
+
],
|
48 |
+
"requirements":[
|
49 |
+
|
50 |
+
]
|
51 |
+
}
|
senter/cfg
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
|
3 |
+
}
|
senter/model
ADDED
Binary file (190 kB). View file
|
|
tokenizer
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
��prefix_search�~^§|^%|^=|^—|^–|^\+(?![0-9])|^…|^……|^,|^:|^;|^\!|^\?|^¿|^؟|^¡|^\(|^\)|^\[|^\]|^\{|^\}|^<|^>|^_|^#|^\*|^&|^。|^?|^!|^,|^、|^;|^:|^~|^·|^।|^،|^۔|^؛|^٪|^\.\.+|^…|^\'|^"|^”|^“|^`|^‘|^´|^’|^‚|^,|^„|^»|^«|^「|^」|^『|^』|^(|^)|^〔|^〕|^【|^】|^《|^》|^〈|^〉|^\$|^£|^€|^¥|^฿|^US\$|^C\$|^A\$|^₽|^﷼|^₴|^₠|^₡|^₢|^₣|^₤|^₥|^₦|^₧|^₨|^₩|^₪|^₫|^€|^₭|^₮|^₯|^₰|^₱|^₲|^₳|^₴|^₵|^₶|^₷|^₸|^₹|^₺|^₻|^₼|^₽|^₾|^₿|^[\u00A6\u00A9\u00AE\u00B0\u0482\u058D\u058E\u060E\u060F\u06DE\u06E9\u06FD\u06FE\u07F6\u09FA\u0B70\u0BF3-\u0BF8\u0BFA\u0C7F\u0D4F\u0D79\u0F01-\u0F03\u0F13\u0F15-\u0F17\u0F1A-\u0F1F\u0F34\u0F36\u0F38\u0FBE-\u0FC5\u0FC7-\u0FCC\u0FCE\u0FCF\u0FD5-\u0FD8\u109E\u109F\u1390-\u1399\u1940\u19DE-\u19FF\u1B61-\u1B6A\u1B74-\u1B7C\u2100\u2101\u2103-\u2106\u2108\u2109\u2114\u2116\u2117\u211E-\u2123\u2125\u2127\u2129\u212E\u213A\u213B\u214A\u214C\u214D\u214F\u218A\u218B\u2195-\u2199\u219C-\u219F\u21A1\u21A2\u21A4\u21A5\u21A7-\u21AD\u21AF-\u21CD\u21D0\u21D1\u21D3\u21D5-\u21F3\u2300-\u2307\u230C-\u231F\u2322-\u2328\u232B-\u237B\u237D-\u239A\u23B4-\u23DB\u23E2-\u2426\u2440-\u244A\u249C-\u24E9\u2500-\u25B6\u25B8-\u25C0\u25C2-\u25F7\u2600-\u266E\u2670-\u2767\u2794-\u27BF\u2800-\u28FF\u2B00-\u2B2F\u2B45\u2B46\u2B4D-\u2B73\u2B76-\u2B95\u2B98-\u2BC8\u2BCA-\u2BFE\u2CE5-\u2CEA\u2E80-\u2E99\u2E9B-\u2EF3\u2F00-\u2FD5\u2FF0-\u2FFB\u3004\u3012\u3013\u3020\u3036\u3037\u303E\u303F\u3190\u3191\u3196-\u319F\u31C0-\u31E3\u3200-\u321E\u322A-\u3247\u3250\u3260-\u327F\u328A-\u32B0\u32C0-\u32FE\u3300-\u33FF\u4DC0-\u4DFF\uA490-\uA4C6\uA828-\uA82B\uA836\uA837\uA839\uAA77-\uAA79\uFDFD\uFFE4\uFFE8\uFFED\uFFEE\uFFFC\uFFFD\U00010137-\U0001013F\U00010179-\U00010189\U0001018C-\U0001018E\U00010190-\U0001019B\U000101A0\U000101D0-\U000101FC\U00010877\U00010878\U00010AC8\U0001173F\U00016B3C-\U00016B3F\U00016B45\U0001BC9C\U0001D000-\U0001D0F5\U0001D100-\U0001D126\U0001D129-\U0001D164\U0001D16A-\U0001D16C\U0001D183\U0001D184\U0001D18C-\U0001D1A9\U0001D1AE-\U0001D1E8\U0001D200-\U0001D241\U0001D245\U0001D300-\U0001D356\U0001D800-\U0001D9FF\U0001DA37-\U0001DA3A\U0001DA6D-\U0001DA74\U0001DA76-\U0001DA83\U0001DA85\U0001DA86\U0001ECAC\U0001F000-\U0001F02B\U0001F030-\U0001F093\U0001F0A0-\U0001F0AE\U0001F0B1-\U0001F0BF\U0001F0C1-\U0001F0CF\U0001F0D1-\U0001F0F5\U0001F110-\U0001F16B\U0001F170-\U0001F1AC\U0001F1E6-\U0001F202\U0001F210-\U0001F23B\U0001F240-\U0001F248\U0001F250\U0001F251\U0001F260-\U0001F265\U0001F300-\U0001F3FA\U0001F400-\U0001F6D4\U0001F6E0-\U0001F6EC\U0001F6F0-\U0001F6F9\U0001F700-\U0001F773\U0001F780-\U0001F7D8\U0001F800-\U0001F80B\U0001F810-\U0001F847\U0001F850-\U0001F859\U0001F860-\U0001F887\U0001F890-\U0001F8AD\U0001F900-\U0001F90B\U0001F910-\U0001F93E\U0001F940-\U0001F970\U0001F973-\U0001F976\U0001F97A\U0001F97C-\U0001F9A2\U0001F9B0-\U0001F9B9\U0001F9C0-\U0001F9C2\U0001F9D0-\U0001F9FF\U0001FA60-\U0001FA6D]�suffix_search�2"…$|……$|,$|:$|;$|\!$|\?$|¿$|؟$|¡$|\($|\)$|\[$|\]$|\{$|\}$|<$|>$|_$|#$|\*$|&$|。$|?$|!$|,$|、$|;$|:$|~$|·$|।$|،$|۔$|؛$|٪$|\.\.+$|…$|\'$|"$|”$|“$|`$|‘$|´$|’$|‚$|,$|„$|»$|«$|「$|」$|『$|』$|($|)$|〔$|〕$|【$|】$|《$|》$|〈$|〉$|[\u00A6\u00A9\u00AE\u00B0\u0482\u058D\u058E\u060E\u060F\u06DE\u06E9\u06FD\u06FE\u07F6\u09FA\u0B70\u0BF3-\u0BF8\u0BFA\u0C7F\u0D4F\u0D79\u0F01-\u0F03\u0F13\u0F15-\u0F17\u0F1A-\u0F1F\u0F34\u0F36\u0F38\u0FBE-\u0FC5\u0FC7-\u0FCC\u0FCE\u0FCF\u0FD5-\u0FD8\u109E\u109F\u1390-\u1399\u1940\u19DE-\u19FF\u1B61-\u1B6A\u1B74-\u1B7C\u2100\u2101\u2103-\u2106\u2108\u2109\u2114\u2116\u2117\u211E-\u2123\u2125\u2127\u2129\u212E\u213A\u213B\u214A\u214C\u214D\u214F\u218A\u218B\u2195-\u2199\u219C-\u219F\u21A1\u21A2\u21A4\u21A5\u21A7-\u21AD\u21AF-\u21CD\u21D0\u21D1\u21D3\u21D5-\u21F3\u2300-\u2307\u230C-\u231F\u2322-\u2328\u232B-\u237B\u237D-\u239A\u23B4-\u23DB\u23E2-\u2426\u2440-\u244A\u249C-\u24E9\u2500-\u25B6\u25B8-\u25C0\u25C2-\u25F7\u2600-\u266E\u2670-\u2767\u2794-\u27BF\u2800-\u28FF\u2B00-\u2B2F\u2B45\u2B46\u2B4D-\u2B73\u2B76-\u2B95\u2B98-\u2BC8\u2BCA-\u2BFE\u2CE5-\u2CEA\u2E80-\u2E99\u2E9B-\u2EF3\u2F00-\u2FD5\u2FF0-\u2FFB\u3004\u3012\u3013\u3020\u3036\u3037\u303E\u303F\u3190\u3191\u3196-\u319F\u31C0-\u31E3\u3200-\u321E\u322A-\u3247\u3250\u3260-\u327F\u328A-\u32B0\u32C0-\u32FE\u3300-\u33FF\u4DC0-\u4DFF\uA490-\uA4C6\uA828-\uA82B\uA836\uA837\uA839\uAA77-\uAA79\uFDFD\uFFE4\uFFE8\uFFED\uFFEE\uFFFC\uFFFD\U00010137-\U0001013F\U00010179-\U00010189\U0001018C-\U0001018E\U00010190-\U0001019B\U000101A0\U000101D0-\U000101FC\U00010877\U00010878\U00010AC8\U0001173F\U00016B3C-\U00016B3F\U00016B45\U0001BC9C\U0001D000-\U0001D0F5\U0001D100-\U0001D126\U0001D129-\U0001D164\U0001D16A-\U0001D16C\U0001D183\U0001D184\U0001D18C-\U0001D1A9\U0001D1AE-\U0001D1E8\U0001D200-\U0001D241\U0001D245\U0001D300-\U0001D356\U0001D800-\U0001D9FF\U0001DA37-\U0001DA3A\U0001DA6D-\U0001DA74\U0001DA76-\U0001DA83\U0001DA85\U0001DA86\U0001ECAC\U0001F000-\U0001F02B\U0001F030-\U0001F093\U0001F0A0-\U0001F0AE\U0001F0B1-\U0001F0BF\U0001F0C1-\U0001F0CF\U0001F0D1-\U0001F0F5\U0001F110-\U0001F16B\U0001F170-\U0001F1AC\U0001F1E6-\U0001F202\U0001F210-\U0001F23B\U0001F240-\U0001F248\U0001F250\U0001F251\U0001F260-\U0001F265\U0001F300-\U0001F3FA\U0001F400-\U0001F6D4\U0001F6E0-\U0001F6EC\U0001F6F0-\U0001F6F9\U0001F700-\U0001F773\U0001F780-\U0001F7D8\U0001F800-\U0001F80B\U0001F810-\U0001F847\U0001F850-\U0001F859\U0001F860-\U0001F887\U0001F890-\U0001F8AD\U0001F900-\U0001F90B\U0001F910-\U0001F93E\U0001F940-\U0001F970\U0001F973-\U0001F976\U0001F97A\U0001F97C-\U0001F9A2\U0001F9B0-\U0001F9B9\U0001F9C0-\U0001F9C2\U0001F9D0-\U0001F9FF\U0001FA60-\U0001FA6D]$|'s$|'S$|’s$|’S$|—$|–$|(?<=[0-9])\+$|(?<=°[FfCcKk])\.$|(?<=[0-9])(?:\$|£|€|¥|฿|US\$|C\$|A\$|₽|﷼|₴|₠|₡|₢|₣|₤|₥|₦|₧|₨|₩|₪|₫|€|₭|₮|₯|₰|₱|₲|₳|₴|₵|₶|₷|₸|₹|₺|₻|₼|₽|₾|₿)$|(?<=[0-9])(?:km|km²|km³|m|m²|m³|dm|dm²|dm³|cm|cm²|cm³|mm|mm²|mm³|ha|µm|nm|yd|in|ft|kg|g|mg|µg|t|lb|oz|m/s|km/h|kmh|mph|hPa|Pa|mbar|mb|MB|kb|KB|gb|GB|tb|TB|T|G|M|K|%|км|км²|км³|м|м²|м³|дм|дм²|дм³|см|см²|см³|мм|мм²|мм³|нм|кг|г|мг|м/с|км/ч|кПа|Па|мбар|Кб|КБ|кб|Мб|МБ|мб|Гб|ГБ|гб|Тб|ТБ|тбكم|كم²|كم³|م|م²|م³|سم|سم²|سم³|مم|مم²|مم³|كم|غرام|جرام|جم|كغ|ملغ|كوب|اكواب)$|(?<=[0-9a-z\uFF41-\uFF5A\u00DF-\u00F6\u00F8-\u00FF\u0101\u0103\u0105\u0107\u0109\u010B\u010D\u010F\u0111\u0113\u0115\u0117\u0119\u011B\u011D\u011F\u0121\u0123\u0125\u0127\u0129\u012B\u012D\u012F\u0131\u0133\u0135\u0137\u0138\u013A\u013C\u013E\u0140\u0142\u0144\u0146\u0148\u0149\u014B\u014D\u014F\u0151\u0153\u0155\u0157\u0159\u015B\u015D\u015F\u0161\u0163\u0165\u0167\u0169\u016B\u016D\u016F\u0171\u0173\u0175\u0177\u017A\u017C\u017E\u017F\u0180\u0183\u0185\u0188\u018C\u018D\u0192\u0195\u0199-\u019B\u019E\u01A1\u01A3\u01A5\u01A8\u01AA\u01AB\u01AD\u01B0\u01B4\u01B6\u01B9\u01BA\u01BD-\u01BF\u01C6\u01C9\u01CC\u01CE\u01D0\u01D2\u01D4\u01D6\u01D8\u01DA\u01DC\u01DD\u01DF\u01E1\u01E3\u01E5\u01E7\u01E9\u01EB\u01ED\u01EF\u01F0\u01F3\u01F5\u01F9\u01FB\u01FD\u01FF\u0201\u0203\u0205\u0207\u0209\u020B\u020D\u020F\u0211\u0213\u0215\u0217\u0219\u021B\u021D\u021F\u0221\u0223\u0225\u0227\u0229\u022B\u022D\u022F\u0231\u0233-\u0239\u023C\u023F\u0240\u0242\u0247\u0249\u024B\u024D\u024F\u2C61\u2C65\u2C66\u2C68\u2C6A\u2C6C\u2C71\u2C73\u2C74\u2C76-\u2C7B\uA723\uA725\uA727\uA729\uA72B\uA72D\uA72F-\uA731\uA733\uA735\uA737\uA739\uA73B\uA73D\uA73F\uA741\uA743\uA745\uA747\uA749\uA74B\uA74D\uA74F\uA751\uA753\uA755\uA757\uA759\uA75B\uA75D\uA75F\uA761\uA763\uA765\uA767\uA769\uA76B\uA76D\uA76F\uA771-\uA778\uA77A\uA77C\uA77F\uA781\uA783\uA785\uA787\uA78C\uA78E\uA791\uA793-\uA795\uA797\uA799\uA79B\uA79D\uA79F\uA7A1\uA7A3\uA7A5\uA7A7\uA7A9\uA7AF\uA7B5\uA7B7\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E01\u1E03\u1E05\u1E07\u1E09\u1E0B\u1E0D\u1E0F\u1E11\u1E13\u1E15\u1E17\u1E19\u1E1B\u1E1D\u1E1F\u1E21\u1E23\u1E25\u1E27\u1E29\u1E2B\u1E2D\u1E2F\u1E31\u1E33\u1E35\u1E37\u1E39\u1E3B\u1E3D\u1E3F\u1E41\u1E43\u1E45\u1E47\u1E49\u1E4B\u1E4D\u1E4F\u1E51\u1E53\u1E55\u1E57\u1E59\u1E5B\u1E5D\u1E5F\u1E61\u1E63\u1E65\u1E67\u1E69\u1E6B\u1E6D\u1E6F\u1E71\u1E73\u1E75\u1E77\u1E79\u1E7B\u1E7D\u1E7F\u1E81\u1E83\u1E85\u1E87\u1E89\u1E8B\u1E8D\u1E8F\u1E91\u1E93\u1E95-\u1E9D\u1E9F\u1EA1\u1EA3\u1EA5\u1EA7\u1EA9\u1EAB\u1EAD\u1EAF\u1EB1\u1EB3\u1EB5\u1EB7\u1EB9\u1EBB\u1EBD\u1EBF\u1EC1\u1EC3\u1EC5\u1EC7\u1EC9\u1ECB\u1ECD\u1ECF\u1ED1\u1ED3\u1ED5\u1ED7\u1ED9\u1EDB\u1EDD\u1EDF\u1EE1\u1EE3\u1EE5\u1EE7\u1EE9\u1EEB\u1EED\u1EEF\u1EF1\u1EF3\u1EF5\u1EF7\u1EF9\u1EFB\u1EFD\u1EFFёа-яәөүҗңһα-ωάέίόώήύа-щюяіїєґѓѕјљњќѐѝ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F%²\-\+…|……|,|:|;|\!|\?|¿|؟|¡|\(|\)|\[|\]|\{|\}|<|>|_|#|\*|&|。|?|!|,|、|;|:|~|·|।|،|۔|؛|٪(?:\'"”“`‘´’‚,„»«「」『』()〔〕【】《》〈〉)])\.$|(?<=[A-Z\uFF21-\uFF3A\u00C0-\u00D6\u00D8-\u00DE\u0100\u0102\u0104\u0106\u0108\u010A\u010C\u010E\u0110\u0112\u0114\u0116\u0118\u011A\u011C\u011E\u0120\u0122\u0124\u0126\u0128\u012A\u012C\u012E\u0130\u0132\u0134\u0136\u0139\u013B\u013D\u013F\u0141\u0143\u0145\u0147\u014A\u014C\u014E\u0150\u0152\u0154\u0156\u0158\u015A\u015C\u015E\u0160\u0162\u0164\u0166\u0168\u016A\u016C\u016E\u0170\u0172\u0174\u0176\u0178\u0179\u017B\u017D\u0181\u0182\u0184\u0186\u0187\u0189-\u018B\u018E-\u0191\u0193\u0194\u0196-\u0198\u019C\u019D\u019F\u01A0\u01A2\u01A4\u01A6\u01A7\u01A9\u01AC\u01AE\u01AF\u01B1-\u01B3\u01B5\u01B7\u01B8\u01BC\u01C4\u01C7\u01CA\u01CD\u01CF\u01D1\u01D3\u01D5\u01D7\u01D9\u01DB\u01DE\u01E0\u01E2\u01E4\u01E6\u01E8\u01EA\u01EC\u01EE\u01F1\u01F4\u01F6-\u01F8\u01FA\u01FC\u01FE\u0200\u0202\u0204\u0206\u0208\u020A\u020C\u020E\u0210\u0212\u0214\u0216\u0218\u021A\u021C\u021E\u0220\u0222\u0224\u0226\u0228\u022A\u022C\u022E\u0230\u0232\u023A\u023B\u023D\u023E\u0241\u0243-\u0246\u0248\u024A\u024C\u024E\u2C60\u2C62-\u2C64\u2C67\u2C69\u2C6B\u2C6D-\u2C70\u2C72\u2C75\u2C7E\u2C7F\uA722\uA724\uA726\uA728\uA72A\uA72C\uA72E\uA732\uA734\uA736\uA738\uA73A\uA73C\uA73E\uA740\uA742\uA744\uA746\uA748\uA74A\uA74C\uA74E\uA750\uA752\uA754\uA756\uA758\uA75A\uA75C\uA75E\uA760\uA762\uA764\uA766\uA768\uA76A\uA76C\uA76E\uA779\uA77B\uA77D\uA77E\uA780\uA782\uA784\uA786\uA78B\uA78D\uA790\uA792\uA796\uA798\uA79A\uA79C\uA79E\uA7A0\uA7A2\uA7A4\uA7A6\uA7A8\uA7AA-\uA7AE\uA7B0-\uA7B4\uA7B6\uA7B8\u1E00\u1E02\u1E04\u1E06\u1E08\u1E0A\u1E0C\u1E0E\u1E10\u1E12\u1E14\u1E16\u1E18\u1E1A\u1E1C\u1E1E\u1E20\u1E22\u1E24\u1E26\u1E28\u1E2A\u1E2C\u1E2E\u1E30\u1E32\u1E34\u1E36\u1E38\u1E3A\u1E3C\u1E3E\u1E40\u1E42\u1E44\u1E46\u1E48\u1E4A\u1E4C\u1E4E\u1E50\u1E52\u1E54\u1E56\u1E58\u1E5A\u1E5C\u1E5E\u1E60\u1E62\u1E64\u1E66\u1E68\u1E6A\u1E6C\u1E6E\u1E70\u1E72\u1E74\u1E76\u1E78\u1E7A\u1E7C\u1E7E\u1E80\u1E82\u1E84\u1E86\u1E88\u1E8A\u1E8C\u1E8E\u1E90\u1E92\u1E94\u1E9E\u1EA0\u1EA2\u1EA4\u1EA6\u1EA8\u1EAA\u1EAC\u1EAE\u1EB0\u1EB2\u1EB4\u1EB6\u1EB8\u1EBA\u1EBC\u1EBE\u1EC0\u1EC2\u1EC4\u1EC6\u1EC8\u1ECA\u1ECC\u1ECE\u1ED0\u1ED2\u1ED4\u1ED6\u1ED8\u1EDA\u1EDC\u1EDE\u1EE0\u1EE2\u1EE4\u1EE6\u1EE8\u1EEA\u1EEC\u1EEE\u1EF0\u1EF2\u1EF4\u1EF6\u1EF8\u1EFA\u1EFC\u1EFEЁА-ЯӘӨҮҖҢҺΑ-ΩΆΈΊΌΏΉΎА-ЩЮЯІЇЄҐЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F][A-Z\uFF21-\uFF3A\u00C0-\u00D6\u00D8-\u00DE\u0100\u0102\u0104\u0106\u0108\u010A\u010C\u010E\u0110\u0112\u0114\u0116\u0118\u011A\u011C\u011E\u0120\u0122\u0124\u0126\u0128\u012A\u012C\u012E\u0130\u0132\u0134\u0136\u0139\u013B\u013D\u013F\u0141\u0143\u0145\u0147\u014A\u014C\u014E\u0150\u0152\u0154\u0156\u0158\u015A\u015C\u015E\u0160\u0162\u0164\u0166\u0168\u016A\u016C\u016E\u0170\u0172\u0174\u0176\u0178\u0179\u017B\u017D\u0181\u0182\u0184\u0186\u0187\u0189-\u018B\u018E-\u0191\u0193\u0194\u0196-\u0198\u019C\u019D\u019F\u01A0\u01A2\u01A4\u01A6\u01A7\u01A9\u01AC\u01AE\u01AF\u01B1-\u01B3\u01B5\u01B7\u01B8\u01BC\u01C4\u01C7\u01CA\u01CD\u01CF\u01D1\u01D3\u01D5\u01D7\u01D9\u01DB\u01DE\u01E0\u01E2\u01E4\u01E6\u01E8\u01EA\u01EC\u01EE\u01F1\u01F4\u01F6-\u01F8\u01FA\u01FC\u01FE\u0200\u0202\u0204\u0206\u0208\u020A\u020C\u020E\u0210\u0212\u0214\u0216\u0218\u021A\u021C\u021E\u0220\u0222\u0224\u0226\u0228\u022A\u022C\u022E\u0230\u0232\u023A\u023B\u023D\u023E\u0241\u0243-\u0246\u0248\u024A\u024C\u024E\u2C60\u2C62-\u2C64\u2C67\u2C69\u2C6B\u2C6D-\u2C70\u2C72\u2C75\u2C7E\u2C7F\uA722\uA724\uA726\uA728\uA72A\uA72C\uA72E\uA732\uA734\uA736\uA738\uA73A\uA73C\uA73E\uA740\uA742\uA744\uA746\uA748\uA74A\uA74C\uA74E\uA750\uA752\uA754\uA756\uA758\uA75A\uA75C\uA75E\uA760\uA762\uA764\uA766\uA768\uA76A\uA76C\uA76E\uA779\uA77B\uA77D\uA77E\uA780\uA782\uA784\uA786\uA78B\uA78D\uA790\uA792\uA796\uA798\uA79A\uA79C\uA79E\uA7A0\uA7A2\uA7A4\uA7A6\uA7A8\uA7AA-\uA7AE\uA7B0-\uA7B4\uA7B6\uA7B8\u1E00\u1E02\u1E04\u1E06\u1E08\u1E0A\u1E0C\u1E0E\u1E10\u1E12\u1E14\u1E16\u1E18\u1E1A\u1E1C\u1E1E\u1E20\u1E22\u1E24\u1E26\u1E28\u1E2A\u1E2C\u1E2E\u1E30\u1E32\u1E34\u1E36\u1E38\u1E3A\u1E3C\u1E3E\u1E40\u1E42\u1E44\u1E46\u1E48\u1E4A\u1E4C\u1E4E\u1E50\u1E52\u1E54\u1E56\u1E58\u1E5A\u1E5C\u1E5E\u1E60\u1E62\u1E64\u1E66\u1E68\u1E6A\u1E6C\u1E6E\u1E70\u1E72\u1E74\u1E76\u1E78\u1E7A\u1E7C\u1E7E\u1E80\u1E82\u1E84\u1E86\u1E88\u1E8A\u1E8C\u1E8E\u1E90\u1E92\u1E94\u1E9E\u1EA0\u1EA2\u1EA4\u1EA6\u1EA8\u1EAA\u1EAC\u1EAE\u1EB0\u1EB2\u1EB4\u1EB6\u1EB8\u1EBA\u1EBC\u1EBE\u1EC0\u1EC2\u1EC4\u1EC6\u1EC8\u1ECA\u1ECC\u1ECE\u1ED0\u1ED2\u1ED4\u1ED6\u1ED8\u1EDA\u1EDC\u1EDE\u1EE0\u1EE2\u1EE4\u1EE6\u1EE8\u1EEA\u1EEC\u1EEE\u1EF0\u1EF2\u1EF4\u1EF6\u1EF8\u1EFA\u1EFC\u1EFEЁА-ЯӘӨҮҖҢҺΑ-ΩΆΈΊΌΏΉΎА-ЩЮЯІЇЄҐЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])\.$�infix_finditer�=�\.\.+|…|[\u00A6\u00A9\u00AE\u00B0\u0482\u058D\u058E\u060E\u060F\u06DE\u06E9\u06FD\u06FE\u07F6\u09FA\u0B70\u0BF3-\u0BF8\u0BFA\u0C7F\u0D4F\u0D79\u0F01-\u0F03\u0F13\u0F15-\u0F17\u0F1A-\u0F1F\u0F34\u0F36\u0F38\u0FBE-\u0FC5\u0FC7-\u0FCC\u0FCE\u0FCF\u0FD5-\u0FD8\u109E\u109F\u1390-\u1399\u1940\u19DE-\u19FF\u1B61-\u1B6A\u1B74-\u1B7C\u2100\u2101\u2103-\u2106\u2108\u2109\u2114\u2116\u2117\u211E-\u2123\u2125\u2127\u2129\u212E\u213A\u213B\u214A\u214C\u214D\u214F\u218A\u218B\u2195-\u2199\u219C-\u219F\u21A1\u21A2\u21A4\u21A5\u21A7-\u21AD\u21AF-\u21CD\u21D0\u21D1\u21D3\u21D5-\u21F3\u2300-\u2307\u230C-\u231F\u2322-\u2328\u232B-\u237B\u237D-\u239A\u23B4-\u23DB\u23E2-\u2426\u2440-\u244A\u249C-\u24E9\u2500-\u25B6\u25B8-\u25C0\u25C2-\u25F7\u2600-\u266E\u2670-\u2767\u2794-\u27BF\u2800-\u28FF\u2B00-\u2B2F\u2B45\u2B46\u2B4D-\u2B73\u2B76-\u2B95\u2B98-\u2BC8\u2BCA-\u2BFE\u2CE5-\u2CEA\u2E80-\u2E99\u2E9B-\u2EF3\u2F00-\u2FD5\u2FF0-\u2FFB\u3004\u3012\u3013\u3020\u3036\u3037\u303E\u303F\u3190\u3191\u3196-\u319F\u31C0-\u31E3\u3200-\u321E\u322A-\u3247\u3250\u3260-\u327F\u328A-\u32B0\u32C0-\u32FE\u3300-\u33FF\u4DC0-\u4DFF\uA490-\uA4C6\uA828-\uA82B\uA836\uA837\uA839\uAA77-\uAA79\uFDFD\uFFE4\uFFE8\uFFED\uFFEE\uFFFC\uFFFD\U00010137-\U0001013F\U00010179-\U00010189\U0001018C-\U0001018E\U00010190-\U0001019B\U000101A0\U000101D0-\U000101FC\U00010877\U00010878\U00010AC8\U0001173F\U00016B3C-\U00016B3F\U00016B45\U0001BC9C\U0001D000-\U0001D0F5\U0001D100-\U0001D126\U0001D129-\U0001D164\U0001D16A-\U0001D16C\U0001D183\U0001D184\U0001D18C-\U0001D1A9\U0001D1AE-\U0001D1E8\U0001D200-\U0001D241\U0001D245\U0001D300-\U0001D356\U0001D800-\U0001D9FF\U0001DA37-\U0001DA3A\U0001DA6D-\U0001DA74\U0001DA76-\U0001DA83\U0001DA85\U0001DA86\U0001ECAC\U0001F000-\U0001F02B\U0001F030-\U0001F093\U0001F0A0-\U0001F0AE\U0001F0B1-\U0001F0BF\U0001F0C1-\U0001F0CF\U0001F0D1-\U0001F0F5\U0001F110-\U0001F16B\U0001F170-\U0001F1AC\U0001F1E6-\U0001F202\U0001F210-\U0001F23B\U0001F240-\U0001F248\U0001F250\U0001F251\U0001F260-\U0001F265\U0001F300-\U0001F3FA\U0001F400-\U0001F6D4\U0001F6E0-\U0001F6EC\U0001F6F0-\U0001F6F9\U0001F700-\U0001F773\U0001F780-\U0001F7D8\U0001F800-\U0001F80B\U0001F810-\U0001F847\U0001F850-\U0001F859\U0001F860-\U0001F887\U0001F890-\U0001F8AD\U0001F900-\U0001F90B\U0001F910-\U0001F93E\U0001F940-\U0001F970\U0001F973-\U0001F976\U0001F97A\U0001F97C-\U0001F9A2\U0001F9B0-\U0001F9B9\U0001F9C0-\U0001F9C2\U0001F9D0-\U0001F9FF\U0001FA60-\U0001FA6D]|(?<=[0-9])[+\-\*^](?=[0-9-])|(?<=[a-z\uFF41-\uFF5A\u00DF-\u00F6\u00F8-\u00FF\u0101\u0103\u0105\u0107\u0109\u010B\u010D\u010F\u0111\u0113\u0115\u0117\u0119\u011B\u011D\u011F\u0121\u0123\u0125\u0127\u0129\u012B\u012D\u012F\u0131\u0133\u0135\u0137\u0138\u013A\u013C\u013E\u0140\u0142\u0144\u0146\u0148\u0149\u014B\u014D\u014F\u0151\u0153\u0155\u0157\u0159\u015B\u015D\u015F\u0161\u0163\u0165\u0167\u0169\u016B\u016D\u016F\u0171\u0173\u0175\u0177\u017A\u017C\u017E\u017F\u0180\u0183\u0185\u0188\u018C\u018D\u0192\u0195\u0199-\u019B\u019E\u01A1\u01A3\u01A5\u01A8\u01AA\u01AB\u01AD\u01B0\u01B4\u01B6\u01B9\u01BA\u01BD-\u01BF\u01C6\u01C9\u01CC\u01CE\u01D0\u01D2\u01D4\u01D6\u01D8\u01DA\u01DC\u01DD\u01DF\u01E1\u01E3\u01E5\u01E7\u01E9\u01EB\u01ED\u01EF\u01F0\u01F3\u01F5\u01F9\u01FB\u01FD\u01FF\u0201\u0203\u0205\u0207\u0209\u020B\u020D\u020F\u0211\u0213\u0215\u0217\u0219\u021B\u021D\u021F\u0221\u0223\u0225\u0227\u0229\u022B\u022D\u022F\u0231\u0233-\u0239\u023C\u023F\u0240\u0242\u0247\u0249\u024B\u024D\u024F\u2C61\u2C65\u2C66\u2C68\u2C6A\u2C6C\u2C71\u2C73\u2C74\u2C76-\u2C7B\uA723\uA725\uA727\uA729\uA72B\uA72D\uA72F-\uA731\uA733\uA735\uA737\uA739\uA73B\uA73D\uA73F\uA741\uA743\uA745\uA747\uA749\uA74B\uA74D\uA74F\uA751\uA753\uA755\uA757\uA759\uA75B\uA75D\uA75F\uA761\uA763\uA765\uA767\uA769\uA76B\uA76D\uA76F\uA771-\uA778\uA77A\uA77C\uA77F\uA781\uA783\uA785\uA787\uA78C\uA78E\uA791\uA793-\uA795\uA797\uA799\uA79B\uA79D\uA79F\uA7A1\uA7A3\uA7A5\uA7A7\uA7A9\uA7AF\uA7B5\uA7B7\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E01\u1E03\u1E05\u1E07\u1E09\u1E0B\u1E0D\u1E0F\u1E11\u1E13\u1E15\u1E17\u1E19\u1E1B\u1E1D\u1E1F\u1E21\u1E23\u1E25\u1E27\u1E29\u1E2B\u1E2D\u1E2F\u1E31\u1E33\u1E35\u1E37\u1E39\u1E3B\u1E3D\u1E3F\u1E41\u1E43\u1E45\u1E47\u1E49\u1E4B\u1E4D\u1E4F\u1E51\u1E53\u1E55\u1E57\u1E59\u1E5B\u1E5D\u1E5F\u1E61\u1E63\u1E65\u1E67\u1E69\u1E6B\u1E6D\u1E6F\u1E71\u1E73\u1E75\u1E77\u1E79\u1E7B\u1E7D\u1E7F\u1E81\u1E83\u1E85\u1E87\u1E89\u1E8B\u1E8D\u1E8F\u1E91\u1E93\u1E95-\u1E9D\u1E9F\u1EA1\u1EA3\u1EA5\u1EA7\u1EA9\u1EAB\u1EAD\u1EAF\u1EB1\u1EB3\u1EB5\u1EB7\u1EB9\u1EBB\u1EBD\u1EBF\u1EC1\u1EC3\u1EC5\u1EC7\u1EC9\u1ECB\u1ECD\u1ECF\u1ED1\u1ED3\u1ED5\u1ED7\u1ED9\u1EDB\u1EDD\u1EDF\u1EE1\u1EE3\u1EE5\u1EE7\u1EE9\u1EEB\u1EED\u1EEF\u1EF1\u1EF3\u1EF5\u1EF7\u1EF9\u1EFB\u1EFD\u1EFFёа-яәөүҗңһα-ωάέίόώήύа-щюяіїєґѓѕјљњќѐѝ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F\'"”“`‘´’‚,„»«「」『』()〔〕【】《》〈〉])\.(?=[A-Z\uFF21-\uFF3A\u00C0-\u00D6\u00D8-\u00DE\u0100\u0102\u0104\u0106\u0108\u010A\u010C\u010E\u0110\u0112\u0114\u0116\u0118\u011A\u011C\u011E\u0120\u0122\u0124\u0126\u0128\u012A\u012C\u012E\u0130\u0132\u0134\u0136\u0139\u013B\u013D\u013F\u0141\u0143\u0145\u0147\u014A\u014C\u014E\u0150\u0152\u0154\u0156\u0158\u015A\u015C\u015E\u0160\u0162\u0164\u0166\u0168\u016A\u016C\u016E\u0170\u0172\u0174\u0176\u0178\u0179\u017B\u017D\u0181\u0182\u0184\u0186\u0187\u0189-\u018B\u018E-\u0191\u0193\u0194\u0196-\u0198\u019C\u019D\u019F\u01A0\u01A2\u01A4\u01A6\u01A7\u01A9\u01AC\u01AE\u01AF\u01B1-\u01B3\u01B5\u01B7\u01B8\u01BC\u01C4\u01C7\u01CA\u01CD\u01CF\u01D1\u01D3\u01D5\u01D7\u01D9\u01DB\u01DE\u01E0\u01E2\u01E4\u01E6\u01E8\u01EA\u01EC\u01EE\u01F1\u01F4\u01F6-\u01F8\u01FA\u01FC\u01FE\u0200\u0202\u0204\u0206\u0208\u020A\u020C\u020E\u0210\u0212\u0214\u0216\u0218\u021A\u021C\u021E\u0220\u0222\u0224\u0226\u0228\u022A\u022C\u022E\u0230\u0232\u023A\u023B\u023D\u023E\u0241\u0243-\u0246\u0248\u024A\u024C\u024E\u2C60\u2C62-\u2C64\u2C67\u2C69\u2C6B\u2C6D-\u2C70\u2C72\u2C75\u2C7E\u2C7F\uA722\uA724\uA726\uA728\uA72A\uA72C\uA72E\uA732\uA734\uA736\uA738\uA73A\uA73C\uA73E\uA740\uA742\uA744\uA746\uA748\uA74A\uA74C\uA74E\uA750\uA752\uA754\uA756\uA758\uA75A\uA75C\uA75E\uA760\uA762\uA764\uA766\uA768\uA76A\uA76C\uA76E\uA779\uA77B\uA77D\uA77E\uA780\uA782\uA784\uA786\uA78B\uA78D\uA790\uA792\uA796\uA798\uA79A\uA79C\uA79E\uA7A0\uA7A2\uA7A4\uA7A6\uA7A8\uA7AA-\uA7AE\uA7B0-\uA7B4\uA7B6\uA7B8\u1E00\u1E02\u1E04\u1E06\u1E08\u1E0A\u1E0C\u1E0E\u1E10\u1E12\u1E14\u1E16\u1E18\u1E1A\u1E1C\u1E1E\u1E20\u1E22\u1E24\u1E26\u1E28\u1E2A\u1E2C\u1E2E\u1E30\u1E32\u1E34\u1E36\u1E38\u1E3A\u1E3C\u1E3E\u1E40\u1E42\u1E44\u1E46\u1E48\u1E4A\u1E4C\u1E4E\u1E50\u1E52\u1E54\u1E56\u1E58\u1E5A\u1E5C\u1E5E\u1E60\u1E62\u1E64\u1E66\u1E68\u1E6A\u1E6C\u1E6E\u1E70\u1E72\u1E74\u1E76\u1E78\u1E7A\u1E7C\u1E7E\u1E80\u1E82\u1E84\u1E86\u1E88\u1E8A\u1E8C\u1E8E\u1E90\u1E92\u1E94\u1E9E\u1EA0\u1EA2\u1EA4\u1EA6\u1EA8\u1EAA\u1EAC\u1EAE\u1EB0\u1EB2\u1EB4\u1EB6\u1EB8\u1EBA\u1EBC\u1EBE\u1EC0\u1EC2\u1EC4\u1EC6\u1EC8\u1ECA\u1ECC\u1ECE\u1ED0\u1ED2\u1ED4\u1ED6\u1ED8\u1EDA\u1EDC\u1EDE\u1EE0\u1EE2\u1EE4\u1EE6\u1EE8\u1EEA\u1EEC\u1EEE\u1EF0\u1EF2\u1EF4\u1EF6\u1EF8\u1EFA\u1EFC\u1EFEЁА-ЯӘӨҮҖҢҺΑ-ΩΆΈΊΌΏΉΎА-ЩЮЯІЇЄҐЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F\'"”“`‘´’‚,„»«「」『』()〔〕【】《》〈〉])|(?<=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F]),(?=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])|(?<=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])(?:-|–|—|--|---|——|~)(?=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])|(?<=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F0-9])[:<>=/](?=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])�token_match��url_match�
|
2 |
+
��A�
|
3 |
+
� ��A� �'��A�'�''��A�''�(*_*)��A�(*_*)�(-8��A�(-8�(-:��A�(-:�(-;��A�(-;�(-_-)��A�(-_-)�(._.)��A�(._.)�(:��A�(:�(;��A�(;�(=��A�(=�(>_<)��A�(>_<)�(^_^)��A�(^_^)�(o:��A�(o:�(¬_¬)��A�(¬_¬)�(ಠ_ಠ)��A�(ಠ_ಠ)�(╯°□°)╯︵┻━┻��A�(╯°□°)╯︵┻━┻�)-:��A�)-:�):��A�):�-_-��A�-_-�-__-��A�-__-�._.��A�._.�0.0��A�0.0�0.o��A�0.o�0_0��A�0_0�0_o��A�0_o�8)��A�8)�8-)��A�8-)�8-D��A�8-D�8D��A�8D�:'(��A�:'(�:')��A�:')�:'-(��A�:'-(�:'-)��A�:'-)�:(��A�:(�:((��A�:((�:(((��A�:(((�:()��A�:()�:)��A�:)�:))��A�:))�:)))��A�:)))�:*��A�:*�:-(��A�:-(�:-((��A�:-((�:-(((��A�:-(((�:-)��A�:-)�:-))��A�:-))�:-)))��A�:-)))�:-*��A�:-*�:-/��A�:-/�:-0��A�:-0�:-3��A�:-3�:->��A�:->�:-D��A�:-D�:-O��A�:-O�:-P��A�:-P�:-X��A�:-X�:-]��A�:-]�:-o��A�:-o�:-p��A�:-p�:-x��A�:-x�:-|��A�:-|�:-}��A�:-}�:/��A�:/�:0��A�:0�:1��A�:1�:3��A�:3�:>��A�:>�:D��A�:D�:O��A�:O�:P��A�:P�:X��A�:X�:]��A�:]�:o��A�:o�:o)��A�:o)�:p��A�:p�:x��A�:x�:|��A�:|�:}��A�:}�;)��A�;)�;-)��A�;-)�;-D��A�;-D�;D��A�;D�;_;��A�;_;�<.<��A�<.<�</3��A�</3�<3��A�<3�<33��A�<33�<333��A�<333�<space>��A�<space>�=(��A�=(�=)��A�=)�=/��A�=/�=3��A�=3�=D��A�=D�=[��A�=[�=]��A�=]�=|��A�=|�>.<��A�>.<�>.>��A�>.>�>:(��A�>:(�>:o��A�>:o�><(((*>��A�><(((*>�@_@��A�@_@�C++��A�C++�O.O��A�O.O�O.o��A�O.o�O_O��A�O_O�O_o��A�O_o�V.V��A�V.V�V_V��A�V_V�XD��A�XD�XDD��A�XDD�[-:��A�[-:�[:��A�[:�[=��A�[=�\")��A�\")�\n��A�\n�\t��A�\t�]=��A�]=�^_^��A�^_^�^__^��A�^__^�^___^��A�^___^�a.��A�a.�b.��A�b.�c.��A�c.�d.��A�d.�e.��A�e.�f.��A�f.�g.��A�g.�h.��A�h.�i.��A�i.�j.��A�j.�k.��A�k.�l.��A�l.�m.��A�m.�n.��A�n.�o.��A�o.�o.0��A�o.0�o.O��A�o.O�o.o��A�o.o�o_0��A�o_0�o_O��A�o_O�o_o��A�o_o�p.��A�p.�q.��A�q.�r.��A�r.�s.��A�s.�t.��A�t.�u.��A�u.�v.��A�v.�v.v��A�v.v�v_v��A�v_v�w.��A�w.�x.��A�x.�xD��A�xD�xDD��A�xDD�y.��A�y.�z.��A�z.� ��A� C� �¯\(ツ)/¯��A�¯\(ツ)/¯�ä.��A�ä.�ö.��A�ö.�ü.��A�ü.�ಠ_ಠ��A�ಠ_ಠ�ಠ︵ಠ��A�ಠ︵ಠ�—��A�—
|
vocab/key2row
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
�
|
vocab/lookups.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:76be8b528d0075f7aae98d6fa57a6d3c83ae480a8469e668d7b0af968995ac71
|
3 |
+
size 1
|
vocab/strings.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:81a6ce709bee8ccc3b41e6276a15b0c7b9cd9fca20a8672e98bda93876171806
|
3 |
+
size 28346933
|
vocab/vectors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:14772b683e726436d5948ad3fff2b43d036ef2ebbe3458aafed6004e05a40706
|
3 |
+
size 128
|
xx_sent_ud_sm-any-py3-none-any.whl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:377b8f58de2897d6c76293441b88bec96c41eda5f8519529f3fcd5cb74f7a628
|
3 |
+
size 4986769
|