Update spaCy pipeline

LICENSES_SOURCES

@@ -1,4 +1,4 @@
-# UD Japanese GSD v2.6
+# UD Japanese GSD v2.8
 
 * Author: Omura, Mai; Miyao, Yusuke; Kanayama, Hiroshi; Matsuda, Hiroshi; Wakasa, Aya; Yamashita, Kayo; Asahara, Masayuki; Tanaka, Takaaki; Murawaki, Yugo; Matsumoto, Yuji; Mori, Shinsuke; Uematsu, Sumire; McDonald, Ryan; Nivre, Joakim; Zeman, Daniel
 * URL: https://github.com/UniversalDependencies/UD_Japanese-GSD
@@ -438,7 +438,7 @@ Creative Commons may be contacted at creativecommons.org.
 
 
 
-# UD Japanese GSD v2.6 NER
+# UD Japanese GSD v2.8 NER
 
 * Author: Megagon Labs Tokyo
 * URL: https://github.com/megagonlabs/UD_Japanese-GSD

README.md

@@ -4,7 +4,7 @@ tags:
 - token-classification
 language:
 - ja
-license: CC-BY-SA-4.0
+license: cc-by-sa-4.0
 model-index:
 - name: ja_core_news_md
   results:
@@ -14,61 +14,61 @@ model-index:
     metrics:
     - name: NER Precision
       type: precision
-      value: 0.7527932961
+      value: 0.737704918
     - name: NER Recall
       type: recall
-      value: 0.6883780332
+      value: 0.679245283
     - name: NER F Score
       type: f_score
-      value: 0.7191460974
+      value: 0.7072691552
   - task:
       name: POS
       type: token-classification
     metrics:
     - name: POS Accuracy
       type: accuracy
-      value: 0.9721899386
+      value: 0.9715755942
   - task:
       name: SENTER
       type: token-classification
     metrics:
     - name: SENTER Precision
       type: precision
-      value: 0.994
+      value: 0.9862475442
     - name: SENTER Recall
       type: recall
-      value: 0.9920159681
+      value: 0.9901380671
     - name: SENTER F Score
       type: f_score
-      value: 0.993006993
+      value: 0.9881889764
   - task:
       name: UNLABELED_DEPENDENCIES
       type: token-classification
     metrics:
     - name: Unlabeled Dependencies Accuracy
       type: accuracy
-      value: 0.9192898975
+      value: 0.9224188392
   - task:
       name: LABELED_DEPENDENCIES
       type: token-classification
     metrics:
     - name: Labeled Dependencies Accuracy
       type: accuracy
-      value: 0.9192898975
+      value: 0.9224188392
 ---
 ### Details: https://spacy.io/models/ja#ja_core_news_md
 
-Japanese pipeline optimized for CPU. Components: tok2vec, parser, senter, ner, attribute_ruler.
+Japanese pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, senter, ner, attribute_ruler.
 
 | Feature | Description |
 | --- | --- |
 | **Name** | `ja_core_news_md` |
-| **Version** | `3.1.0` |
-| **spaCy** | `>=3.1.0,<3.2.0` |
-| **Default Pipeline** | `tok2vec`, `parser`, `attribute_ruler`, `ner` |
-| **Components** | `tok2vec`, `parser`, `senter`, `attribute_ruler`, `ner` |
+| **Version** | `3.2.0` |
+| **spaCy** | `>=3.2.0,<3.3.0` |
+| **Default Pipeline** | `tok2vec`, `morphologizer`, `parser`, `attribute_ruler`, `ner` |
+| **Components** | `tok2vec`, `morphologizer`, `parser`, `senter`, `attribute_ruler`, `ner` |
 | **Vectors** | 480443 keys, 20000 unique vectors (300 dimensions) |
-| **Sources** | [UD Japanese GSD v2.6](https://github.com/UniversalDependencies/UD_Japanese-GSD) (Omura, Mai; Miyao, Yusuke; Kanayama, Hiroshi; Matsuda, Hiroshi; Wakasa, Aya; Yamashita, Kayo; Asahara, Masayuki; Tanaka, Takaaki; Murawaki, Yugo; Matsumoto, Yuji; Mori, Shinsuke; Uematsu, Sumire; McDonald, Ryan; Nivre, Joakim; Zeman, Daniel)<br />[UD Japanese GSD v2.6 NER](https://github.com/megagonlabs/UD_Japanese-GSD) (Megagon Labs Tokyo)<br />[chiVe: Japanese Word Embedding with Sudachi & NWJC (chive-1.1-mc90-500k)](https://github.com/WorksApplications/chiVe) (Works Applications) |
+| **Sources** | [UD Japanese GSD v2.8](https://github.com/UniversalDependencies/UD_Japanese-GSD) (Omura, Mai; Miyao, Yusuke; Kanayama, Hiroshi; Matsuda, Hiroshi; Wakasa, Aya; Yamashita, Kayo; Asahara, Masayuki; Tanaka, Takaaki; Murawaki, Yugo; Matsumoto, Yuji; Mori, Shinsuke; Uematsu, Sumire; McDonald, Ryan; Nivre, Joakim; Zeman, Daniel)<br />[UD Japanese GSD v2.8 NER](https://github.com/megagonlabs/UD_Japanese-GSD) (Megagon Labs Tokyo)<br />[chiVe: Japanese Word Embedding with Sudachi & NWJC (chive-1.1-mc90-500k)](https://github.com/WorksApplications/chiVe) (Works Applications) |
 | **License** | `CC BY-SA 4.0` |
 | **Author** | [Explosion](https://explosion.ai) |
 
@@ -76,10 +76,11 @@ Japanese pipeline optimized for CPU. Components: tok2vec, parser, senter, ner, a
 
 <details>
 
-<summary>View label scheme (47 labels for 3 components)</summary>
+<summary>View label scheme (66 labels for 4 components)</summary>
 
 | Component | Labels |
 | --- | --- |
+| **`morphologizer`** | `POS=NOUN`, `POS=ADP`, `POS=VERB`, `POS=SCONJ`, `POS=AUX`, `POS=PUNCT`, `POS=PART`, `POS=DET`, `POS=NUM`, `POS=ADV`, `POS=PRON`, `POS=ADJ`, `POS=PROPN`, `POS=CCONJ`, `POS=SYM`, `POS=NOUN\|Polarity=Neg`, `POS=AUX\|Polarity=Neg`, `POS=INTJ`, `POS=SCONJ\|Polarity=Neg` |
 | **`parser`** | `ROOT`, `acl`, `advcl`, `advmod`, `amod`, `aux`, `case`, `cc`, `ccomp`, `compound`, `cop`, `csubj`, `dep`, `det`, `dislocated`, `fixed`, `mark`, `nmod`, `nsubj`, `nummod`, `obj`, `obl`, `punct` |
 | **`senter`** | `I`, `S` |
 | **`ner`** | `CARDINAL`, `DATE`, `EVENT`, `FAC`, `GPE`, `LANGUAGE`, `LAW`, `LOC`, `MONEY`, `MOVEMENT`, `NORP`, `ORDINAL`, `ORG`, `PERCENT`, `PERSON`, `PET_NAME`, `PHONE`, `PRODUCT`, `QUANTITY`, `TIME`, `TITLE_AFFIX`, `WORK_OF_ART` |
@@ -91,14 +92,21 @@ Japanese pipeline optimized for CPU. Components: tok2vec, parser, senter, ner, a
 | Type | Score |
 | --- | --- |
 | `TOKEN_ACC` | 99.69 |
-| `TAG_ACC` | 97.22 |
-| `POS_ACC` | 96.40 |
-| `MORPH_ACC` | 0.00 |
-| `DEP_UAS` | 91.93 |
-| `DEP_LAS` | 90.06 |
-| `ENTS_P` | 75.28 |
-| `ENTS_R` | 68.84 |
-| `ENTS_F` | 71.91 |
-| `SENTS_P` | 99.40 |
-| `SENTS_R` | 99.20 |
-| `SENTS_F` | 99.30 |
+| `TOKEN_P` | 97.65 |
+| `TOKEN_R` | 97.90 |
+| `TOKEN_F` | 97.77 |
+| `POS_ACC` | 97.13 |
+| `MORPH_ACC` | 0.40 |
+| `MORPH_MICRO_P` | 34.01 |
+| `MORPH_MICRO_R` | 98.04 |
+| `MORPH_MICRO_F` | 50.51 |
+| `SENTS_P` | 98.62 |
+| `SENTS_R` | 99.01 |
+| `SENTS_F` | 98.82 |
+| `DEP_UAS` | 92.24 |
+| `DEP_LAS` | 90.75 |
+| `TAG_ACC` | 97.16 |
+| `LEMMA_ACC` | 96.59 |
+| `ENTS_P` | 73.77 |
+| `ENTS_R` | 67.92 |
+| `ENTS_F` | 70.73 |

accuracy.json

@@ -1,166 +1,182 @@
 {
-  "token_acc": 0.9968965945,
-  "tag_acc": 0.9721899386,
-  "pos_acc": 0.9639755682,
-  "morph_acc": 0.0,
-  "dep_uas": 0.9192898975,
-  "dep_las": 0.9005714286,
-  "ents_p": 0.7527932961,
-  "ents_r": 0.6883780332,
-  "ents_f": 0.7191460974,
-  "sents_p": 0.994,
-  "sents_r": 0.9920159681,
-  "sents_f": 0.993006993,
-  "speed": 13117.9406369597,
+  "token_acc": 0.9968649485,
+  "token_p": 0.9764591282,
+  "token_r": 0.9790021974,
+  "token_f": 0.9777290092,
+  "pos_acc": 0.971323379,
+  "morph_acc": 0.0040005162,
+  "morph_micro_p": 0.3401360544,
+  "morph_micro_r": 0.9803921569,
+  "morph_micro_f": 0.5050505051,
   "morph_per_feat": {
     "Polarity": {
+      "p": 1.0,
+      "r": 0.9803921569,
+      "f": 0.9900990099
+    },
+    "Inflection": {
+      "p": 0.0,
+      "r": 0.0,
+      "f": 0.0
+    },
+    "Reading": {
       "p": 0.0,
       "r": 0.0,
       "f": 0.0
     }
   },
+  "sents_p": 0.9862475442,
+  "sents_r": 0.9901380671,
+  "sents_f": 0.9881889764,
+  "dep_uas": 0.9224188392,
+  "dep_las": 0.9075365579,
   "dep_las_per_type": {
     "cc": {
-      "p": 0.829787234,
-      "r": 0.847826087,
-      "f": 0.8387096774
-    },
-    "nummod": {
-      "p": 0.9806949807,
-      "r": 0.8728522337,
-      "f": 0.9236363636
+      "p": 0.7708333333,
+      "r": 0.7708333333,
+      "f": 0.7708333333
     },
     "compound": {
-      "p": 0.9418825016,
-      "r": 0.9255121043,
-      "f": 0.9336255479
+      "p": 0.9421390999,
+      "r": 0.908680947,
+      "f": 0.925107604
     },
     "obl": {
-      "p": 0.7983587339,
-      "r": 0.8185096154,
-      "f": 0.8083086053
+      "p": 0.8222778473,
+      "r": 0.8202247191,
+      "f": 0.82125
     },
     "case": {
-      "p": 0.9838709677,
-      "r": 0.9782359679,
-      "f": 0.9810453762
+      "p": 0.9907763259,
+      "r": 0.9794832827,
+      "f": 0.9850974398
     },
     "dislocated": {
-      "p": 0.5,
-      "r": 0.3157894737,
-      "f": 0.3870967742
-    },
-    "nmod": {
-      "p": 0.8684546616,
-      "r": 0.8192771084,
-      "f": 0.843149411
+      "p": 0.5833333333,
+      "r": 0.5384615385,
+      "f": 0.56
     },
     "nsubj": {
-      "p": 0.8020618557,
-      "r": 0.8104166667,
-      "f": 0.8062176166
+      "p": 0.8061420345,
+      "r": 0.8061420345,
+      "f": 0.8061420345
+    },
+    "nmod": {
+      "p": 0.88639201,
+      "r": 0.8304093567,
+      "f": 0.8574879227
     },
     "root": {
-      "p": 0.9634888438,
-      "r": 0.9481037924,
-      "f": 0.9557344064
+      "p": 0.9741035857,
+      "r": 0.9644970414,
+      "f": 0.9692765114
     },
     "aux": {
-      "p": 0.9575844716,
-      "r": 0.9652173913,
-      "f": 0.9613857813
+      "p": 0.977818854,
+      "r": 0.982358403,
+      "f": 0.9800833719
     },
     "advcl": {
-      "p": 0.6797235023,
-      "r": 0.6876456876,
-      "f": 0.6836616454
+      "p": 0.6726057906,
+      "r": 0.6786516854,
+      "f": 0.6756152125
     },
     "mark": {
-      "p": 0.9575757576,
-      "r": 0.9330708661,
-      "f": 0.9451645065
+      "p": 0.9599198397,
+      "r": 0.958,
+      "f": 0.958958959
+    },
+    "fixed": {
+      "p": 0.9533213645,
+      "r": 0.9654545455,
+      "f": 0.9593495935
     },
     "acl": {
-      "p": 0.8216704289,
-      "r": 0.8017621145,
-      "f": 0.8115942029
+      "p": 0.8561946903,
+      "r": 0.8505494505,
+      "f": 0.8533627343
     },
     "obj": {
-      "p": 0.9320987654,
-      "r": 0.9207317073,
-      "f": 0.9263803681
+      "p": 0.9695121951,
+      "r": 0.9607250755,
+      "f": 0.9650986343
     },
-    "fixed": {
-      "p": 0.9371727749,
-      "r": 0.9835164835,
-      "f": 0.9597855228
+    "nummod": {
+      "p": 0.9868421053,
+      "r": 0.8875739645,
+      "f": 0.9345794393
     },
     "advmod": {
-      "p": 0.6823529412,
-      "r": 0.4603174603,
-      "f": 0.5497630332
+      "p": 0.6323529412,
+      "r": 0.6142857143,
+      "f": 0.6231884058
     },
     "amod": {
-      "p": 0.9259259259,
-      "r": 0.625,
-      "f": 0.7462686567
+      "p": 0.9,
+      "r": 0.7297297297,
+      "f": 0.8059701493
     },
     "cop": {
-      "p": 0.9653179191,
-      "r": 0.9175824176,
-      "f": 0.9408450704
+      "p": 0.9585798817,
+      "r": 0.9418604651,
+      "f": 0.9501466276
     },
     "ccomp": {
-      "p": 0.95,
-      "r": 0.8636363636,
-      "f": 0.9047619048
+      "p": 1.0,
+      "r": 0.7272727273,
+      "f": 0.8421052632
+    },
+    "det": {
+      "p": 0.9615384615,
+      "r": 0.9433962264,
+      "f": 0.9523809524
     },
     "csubj": {
-      "p": 0.5294117647,
-      "r": 0.6923076923,
-      "f": 0.6
+      "p": 0.6923076923,
+      "r": 0.75,
+      "f": 0.72
     },
     "dep": {
       "p": 0.0,
       "r": 0.0,
       "f": 0.0
-    },
-    "det": {
-      "p": 0.9607843137,
-      "r": 0.9607843137,
-      "f": 0.9607843137
     }
   },
+  "tag_acc": 0.9715755942,
+  "lemma_acc": 0.9659109444,
+  "ents_p": 0.737704918,
+  "ents_r": 0.679245283,
+  "ents_f": 0.7072691552,
   "ents_per_type": {
     "DATE": {
-      "p": 0.9622641509,
-      "r": 0.9444444444,
-      "f": 0.953271028
-    },
-    "PERSON": {
-      "p": 0.7769784173,
-      "r": 0.7769784173,
-      "f": 0.7769784173
+      "p": 0.9722222222,
+      "r": 0.9633027523,
+      "f": 0.9677419355
     },
     "ORG": {
-      "p": 0.6052631579,
-      "r": 0.5267175573,
-      "f": 0.5632653061
+      "p": 0.6218487395,
+      "r": 0.5401459854,
+      "f": 0.578125
     },
     "TITLE_AFFIX": {
-      "p": 0.84,
-      "r": 0.7,
-      "f": 0.7636363636
+      "p": 0.7727272727,
+      "r": 0.5666666667,
+      "f": 0.6538461538
+    },
+    "PERSON": {
+      "p": 0.7407407407,
+      "r": 0.7194244604,
+      "f": 0.7299270073
     },
     "GPE": {
-      "p": 0.6813186813,
-      "r": 0.6595744681,
-      "f": 0.6702702703
+      "p": 0.6774193548,
+      "r": 0.670212766,
+      "f": 0.6737967914
     },
     "PRODUCT": {
-      "p": 0.4285714286,
-      "r": 0.3658536585,
-      "f": 0.3947368421
+      "p": 0.5806451613,
+      "r": 0.4285714286,
+      "f": 0.4931506849
     },
     "TIME": {
       "p": 0.6666666667,
@@ -168,44 +184,49 @@
       "f": 0.8
     },
     "QUANTITY": {
-      "p": 0.9242424242,
-      "r": 0.9242424242,
-      "f": 0.9242424242
+      "p": 0.8382352941,
+      "r": 0.8636363636,
+      "f": 0.8507462687
     },
     "NORP": {
-      "p": 0.7777777778,
-      "r": 0.65625,
-      "f": 0.7118644068
+      "p": 0.7407407407,
+      "r": 0.625,
+      "f": 0.6779661017
     },
     "ORDINAL": {
-      "p": 0.6842105263,
-      "r": 0.6842105263,
-      "f": 0.6842105263
+      "p": 0.5357142857,
+      "r": 0.6818181818,
+      "f": 0.6
     },
     "WORK_OF_ART": {
-      "p": 0.8571428571,
+      "p": 0.8,
       "r": 0.7058823529,
-      "f": 0.7741935484
+      "f": 0.75
     },
     "FAC": {
-      "p": 0.5555555556,
-      "r": 0.4054054054,
-      "f": 0.46875
-    },
-    "EVENT": {
-      "p": 0.8571428571,
-      "r": 0.4615384615,
-      "f": 0.6
+      "p": 0.619047619,
+      "r": 0.3513513514,
+      "f": 0.4482758621
     },
     "PERCENT": {
       "p": 1.0,
       "r": 0.2857142857,
       "f": 0.4444444444
     },
+    "CARDINAL": {
+      "p": 0.0,
+      "r": 0.0,
+      "f": 0.0
+    },
+    "EVENT": {
+      "p": 0.75,
+      "r": 0.6923076923,
+      "f": 0.72
+    },
     "LOC": {
-      "p": 0.5625,
-      "r": 0.9,
-      "f": 0.6923076923
+      "p": 0.5333333333,
+      "r": 0.8,
+      "f": 0.64
     },
     "MOVEMENT": {
       "p": 0.0,
@@ -213,24 +234,20 @@
       "f": 0.0
     },
     "LAW": {
-      "p": 0.0,
-      "r": 0.0,
-      "f": 0.0
+      "p": 1.0,
+      "r": 0.3333333333,
+      "f": 0.5
     },
     "MONEY": {
-      "p": 1.0,
+      "p": 0.875,
       "r": 1.0,
-      "f": 1.0
+      "f": 0.9333333333
     },
     "LANGUAGE": {
-      "p": 1.0,
+      "p": 0.8571428571,
       "r": 1.0,
-      "f": 1.0
-    },
-    "CARDINAL": {
-      "p": 0.0,
-      "r": 0.0,
-      "f": 0.0
+      "f": 0.9230769231
     }
-  }
+  },
+  "speed": 4621.4641630782
 }

config.cfg

@@ -1,10 +1,8 @@
 [paths]
-train = "corpus/ja-core-news/train.spacy"
-dev = "corpus/ja-core-news/dev.spacy"
-vectors = "corpus/ja_vectors"
-raw = null
+train = null
+dev = null
+vectors = null
 init_tok2vec = null
-vocab_data = null
 
 [system]
 gpu_allocator = null
@@ -12,7 +10,7 @@ seed = 0
 
 [nlp]
 lang = "ja"
-pipeline = ["tok2vec","parser","senter","attribute_ruler","ner"]
+pipeline = ["tok2vec","morphologizer","parser","senter","attribute_ruler","ner"]
 disabled = ["senter"]
 before_creation = null
 after_creation = null
@@ -27,12 +25,29 @@ split_mode = null
 
 [components.attribute_ruler]
 factory = "attribute_ruler"
+scorer = {"@scorers":"spacy.attribute_ruler_scorer.v1"}
 validate = false
 
+[components.morphologizer]
+factory = "morphologizer"
+extend = true
+overwrite = true
+scorer = {"@scorers":"spacy.morphologizer_scorer.v1"}
+
+[components.morphologizer.model]
+@architectures = "spacy.Tagger.v1"
+nO = null
+
+[components.morphologizer.model.tok2vec]
+@architectures = "spacy.Tok2VecListener.v1"
+width = ${components.tok2vec.model.encode:width}
+upstream = "tok2vec"
+
 [components.ner]
 factory = "ner"
 incorrect_spans_key = null
 moves = null
+scorer = {"@scorers":"spacy.ner_scorer.v1"}
 update_with_oracle_cut_size = 100
 
 [components.ner.model]
@@ -66,6 +81,7 @@ factory = "parser"
 learn_tokens = false
 min_action_freq = 30
 moves = null
+scorer = {"@scorers":"spacy.parser_scorer.v1"}
 update_with_oracle_cut_size = 100
 
 [components.parser.model]
@@ -84,6 +100,8 @@ upstream = "tok2vec"
 
 [components.senter]
 factory = "senter"
+overwrite = false
+scorer = {"@scorers":"spacy.senter_scorer.v1"}
 
 [components.senter.model]
 @architectures = "spacy.Tagger.v1"
@@ -130,17 +148,17 @@ maxout_pieces = 3
 
 [corpora.dev]
 @readers = "spacy.Corpus.v1"
-limit = 0
-max_length = 0
-path = ${paths:dev}
+path = ${paths.dev}
 gold_preproc = false
+max_length = 0
+limit = 0
 augmenter = null
 
 [corpora.train]
 @readers = "spacy.Corpus.v1"
-path = ${paths:train}
-max_length = 5000
+path = ${paths.train}
 gold_preproc = false
+max_length = 0
 limit = 0
 augmenter = null
 
@@ -173,9 +191,8 @@ compound = 1.001
 t = 0.0
 
 [training.logger]
-@loggers = "spacy.WandbLogger.v1"
-project_name = "spacy-v3.0.0a2"
-remove_config_values = []
+@loggers = "spacy.ConsoleLogger.v1"
+progress_bar = false
 
 [training.optimizer]
 @optimizers = "Adam.v1"
@@ -189,21 +206,26 @@ eps = 0.00000001
 learn_rate = 0.001
 
 [training.score_weights]
+pos_acc = 0.11
+morph_micro_f = 0.33
+morph_per_feat = null
 dep_uas = 0.0
-dep_las = 0.45
+dep_las = 0.21
 dep_las_per_type = null
 sents_p = null
 sents_r = null
-sents_f = 0.06
-ents_f = 0.5
+sents_f = 0.03
+ents_f = 0.21
 ents_p = 0.0
 ents_r = 0.0
 ents_per_type = null
+morph_acc = 0.11
+speed = 0.0
 
 [pretraining]
 
 [initialize]
-vocab_data = ${paths.vocab_data}
+vocab_data = null
 vectors = ${paths.vectors}
 init_tok2vec = ${paths.init_tok2vec}
 before_init = null
@@ -211,6 +233,13 @@ after_init = null
 
 [initialize.components]
 
+[initialize.components.morphologizer]
+
+[initialize.components.morphologizer.labels]
+@readers = "spacy.read_labels.v1"
+path = "corpus/labels/morphologizer.json"
+require = false
+
 [initialize.components.ner]
 
 [initialize.components.ner.labels]

ja_core_news_md-any-py3-none-any.whl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fb0bbbcdeb6856d65d2c1452649c9d66a21a0e617f34f7ab077ab2b7e41df8c4
-size 42813318
+oid sha256:c851e760a3b18f48359d9c52828ced1d1bf2560063d8fcdfc161203e3eaf35eb
+size 43045518

meta.json

@@ -1,14 +1,14 @@
 {
   "lang":"ja",
   "name":"core_news_md",
-  "version":"3.1.0",
-  "description":"Japanese pipeline optimized for CPU. Components: tok2vec, parser, senter, ner, attribute_ruler.",
+  "version":"3.2.0",
+  "description":"Japanese pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, senter, ner, attribute_ruler.",
   "author":"Explosion",
   "email":"contact@explosion.ai",
   "url":"https://explosion.ai",
   "license":"CC BY-SA 4.0",
-  "spacy_version":">=3.1.0,<3.2.0",
-  "spacy_git_version":"caba63b74",
+  "spacy_version":">=3.2.0,<3.3.0",
+  "spacy_git_version":"bb26550e2",
   "vectors":{
     "width":300,
     "vectors":20000,
@@ -18,6 +18,27 @@
   "labels":{
     "tok2vec":[
 
+    ],
+    "morphologizer":[
+      "POS=NOUN",
+      "POS=ADP",
+      "POS=VERB",
+      "POS=SCONJ",
+      "POS=AUX",
+      "POS=PUNCT",
+      "POS=PART",
+      "POS=DET",
+      "POS=NUM",
+      "POS=ADV",
+      "POS=PRON",
+      "POS=ADJ",
+      "POS=PROPN",
+      "POS=CCONJ",
+      "POS=SYM",
+      "POS=NOUN|Polarity=Neg",
+      "POS=AUX|Polarity=Neg",
+      "POS=INTJ",
+      "POS=SCONJ|Polarity=Neg"
     ],
     "parser":[
       "ROOT",
@@ -78,12 +99,14 @@
   },
   "pipeline":[
     "tok2vec",
+    "morphologizer",
     "parser",
     "attribute_ruler",
     "ner"
   ],
   "components":[
     "tok2vec",
+    "morphologizer",
     "parser",
     "senter",
     "attribute_ruler",
@@ -93,168 +116,184 @@
     "senter"
   ],
   "performance":{
-    "token_acc":0.9968965945,
-    "tag_acc":0.9721899386,
-    "pos_acc":0.9639755682,
-    "morph_acc":0.0,
-    "dep_uas":0.9192898975,
-    "dep_las":0.9005714286,
-    "ents_p":0.7527932961,
-    "ents_r":0.6883780332,
-    "ents_f":0.7191460974,
-    "sents_p":0.994,
-    "sents_r":0.9920159681,
-    "sents_f":0.993006993,
-    "speed":13117.9406369597,
+    "token_acc":0.9968649485,
+    "token_p":0.9764591282,
+    "token_r":0.9790021974,
+    "token_f":0.9777290092,
+    "pos_acc":0.971323379,
+    "morph_acc":0.0040005162,
+    "morph_micro_p":0.3401360544,
+    "morph_micro_r":0.9803921569,
+    "morph_micro_f":0.5050505051,
     "morph_per_feat":{
       "Polarity":{
+        "p":1.0,
+        "r":0.9803921569,
+        "f":0.9900990099
+      },
+      "Inflection":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
+      },
+      "Reading":{
         "p":0.0,
         "r":0.0,
         "f":0.0
       }
     },
+    "sents_p":0.9862475442,
+    "sents_r":0.9901380671,
+    "sents_f":0.9881889764,
+    "dep_uas":0.9224188392,
+    "dep_las":0.9075365579,
     "dep_las_per_type":{
       "cc":{
-        "p":0.829787234,
-        "r":0.847826087,
-        "f":0.8387096774
-      },
-      "nummod":{
-        "p":0.9806949807,
-        "r":0.8728522337,
-        "f":0.9236363636
+        "p":0.7708333333,
+        "r":0.7708333333,
+        "f":0.7708333333
       },
       "compound":{
-        "p":0.9418825016,
-        "r":0.9255121043,
-        "f":0.9336255479
+        "p":0.9421390999,
+        "r":0.908680947,
+        "f":0.925107604
       },
       "obl":{
-        "p":0.7983587339,
-        "r":0.8185096154,
-        "f":0.8083086053
+        "p":0.8222778473,
+        "r":0.8202247191,
+        "f":0.82125
       },
       "case":{
-        "p":0.9838709677,
-        "r":0.9782359679,
-        "f":0.9810453762
+        "p":0.9907763259,
+        "r":0.9794832827,
+        "f":0.9850974398
       },
       "dislocated":{
-        "p":0.5,
-        "r":0.3157894737,
-        "f":0.3870967742
-      },
-      "nmod":{
-        "p":0.8684546616,
-        "r":0.8192771084,
-        "f":0.843149411
+        "p":0.5833333333,
+        "r":0.5384615385,
+        "f":0.56
       },
       "nsubj":{
-        "p":0.8020618557,
-        "r":0.8104166667,
-        "f":0.8062176166
+        "p":0.8061420345,
+        "r":0.8061420345,
+        "f":0.8061420345
+      },
+      "nmod":{
+        "p":0.88639201,
+        "r":0.8304093567,
+        "f":0.8574879227
       },
       "root":{
-        "p":0.9634888438,
-        "r":0.9481037924,
-        "f":0.9557344064
+        "p":0.9741035857,
+        "r":0.9644970414,
+        "f":0.9692765114
       },
       "aux":{
-        "p":0.9575844716,
-        "r":0.9652173913,
-        "f":0.9613857813
+        "p":0.977818854,
+        "r":0.982358403,
+        "f":0.9800833719
       },
       "advcl":{
-        "p":0.6797235023,
-        "r":0.6876456876,
-        "f":0.6836616454
+        "p":0.6726057906,
+        "r":0.6786516854,
+        "f":0.6756152125
       },
       "mark":{
-        "p":0.9575757576,
-        "r":0.9330708661,
-        "f":0.9451645065
+        "p":0.9599198397,
+        "r":0.958,
+        "f":0.958958959
+      },
+      "fixed":{
+        "p":0.9533213645,
+        "r":0.9654545455,
+        "f":0.9593495935
       },
       "acl":{
-        "p":0.8216704289,
-        "r":0.8017621145,
-        "f":0.8115942029
+        "p":0.8561946903,
+        "r":0.8505494505,
+        "f":0.8533627343
       },
       "obj":{
-        "p":0.9320987654,
-        "r":0.9207317073,
-        "f":0.9263803681
+        "p":0.9695121951,
+        "r":0.9607250755,
+        "f":0.9650986343
       },
-      "fixed":{
-        "p":0.9371727749,
-        "r":0.9835164835,
-        "f":0.9597855228
+      "nummod":{
+        "p":0.9868421053,
+        "r":0.8875739645,
+        "f":0.9345794393
       },
       "advmod":{
-        "p":0.6823529412,
-        "r":0.4603174603,
-        "f":0.5497630332
+        "p":0.6323529412,
+        "r":0.6142857143,
+        "f":0.6231884058
       },
       "amod":{
-        "p":0.9259259259,
-        "r":0.625,
-        "f":0.7462686567
+        "p":0.9,
+        "r":0.7297297297,
+        "f":0.8059701493
       },
       "cop":{
-        "p":0.9653179191,
-        "r":0.9175824176,
-        "f":0.9408450704
+        "p":0.9585798817,
+        "r":0.9418604651,
+        "f":0.9501466276
       },
       "ccomp":{
-        "p":0.95,
-        "r":0.8636363636,
-        "f":0.9047619048
+        "p":1.0,
+        "r":0.7272727273,
+        "f":0.8421052632
+      },
+      "det":{
+        "p":0.9615384615,
+        "r":0.9433962264,
+        "f":0.9523809524
       },
       "csubj":{
-        "p":0.5294117647,
-        "r":0.6923076923,
-        "f":0.6
+        "p":0.6923076923,
+        "r":0.75,
+        "f":0.72
       },
       "dep":{
         "p":0.0,
         "r":0.0,
         "f":0.0
-      },
-      "det":{
-        "p":0.9607843137,
-        "r":0.9607843137,
-        "f":0.9607843137
       }
     },
+    "tag_acc":0.9715755942,
+    "lemma_acc":0.9659109444,
+    "ents_p":0.737704918,
+    "ents_r":0.679245283,
+    "ents_f":0.7072691552,
     "ents_per_type":{
       "DATE":{
-        "p":0.9622641509,
-        "r":0.9444444444,
-        "f":0.953271028
-      },
-      "PERSON":{
-        "p":0.7769784173,
-        "r":0.7769784173,
-        "f":0.7769784173
+        "p":0.9722222222,
+        "r":0.9633027523,
+        "f":0.9677419355
       },
       "ORG":{
-        "p":0.6052631579,
-        "r":0.5267175573,
-        "f":0.5632653061
+        "p":0.6218487395,
+        "r":0.5401459854,
+        "f":0.578125
       },
       "TITLE_AFFIX":{
-        "p":0.84,
-        "r":0.7,
-        "f":0.7636363636
+        "p":0.7727272727,
+        "r":0.5666666667,
+        "f":0.6538461538
+      },
+      "PERSON":{
+        "p":0.7407407407,
+        "r":0.7194244604,
+        "f":0.7299270073
       },
       "GPE":{
-        "p":0.6813186813,
-        "r":0.6595744681,
-        "f":0.6702702703
+        "p":0.6774193548,
+        "r":0.670212766,
+        "f":0.6737967914
       },
       "PRODUCT":{
-        "p":0.4285714286,
-        "r":0.3658536585,
-        "f":0.3947368421
+        "p":0.5806451613,
+        "r":0.4285714286,
+        "f":0.4931506849
       },
       "TIME":{
         "p":0.6666666667,
@@ -262,44 +301,49 @@
         "f":0.8
       },
       "QUANTITY":{
-        "p":0.9242424242,
-        "r":0.9242424242,
-        "f":0.9242424242
+        "p":0.8382352941,
+        "r":0.8636363636,
+        "f":0.8507462687
       },
       "NORP":{
-        "p":0.7777777778,
-        "r":0.65625,
-        "f":0.7118644068
+        "p":0.7407407407,
+        "r":0.625,
+        "f":0.6779661017
       },
       "ORDINAL":{
-        "p":0.6842105263,
-        "r":0.6842105263,
-        "f":0.6842105263
+        "p":0.5357142857,
+        "r":0.6818181818,
+        "f":0.6
       },
       "WORK_OF_ART":{
-        "p":0.8571428571,
+        "p":0.8,
         "r":0.7058823529,
-        "f":0.7741935484
+        "f":0.75
       },
       "FAC":{
-        "p":0.5555555556,
-        "r":0.4054054054,
-        "f":0.46875
-      },
-      "EVENT":{
-        "p":0.8571428571,
-        "r":0.4615384615,
-        "f":0.6
+        "p":0.619047619,
+        "r":0.3513513514,
+        "f":0.4482758621
       },
       "PERCENT":{
         "p":1.0,
         "r":0.2857142857,
         "f":0.4444444444
       },
+      "CARDINAL":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
+      },
+      "EVENT":{
+        "p":0.75,
+        "r":0.6923076923,
+        "f":0.72
+      },
       "LOC":{
-        "p":0.5625,
-        "r":0.9,
-        "f":0.6923076923
+        "p":0.5333333333,
+        "r":0.8,
+        "f":0.64
       },
       "MOVEMENT":{
         "p":0.0,
@@ -307,36 +351,32 @@
         "f":0.0
       },
       "LAW":{
-        "p":0.0,
-        "r":0.0,
-        "f":0.0
+        "p":1.0,
+        "r":0.3333333333,
+        "f":0.5
       },
       "MONEY":{
-        "p":1.0,
+        "p":0.875,
         "r":1.0,
-        "f":1.0
+        "f":0.9333333333
       },
       "LANGUAGE":{
-        "p":1.0,
+        "p":0.8571428571,
         "r":1.0,
-        "f":1.0
-      },
-      "CARDINAL":{
-        "p":0.0,
-        "r":0.0,
-        "f":0.0
+        "f":0.9230769231
       }
-    }
+    },
+    "speed":4621.4641630782
   },
   "sources":[
     {
-      "name":"UD Japanese GSD v2.6",
+      "name":"UD Japanese GSD v2.8",
       "url":"https://github.com/UniversalDependencies/UD_Japanese-GSD",
       "license":"CC BY-SA 4.0",
       "author":"Omura, Mai; Miyao, Yusuke; Kanayama, Hiroshi; Matsuda, Hiroshi; Wakasa, Aya; Yamashita, Kayo; Asahara, Masayuki; Tanaka, Takaaki; Murawaki, Yugo; Matsumoto, Yuji; Mori, Shinsuke; Uematsu, Sumire; McDonald, Ryan; Nivre, Joakim; Zeman, Daniel"
     },
     {
-      "name":"UD Japanese GSD v2.6 NER",
+      "name":"UD Japanese GSD v2.8 NER",
       "url":"https://github.com/megagonlabs/UD_Japanese-GSD",
       "license":"CC BY-SA 4.0",
       "author":"Megagon Labs Tokyo"

morphologizer/cfg

@@ -0,0 +1,46 @@
+{
+  "extend":true,
+  "labels_morph":{
+    "POS=NOUN":"",
+    "POS=ADP":"",
+    "POS=VERB":"",
+    "POS=SCONJ":"",
+    "POS=AUX":"",
+    "POS=PUNCT":"",
+    "POS=PART":"",
+    "POS=DET":"",
+    "POS=NUM":"",
+    "POS=ADV":"",
+    "POS=PRON":"",
+    "POS=ADJ":"",
+    "POS=PROPN":"",
+    "POS=CCONJ":"",
+    "POS=SYM":"",
+    "POS=NOUN|Polarity=Neg":"Polarity=Neg",
+    "POS=AUX|Polarity=Neg":"Polarity=Neg",
+    "POS=INTJ":"",
+    "POS=SCONJ|Polarity=Neg":"Polarity=Neg"
+  },
+  "labels_pos":{
+    "POS=NOUN":92,
+    "POS=ADP":85,
+    "POS=VERB":100,
+    "POS=SCONJ":98,
+    "POS=AUX":87,
+    "POS=PUNCT":97,
+    "POS=PART":94,
+    "POS=DET":90,
+    "POS=NUM":93,
+    "POS=ADV":86,
+    "POS=PRON":95,
+    "POS=ADJ":84,
+    "POS=PROPN":96,
+    "POS=CCONJ":89,
+    "POS=SYM":99,
+    "POS=NOUN|Polarity=Neg":92,
+    "POS=AUX|Polarity=Neg":87,
+    "POS=INTJ":91,
+    "POS=SCONJ|Polarity=Neg":98
+  },
+  "overwrite":true
+}

morphologizer/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3910cf5c3ecff8a4fbb14f474cc856df94c7e5546ad252c9e48158c9a3705a7
+size 7749

ner/moves

@@ -1 +1 @@
-��moves��{"0":{},"1":{"DATE":4112,"ORG":3465,"PERSON":2992,"QUANTITY":2502,"GPE":1927,"PRODUCT":1317,"FAC":1230,"ORDINAL":1095,"WORK_OF_ART":1022,"EVENT":865,"NORP":732,"LOC":557,"MONEY":400,"TITLE_AFFIX":343,"TIME":294,"PERCENT":272,"MOVEMENT":148,"LAW":94,"LANGUAGE":78,"CARDINAL":27,"PET_NAME":19,"PHONE":4},"2":{"DATE":4112,"ORG":3465,"PERSON":2992,"QUANTITY":2502,"GPE":1927,"PRODUCT":1317,"FAC":1230,"ORDINAL":1095,"WORK_OF_ART":1022,"EVENT":865,"NORP":732,"LOC":557,"MONEY":400,"TITLE_AFFIX":343,"TIME":294,"PERCENT":272,"MOVEMENT":148,"LAW":94,"LANGUAGE":78,"CARDINAL":27,"PET_NAME":19,"PHONE":4},"3":{"DATE":4112,"ORG":3465,"PERSON":2992,"QUANTITY":2502,"GPE":1927,"PRODUCT":1317,"FAC":1230,"ORDINAL":1095,"WORK_OF_ART":1022,"EVENT":865,"NORP":732,"LOC":557,"MONEY":400,"TITLE_AFFIX":343,"TIME":294,"PERCENT":272,"MOVEMENT":148,"LAW":94,"LANGUAGE":78,"CARDINAL":27,"PET_NAME":19,"PHONE":4},"4":{"DATE":4112,"ORG":3465,"PERSON":2992,"QUANTITY":2502,"GPE":1927,"PRODUCT":1317,"FAC":1230,"ORDINAL":1095,"WORK_OF_ART":1022,"EVENT":865,"NORP":732,"LOC":557,"MONEY":400,"TITLE_AFFIX":343,"TIME":294,"PERCENT":272,"MOVEMENT":148,"LAW":94,"LANGUAGE":78,"CARDINAL":27,"PET_NAME":19,"PHONE":4,"":1},"5":{"":1}}�cfg��neg_key�
+��moves��{"0":{},"1":{"DATE":4200,"ORG":3487,"PERSON":3042,"QUANTITY":2519,"GPE":1953,"PRODUCT":1328,"FAC":1243,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":734,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4},"2":{"DATE":4200,"ORG":3487,"PERSON":3042,"QUANTITY":2519,"GPE":1953,"PRODUCT":1328,"FAC":1243,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":734,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4},"3":{"DATE":4200,"ORG":3487,"PERSON":3042,"QUANTITY":2519,"GPE":1953,"PRODUCT":1328,"FAC":1243,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":734,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4},"4":{"DATE":4200,"ORG":3487,"PERSON":3042,"QUANTITY":2519,"GPE":1953,"PRODUCT":1328,"FAC":1243,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":734,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4,"":1},"5":{"":1}}�cfg��neg_key�

parser/moves

@@ -1 +1 @@
-��moves�
q{"0":{"":75008},"1":{"":80671},"2":{"compound":20642,"obl":11201,"nmod":11139,"nsubj":6348,"acl":6215,"advcl":6023,"obj":4334,"nummod":3800,"advmod":1393,"punct":1249,"det":813,"cc":695,"amod":366,"ccomp":327,"dislocated":266,"csubj":159,"dep":0},"3":{"case":35563,"aux":18454,"punct":14888,"mark":6577,"fixed":2698,"cop":2198,"compound":248,"dep":0},"4":{"ROOT":6787}}�cfg��neg_key�
+��moves�
~{"0":{"":75051},"1":{"":81581},"2":{"compound":22178,"nmod":11296,"obl":10522,"nsubj":6649,"acl":6185,"advcl":5956,"obj":4364,"nummod":2247,"advmod":1841,"punct":1169,"det":822,"cc":699,"amod":357,"ccomp":335,"dislocated":233,"csubj":139,"dep":0},"3":{"case":35390,"punct":15051,"aux":14506,"fixed":7377,"mark":6390,"cop":2079,"compound":542,"advcl":148,"dep":56},"4":{"ROOT":6810}}�cfg��neg_key�

senter/cfg

@@ -1,3 +1,3 @@
 {
-
+  "overwrite":false
 }

vocab/strings.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:11826e1ac851be0655fd038aba542199014396e08ad6c396ee6b0e70f9f1e0e8
-size 13755465
+oid sha256:8144aa155796b950df8a0ecdcb2a3d094ef4cdd57a2c4afb1df0be95d1aa7f7d
+size 15570329

vocab/vectors.cfg

@@ -0,0 +1,3 @@
+{
+  "mode":"default"
+}