Spaces:
Sleeping
Sleeping
| // Djam�: version record added for history's sake. | |
| // note to future updater: please add your changelog below | |
| (copied from http://nlp.cs.nyu.edu/evalb/ ) | |
| EVALB20080701.tgz (July 1, 2008 version) modified by Don Blaheta (Knox College) | |
| EVALB20060307.tgz (March 3, 2006 version; debuged of Jan. 17, 2006 version) modified by David Ellis (Brown University) | |
| EVALB20060117.tgz (Jan. 17, 2006 version) modified by David Ellis (Brown University) | |
| EVALB20050908.tgz (Sept. 8, 2005 version) modified by David Brroks (Birmingham) | |
| EVALB.tgz (original version). | |
| Authors | |
| Satoshi Sekine (New York University) : e-mail: his last name (at) cs.nyu.edu | |
| Michael John Collins (University of Pennsylvania) | |
| Note: the authors are not responsible for the newer versions. We put these versions even without checking the program. Please be responsible for yourself. | |
| ************************************************************************* | |
| Modification | |
| David Brroks (Birmingham): fixed the code so that the program can be compiled by the latest gcc (September 2005). Helps are given by Peet Morris and Ramon Ziai through the Corpora Mailing list. | |
| David Ellis (Brown University) : fixes a bug in which sentences were incorrectly categorized as "length mismatch" when the the parse output had certain mislabeled parts-of-speech. | |
| Don Blaheta (KNOX) : fixes a bug on the output of last number of the total information was not TOTAL_crossing, but it was TOTAL_non_crossing. | |
| April 2012 | |
| // Modified by Slav Petrov and Ryanc Mc Donald (Google inc., for the sancl 2012 shared task) | |
| // ===> making it less sensitive to punct POS errors leading to | |
| // mismatch of length | |
| August 2013, 10 | |
| // Modified by Djam� Seddah (Univ. Paris Sorbonne, for the spmrl 2013 shared task) | |
| // ===> making it able to cope with Arabic very long lines (byte wise) | |
| // ===> now limit is 50000 bytes, was 5000 (tricky bug, if you ask me) | |
| // please check the constant macro section if you encounter weird bugs not present in other | |
| implementations (check evalC by Federico Sangatti for example, http://homepages.inf.ed.ac.uk/fsangati/evalC_25_5_10.zip ) | |
| August 2013, 23 | |
| // Modif from Thomas M�ller (IMS Stuttgart) | |
| // ===> adding of # in the stop word modify_label function (so that the | |
| // lexer will read NPP instead of NPP##feat:...### as in hte SPMRL Data set | |
| // Modif from Djam� Seddah | |
| // ===> Application of modify_label to all labels (including the POS label | |
| // wich were left untouched for some reasons) | |
| // That should btw be an option. (wether to evaluate full labels or not, | |
| // only stripping of Non Terminal, POS tag and so on) | |
| August 2013, 27 | |
| // Modif from Djam� | |
| // --> adding of an option to include the non parsed sentences in the | |
| // --> evaluation (-X option) | |
| // --> adding an option to evaluate only the first N sentences (-K n) | |
| // --> adding an option to provide a compact results view (-L) so one can do | |
| // --> find ./ -name "*parsed.run?" -exec evalb_spmrl -L GOLD {} \; -print | | |
| // --> grep -v '=====' | grep '=' | |
| September 2013, 6 | |
| // Modif from DJame | |
| // fixing the infinite slowness bug (shame on me) | |
| // now speed is similar to what it was before | |
| October 2013, 13 | |
| // Addition from Djame | |
| // Adding the spmrl_hebrew.prm if one wants to evaluate hebrew parsing within the | |
| // same conditions as the state-of-the-art | |
| // namely without counting the additional SYNpos layer which inflates evalb | |
| // scores by almost 2 points. | |
| // Note: for the spmrl shared task, we used the spmrl.prm file (so with | |
| // these labels. It was too late to modify the rules once again when we | |
| // realized this) | |