Leaderboard - UD Tagset

Rank Model name Model url Pretrained embeddings Dataset Metric Average Tokens Sentences Words UPOS XPOS UFeats AllTags Lemmas UAS LAS CLAS MLAS BLEX
1 trankit LINK xlm-RoBERTa-base Polish Dependency Treebank AligndAcc 90.83 - - - 96.13 96.93 99.58 95.48 100.00 87.89 84.20 84.26 79.60 84.26
F1 90.19 97.02 99.70 97.02 93.26 94.04 96.61 92.64 97.02 85.27 81.69 80.91 76.43 80.91
2 KoichiYasuoka/deberta-base-chinese-erlangshen-ud-goeswith LINK IDEA-CCNL/Erlangshen-DeBERTa-v2-97M-Chinese Polish Dependency Treebank AligndAcc 89.90 - - - 97.07 - 99.57 - 99.80 88.01 85.18 84.52 80.74 84.28
F1 90.37 97.50 100.00 97.50 94.64 - 97.08 - 97.30 85.81 83.05 81.70 78.04 81.47
3 stanza LINK fasttext Polish Dependency Treebank AligndAcc 85.76 - - - 95.98 95.71 99.14 94.85 100.00 78.72 75.21 74.09 69.80 74.09
F1 83.37 94.00 94.30 94.00 90.23 89.97 93.20 89.16 94.00 74.00 70.70 68.07 64.13 68.07
4 combo LINK bert-base Polish Dependency Treebank AligndAcc 86.21 - - - 96.79 96.58 99.43 95.88 99.21 78.27 75.51 75.22 70.96 74.27
F1 76.92 85.99 97.60 85.99 83.23 83.04 85.50 82.45 85.31 67.30 64.93 60.96 57.51 60.19
5 combo LINK fasttext Polish Dependency Treebank AligndAcc 82.50 - - - 95.10 94.97 99.00 93.80 99.18 72.75 69.43 68.94 63.83 68.04
F1 74.56 85.99 97.60 85.99 81.77 81.67 85.13 80.66 85.28 62.56 59.70 55.96 51.81 55.22
6 udpipe LINK fasttext Polish Dependency Treebank AligndAcc 79.02 - - - 93.38 93.22 98.56 91.83 99.99 67.31 63.25 62.29 58.15 62.27
F1 74.87 88.99 99.10 88.99 83.11 82.96 87.71 81.72 88.98 59.90 56.29 53.04 49.52 53.03
7 stanza_tokenize_lemmatize LINK fasttext Polish Dependency Treebank AligndAcc 66.75 - - - - - 88.64 - 100.00 11.63 - - - -
F1 78.43 94.00 94.30 94.00 - - 83.32 - 94.00 10.93 - - - -

Legend:

  • Prediction is done on plain text file.