1Postgraduate student, Department of Romance and Germanic Languages and Cross-Cultural Communication, Chelyabinsk State University (Chelyabinsk)
rak35@hi.is; raoul.karimov@hotmail.com
Abstract
The paper dwells upon automatic PoS-tagging of Old Norse by computational means, including machine learning. It analyzes the available language material in diachrony from the standpoint of how language evolution might have affected the quality of automatic PoS-tagging. The paper further describes the phonetic traits that have assumingly led to classification errors.
The research material is an Old Norwegian educational text titled Konungs skuggsjá, or King’s Mirror, vectorized by the moving average method and then used to train an Ada-Boosted random forest model. The resulting classification accuracy is about 97%. However, being non-contextual, this vectorization method enables no complete differentiation of morphologically similar parts of speech: verbs, nouns, adjectives, and adverbs. This becomes evident when digging into the identified high-weight classification features, each being a vectoral dimension corresponding to a specific alphabet character; another indicative factor comprises Morfessor-identified high-rank morphs, analyzing which reveals the morphogrammatic units that cause the most classification errors.
Historical consideration of these morphs shows that their collision is due to them being inherited from Proto-Germanic (PG) while undergoing rhotacism, or conversion from PG /z/ to ON /r/. However, the same process effectively prevents the collision of rhotacized finite verbal forms with the genitive case that inherits the PG suffix -s.
The key finding is that such morphological collision being unavoidable, character-based vectorization might not suffice when using a small training set or when trying to classify not only by parts of speech, but also by specific forms in the paradigm.
Keywords
Old Norse, corpus linguistics, phonetics, morphology, parts of speech, annotation, tagging, vector representation.
References
1. Arapov M. A., Hertz, M. M. 1973. “Matematicheskiye metody v istoricheskoy lingvistike” [Mathematical Methods in Historical Linguistics] Moscow, Nauka. 322 p.
2. Nikolayeva N. A. 2003. “Tematizatsiya prezensa silnogo glagola v keltskikh I germanskikh yazykakh [Thematization of the Present Tense of Strong Verbs in Celtic and Germanic Languages]. PhD thesis. Moscow, MSU. 200 p.
3. Bandle O. 2002. The Nordic languages: an international handbook of the history of the North Germanic languages / Edited by O. Bandle, K. Braunmüller, E. H. Jahr, A. Karker, H. P. Naumann, U. Telemann, L. Elmevik, G. Wildmark. Berlin: De Gruyter Mouton.
4. Gade K. E. 1986. "Homosexuality and Rape of Males in Old Norse Law and Literature". Scandinavian Studies, vol. 58, no. 2, pp. 124-141.
5. Hagland J. R. 1978. "A Note on Old Norwegian Vowel Harmony". Nordic Journal of Linguistics, vol. 1, pp. 141-147.
6. Haugen O. E. 1994. Norrøne tekster i utval. Oslo: Ad Notam Gyldendal.
7. Haugen O. E. 1995. Grunnbok i norrønt språk. Oslo: Ad Notam Gyldendal.
8. Jahr E. H., Lorentz O. (eds.). 1993. Historisk språkvitenskap. Oslo: Novus.
9. Karttunen L. "Applications of Finite-State Transducers in Natural Language Processing". Implementation and Application of Automata, 5th International Conference, CIAA 2000, July 24-25, 2000, pp. 34-46.
10. Kytö M. 1996. Manual to the Diachronic Part of the Helsinki Corpus of English Texts. Helsinki: University of Helsinki.
11. Loftsson H., Kramarczyk I., Helgadóttir S., Rögnvaldsson E. I. 2009. "Improving the PoS tagging accuracy of Icelandic text". Proceedings of the 17th Nordic Conference of Computational Linguistics (NODALIDA 2009). Odense, Denmark: Northern European Association for Language Technology (NEALT), pp. 103-110.
12. Medieval Nordic Text Archive. URL: https://www.clarino.uib.no/menota (as of 11.05.2019).
13. Silva A. P., Silva A., Rodrigues I. 2015. "An Approach to the POS Tagging Problem Using Genetic Algorithms". Computational Intelligence. Berlin: Springer, 2015, pp. 3-17.
14. Smit P., Virpioja S., Grönroos S.A., Kurimo M. 2014. "Morfessor 2.0: Toolkit for statistical morphological segmentation". Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, pp. 21-24.
15. Spurkland T. 1989. Innføring i norrønt språk. Oslo: Universitetsforlaget.
16. Stroh-Wollin U. 2016. "The emergence of definiteness marking in Scandinavian — new answers to old questions". Arkiv för nordisk filologi. 2016, no. 131, pp. 129-169.
17. Takala P. 2016. "Word Embeddings for Morphologically Rich Languages. European Symposium on Artificial Neural Networks". Bruges, April 27-29, pр. 177-182.
18. Tharwat A. 2018. AdaBoost classifier: an overview. Frankfurt: Frankfurt University of Applied Sciences.
19. Vrieland S. D. 2004. Old English and Old Norse. An Introduction to West and North Germanic. Copenhagen: University of Copenhagen.
20. Witten H. I. 2011. Data Mining: Practical Machine Learning Tools and Techniques. Burlington, Massachusets: Morgan Kaufmann Publishers Inc.
Cтатья публикуется впервые подпись автора / Каримов Рауль Дамирович