Ensemble lemmatization with the Classical Language Toolkit

Patrick J Burns

Abstract


Because of the less-resourced nature of historical languages, non-standard solutions are often required for natural language processing tasks. This article introduces one such solution for historical-language lemmatization, that is the Ensemble lemmatizer for the Classical Language Toolkit, an open-source Python package that supports NLP research for historical languages. Ensemble lemmatization is the most recent development at CLTK in the repurposing and refactoring of an existing method designed for one task, specifically the backoff method as used for part-of-speech tagging, for use in a different task, namely lemmatization. This article argues for the benefits of ensemble lemmatization, specifically, flexible tool construction and the use of all available information to reach tagging decisions, and presents two use cases.

Parole chiave


lemmatization; natural language processing; Latin; Classical Language Toolkit

Full Text

PDF (English)


DOI: https://doi.org/10.4454/ssl.v58i1.273

Refback

  • Non ci sono refbacks, per ora.


Copyright (c) 2020 Studi e Saggi Linguistici

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
eISSN 2281-9142 - ISSN 0085-6827 - Webmaster - Publisher