Early experiments on automatic annotation of Portuguese medieval texts

Bico, Maria Inês; Baptista, Jorge; Batista, Fernando; Cardeira, Esperança

http://hdl.handle.net/10400.1/18903

Utilize este identificador para referenciar este registo.

Nome:	Descrição:	Tamanho:	Formato:
Lemmatization_and_POS_of_PT_Medieval_Texts.pdf		349.21 KB	Adobe PDF	Ver/Abrir

Contacte-nos

Autores

Resumo(s)

This paper presents the challenges and solutions adopted to the lemmatization and part-of-speech (PoS) tagging of a corpus of Old Portuguese texts (up to 1525), to pave the way to the implementation of an automatic annotation of these Medieval texts. A highly granular tagset, previously devised for Modern Portuguese, was adapted to this end. A large text (similar to 155 thousand words) was manually annotated for PoS and lemmata and used to train an initial PoS-tagger model. When applied to two other texts, the resulting model attained 91.2% precision with a textual variant of the same text, and 67.4% with a new, unseen text. A second model was then trained with the data provided by the previous three texts and applied to two other unseen texts. The new model achieved a precision of 77.3% and 82.4%, respectively.