Please use this identifier to cite or link to this item:
http://hdl.handle.net/20.500.12188/30399
Title: | Validation of language agnostic models for discourse marker detection | Authors: | Damova, Mariana Mishev, Kostadin Valunaite Oleskeviciene, Giedre Liebeskind, Chaya da Purificação Silvano, Maria Trajanov, Dimitar Truica, Ciprian-Octavian Apostol, Elena-Simona Chiarcos, Christian Baczkowska, Anna |
Issue Date: | 2023 | Journal: | Language, Data and Knowledge 2023 (LDK 2023): Proceedings of the 4th Conference on Language, Data and Knowledge | Abstract: | Using language models to detect or predict the presence of language phenomena in the text has become a mainstream research topic. With the rise of generative models, experiments using deep learning and transformer models trigger intense interest. Aspects like precision of predictions, portability to other languages or phenomena, scale have been central to the research community. Discourse markers, as language phenomena, perform important functions, such as signposting, signalling, and rephrasing, by facilitating discourse organization. Our paper is about discourse markers detection, a complex task as it pertains to a language phenomenon manifested by expressions that can occur as content words in some contexts and as discourse markers in others. We have adopted language agnostic model trained in English to predict the discourse marker presence in texts in 8 other unseen by the model languages with the goal to evaluate how well the model performs in different structure and lexical properties languages. We report on the process of evaluation and validation of the model's performance across European Portuguese, Hebrew, German, Polish, Romanian, Bulgarian, Macedonian, and Lithuanian and about the results of this validation. This research is a key step towards multilingual language processing. | URI: | http://hdl.handle.net/20.500.12188/30399 |
Appears in Collections: | Faculty of Computer Science and Engineering: Journal Articles |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
649361.pdf | 231.86 kB | Adobe PDF | View/Open |
Page view(s)
19
checked on Sep 22, 2024
Download(s)
3
checked on Sep 22, 2024
Google ScholarTM
Check
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.