uu.seUppsala University Publications
Change search
ReferencesLink to record
Permanent link

Direct link
A Graphical Pronoun Analysis Tool for the PROTEST Pronoun Evaluation Test Suite
Uppsala University, Disciplinary Domain of Humanities and Social Sciences, Faculty of Languages, Department of Linguistics and Philology.
Univ Munich, Marchioninistr 15, D-81377 Munich, Germany..
2016 (English)In: Baltic Journal of Modern Computing, ISSN 2255-8942, E-ISSN 2255-8950, Vol. 4, no 2, 318-330 p.Article in journal (Refereed) PublishedText
Abstract [en]

We present a graphical pronoun analysis tool and a set of guidelines for manual evaluation to be used with the PROTEST pronoun test suite for machine translation (MT). The tool provides a means for researchers to evaluate the performance of their MT systems and browse individual pronoun translations. MT systems may be evaluated automatically by comparing the translation of the test suite pronoun tokens in the MT output with those in the reference translation. Those translations that do not match the reference are referred for manual evaluation, which is supported by the graphical pronoun analysis tool and its accompanying annotation guidelines. By encouraging the manual examination and evaluation of individual pronoun tokens, we hope to understand better how well MT systems perform when translating different categories of pronouns, and gain insights as to where MT systems perform poorly and why.

Place, publisher, year, edition, pages
2016. Vol. 4, no 2, 318-330 p.
Keyword [en]
Evaluation, machine translation, pronouns, graphical interface, manual annotation
National Category
Language Technology (Computational Linguistics)
URN: urn:nbn:se:uu:diva-299621ISI: 000377706600020OAI: oai:DiVA.org:uu-299621DiVA: diva2:949834
Available from: 2016-07-25 Created: 2016-07-25 Last updated: 2016-07-25Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Hardmeier, Christian
By organisation
Department of Linguistics and Philology
In the same journal
Baltic Journal of Modern Computing
Language Technology (Computational Linguistics)

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 35 hits
ReferencesLink to record
Permanent link

Direct link