uu.seUppsala University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A Graphical Pronoun Analysis Tool for the PROTEST Pronoun Evaluation Test Suite
Uppsala University, Disciplinary Domain of Humanities and Social Sciences, Faculty of Languages, Department of Linguistics and Philology.
Univ Munich, Marchioninistr 15, D-81377 Munich, Germany..
2016 (English)In: Baltic Journal of Modern Computing, ISSN 2255-8942, E-ISSN 2255-8950, Vol. 4, no 2, 318-330 p.Article in journal (Refereed) Published
Resource type
Text
Abstract [en]

We present a graphical pronoun analysis tool and a set of guidelines for manual evaluation to be used with the PROTEST pronoun test suite for machine translation (MT). The tool provides a means for researchers to evaluate the performance of their MT systems and browse individual pronoun translations. MT systems may be evaluated automatically by comparing the translation of the test suite pronoun tokens in the MT output with those in the reference translation. Those translations that do not match the reference are referred for manual evaluation, which is supported by the graphical pronoun analysis tool and its accompanying annotation guidelines. By encouraging the manual examination and evaluation of individual pronoun tokens, we hope to understand better how well MT systems perform when translating different categories of pronouns, and gain insights as to where MT systems perform poorly and why.

Place, publisher, year, edition, pages
2016. Vol. 4, no 2, 318-330 p.
Keyword [en]
Evaluation, machine translation, pronouns, graphical interface, manual annotation
National Category
Language Technology (Computational Linguistics)
Identifiers
URN: urn:nbn:se:uu:diva-299621ISI: 000377706600020OAI: oai:DiVA.org:uu-299621DiVA: diva2:949834
Available from: 2016-07-25 Created: 2016-07-25 Last updated: 2016-07-25Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Hardmeier, Christian
By organisation
Department of Linguistics and Philology
In the same journal
Baltic Journal of Modern Computing
Language Technology (Computational Linguistics)

Search outside of DiVA

GoogleGoogle Scholar

Total: 339 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf