uu.seUppsala University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Manual Evaluation of a Conversational Agent System
Uppsala University, Disciplinary Domain of Humanities and Social Sciences, Faculty of Languages, Department of Linguistics and Philology.
2019 (English)Independent thesis Basic level (degree of Bachelor), 180 HE creditsStudent thesis
Abstract [en]

There are many ways to evaluate a conversational agent system or a chatbot as it is often called. This thesis presents a customized method for creating an evaluation framework to evaluate a specific conversational agent. The framework consists of a manual evaluation using customized classification tags and an analysis of the results from the classification. We showed that it is possible to create an evaluation framework for the agent which to some extent shows the capabilities of the system. We also showed that itis possible to improve the system based on the results from the manual evaluation.

Place, publisher, year, edition, pages
2019. , p. 25
Keywords [en]
Linguistics, Language Technology, Chatbot, Conversational Agent
National Category
Language Technology (Computational Linguistics)
Identifiers
URN: urn:nbn:se:uu:diva-386591OAI: oai:DiVA.org:uu-386591DiVA, id: diva2:1328035
External cooperation
Voice Provider Sweden AB
Subject / course
Language Technology
Educational program
Bachelor Programme in Language Technology
Supervisors
Examiners
Available from: 2019-06-24 Created: 2019-06-20 Last updated: 2019-06-24Bibliographically approved

Open Access in DiVA

No full text in DiVA

By organisation
Department of Linguistics and Philology
Language Technology (Computational Linguistics)

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 89 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf