WEKO3
アイテム
EVALUATION METHOD OF NON-TASK-ORIENTED DIALOGUE SYSTEM BY HMM
http://hdl.handle.net/2237/10479
http://hdl.handle.net/2237/10479426e38fc-4fd3-4286-b44d-548286c10c70
名前 / ファイル | ライセンス | アクション |
---|---|---|
p149-152_Evaluation_method_of_non-task-oriented_dialogue.pdf (16.9 MB)
|
|
Item type | 会議発表論文 / Conference Paper(1) | |||||
---|---|---|---|---|---|---|
公開日 | 2008-08-28 | |||||
タイトル | ||||||
タイトル | EVALUATION METHOD OF NON-TASK-ORIENTED DIALOGUE SYSTEM BY HMM | |||||
言語 | en | |||||
著者 |
ISOMURA, Naoki
× ISOMURA, Naoki× TORIUMI, Fujio× ISHII, Kenichiro |
|||||
アクセス権 | ||||||
アクセス権 | open access | |||||
アクセス権URI | http://purl.org/coar/access_right/c_abf2 | |||||
抄録 | ||||||
内容記述 | Recently, computerized dialogue systems have been actively investigated and used in various fields. In order to realize a practical system, the performance of the system should be evaluated quantitatively. An objective and quantitative evaluation method for task-oriented dialogue systems, such as reservation services, has already been established; however, non-task-oriented dialogue systems have been evaluated only by subjective methods like questionnaires. In this paper, we propose a new criterion that can evaluate non-task-oriented dialogue systems objectively and quantitatively. We assume that a human-human dialogue is an ideal dialogue. We design an HMM (Hidden Markov Model) by learning a sequence of human-human dialogue utterance tags that are automatically assigned. We apply n-gram for auto-tagging and evaluate the humanness of dialogues using HMM. In this simulation, the rate of correct auto-tagging is 54%. If we consider partly correct tags as completely correct tags, the correct rate becomes 82%. Furthermore, it was clarified that the proposed method based on HMM can evaluate the humanness of a dialogue. | |||||
言語 | en | |||||
内容記述タイプ | Abstract | |||||
出版者 | ||||||
言語 | en | |||||
出版者 | INTELLIGENT MEDIA INTEGRATION NAGOYA UNIVERSITY / COE | |||||
言語 | ||||||
言語 | eng | |||||
資源タイプ | ||||||
資源 | http://purl.org/coar/resource_type/c_5794 | |||||
タイプ | conference paper | |||||
書誌情報 |
en : 4th Symposium on "Intelligent Media Integration for Social Information Infrastructure" December 7-8, 2006 p. 149-152, 発行日 2006-12 |
|||||
フォーマット | ||||||
application/pdf | ||||||
著者版フラグ | ||||||
値 | publisher | |||||
URI | ||||||
識別子 | http://hdl.handle.net/2237/10479 | |||||
識別子タイプ | HDL |