会議発表論文

会議発表論文

A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models

International Workshop on Spoken Dialogue Systems

英語

2025

Mikio Nakano, Hironori Takeuchi, Kazunori Komatani: A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models. International Workshop on Spoken Dialogue Systems (IWSDS), 2025.

This paper proposes a methodology for identifying evaluation items for practical dialogue systems. Traditionally, user satisfaction and user experiences have been the primary metrics for evaluating dialogue systems. However, there are various other evaluation items to consider when developing and operating practical dialogue systems, and such evaluation items are expected to lead to new research topics. So far, there has been no methodology for identifying these evaluation items. We propose identifying evaluation items based on business-dialogue system alignment models, which are applications of business-IT alignment models used in the development and operation of practical IT systems. We also present a generic model that facilitates the construction of a businessdialogue system alignment model for each dialogue system.

This article is licensed under a Creative Commons Attribution 4.0 International License.

100876

A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models

International Workshop on Spoken Dialogue Systems

英語

2025

https://hdl.handle.net/11094/100876