A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models

Nakano, Mikio; Takeuchi, Hironori; Komatani, Kazunori

A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models

Nakano, Mikio; Takeuchi, Hironori; Komatani, Kazunori

2025

Number of Access:347（2025-12-03 19:35 Counts）

Identifier to cite or link to this item: https://hdl.handle.net/11094/100876

Link to primary information

File	Format	Terms of use	Size	Views	Date.Available	Description	information
IWSDS_2025_Evaluation-camera-reday-v5	pdf	None	532 KB	73	2025.04.09

Creative Commons : Attribution

Item Information

Output File Export EndNote Basic Export Mendeley

Title	A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models
Creator	CreatorName Nakano, Mikio
	NRID 1000080824119 1000080824119 CreatorName Takeuchi, Hironori
	NRID 1000040362579 1000040362579 ORCID 0000-0002-6052-600X 0000-0002-6052-600X researchmap permalink komatani komatani Scopus Author ID 35577813100 35577813100 CreatorName Komatani, Kazunori
Description	Mikio Nakano, Hironori Takeuchi, Kazunori Komatani: A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models. International Workshop on Spoken Dialogue Systems (IWSDS), 2025.
Abstract	This paper proposes a methodology for identifying evaluation items for practical dialogue systems. Traditionally, user satisfaction and user experiences have been the primary metrics for evaluating dialogue systems. However, there are various other evaluation items to consider when developing and operating practical dialogue systems, and such evaluation items are expected to lead to new research topics. So far, there has been no methodology for identifying these evaluation items. We propose identifying evaluation items based on business-dialogue system alignment models, which are applications of business-IT alignment models used in the development and operation of practical IT systems. We also present a generic model that facilitates the construction of a businessdialogue system alignment model for each dialogue system.
Conference Information	Conference Name International Workshop on Spoken Dialogue Systems Technology (IWSDS) Conference Sequence 15 Conference Date May 27th to 30th, 2025 Conference Venue Bizkaia Aretoa UPV/EHU, University of the Basque Country Conference Place BilBao Conference Country Spain
Publisher	International Workshop on Spoken Dialogue Systems
Date of Issued	2025
Language	English
Handle URL	https://hdl.handle.net/11094/100876
Access Rights	open access
CopyRight	This article is licensed under a Creative Commons Attribution 4.0 International License.
oaire:version	Accepted Manuscript
Category	会議発表論文 Conference Paper

Resource Type	conference paper
Local Type	Conference Paper
DC.title	A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models
DC.creator	Nakano, Mikio
	Takeuchi, Hironori
	Komatani, Kazunori
DC.publisher	International Workshop on Spoken Dialogue Systems
DC.language' scheme='DCTERMS.RFC1766	English
DCTERMS.issued' scheme='DCTERMS.W3CDTF	2025
DC.description	Mikio Nakano, Hironori Takeuchi, Kazunori Komatani: A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models. International Workshop on Spoken Dialogue Systems (IWSDS), 2025.
DCTERMS.abstract	This paper proposes a methodology for identifying evaluation items for practical dialogue systems. Traditionally, user satisfaction and user experiences have been the primary metrics for evaluating dialogue systems. However, there are various other evaluation items to consider when developing and operating practical dialogue systems, and such evaluation items are expected to lead to new research topics. So far, there has been no methodology for identifying these evaluation items. We propose identifying evaluation items based on business-dialogue system alignment models, which are applications of business-IT alignment models used in the development and operation of practical IT systems. We also present a generic model that facilitates the construction of a businessdialogue system alignment model for each dialogue system.
DC.rights	This article is licensed under a Creative Commons Attribution 4.0 International License.
DC.format	100876
citation_title	A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models
citation_author	Nakano, Mikio
	Takeuchi, Hironori
	Komatani, Kazunori
citation_publisher	International Workshop on Spoken Dialogue Systems
citation_language	English
citation_date	2025
citation_public_url	https://hdl.handle.net/11094/100876

A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models

Link to primary information

Item Information

Show details