Evaluating Dialogue Systems from the System Owners’Perspectives

Nakano, Mikio; Mukai, Hisahiro; Matsuyama, Yoichi et al.

2024

アクセス数:83件（2025-03-14 23:01 集計）

固定URL: https://hdl.handle.net/11094/95314

閲覧可能ファイル 

ファイル フォーマット 利用条件 サイズ 閲覧回数 利用開始日 説明 information
nakano-IWSDS24_Evaluation-camera-ready-final pdf なし 47.3 KB 90 2024.04.23  

論文情報

ファイル出力 EndNote Basic出力 Mendeley出力

タイトル
Evaluating Dialogue Systems from the System Owners’Perspectives
著者
著者名
Nakano, Mikio
著者名
Mukai, Hisahiro
著者名
Matsuyama, Yoichi
NRID
1000040362579 1000040362579
ORCID
0000-0002-6052-600X 0000-0002-6052-600X
researchmap permalink
komatani komatani
Scopus Author ID
35577813100 35577813100
著者名
Komatani, Kazunori
抄録
This position paper proposes to evaluate dialogue systems from the perspectives of the system owners, who decide funding the system development and operation, unlike evaluating based only on the users’ satisfaction and experiences asusually done in academic research.We suspect this difference causes a gap between conducting academic research and providing services using dialogue systems. This paper presents an initial list of evaluation criteria from the system owners’ perspectives. They consist of three groups, namely the system owners’ benefits, costs, and risks. This paper also indicates some of them have been overlooked in academic research, and that considering them will lead to novel research topics.
会議情報
会議名
International Workshop on Spoken Dialogue Systems Technology (IWSDS 2024)
回次
14
開催期間
March 4th to March 6th, 2024
開催会場
Premiere Hotel Nakajima Park Sapporo
開催地
Sapporo
開催国
日本
刊行年月
2024-03-04
言語
英語
ハンドルURL
https://hdl.handle.net/11094/95314
アクセス権
open access
出版タイプ
Author’s Original
カテゴリ
会議発表論文 Conference Paper