Automated entry of paper-based patient-reported outcomes: Applying deep learning to the Japanese orthopaedic association back pain evaluation questionnaire

Kita, Kosuke; Fujimori, Takahito; Suzuki, Yuki; Kaito, Takashi; Takenaka, Shota; Kanie, Yuya; Furuya, Masayuki; Wataya, Tomohiro; Nishigaki, Daiki; Sato, Junya; Tomiyama, Noriyuki; Okada, Seiji; Kido, Shoji

doi:https://doi.org/10.1016/j.compbiomed.2024.108197

Automated entry of paper-based patient-reported outcomes: Applying deep learning to the Japanese orthopaedic association back pain evaluation questionnaire

Kita, Kosuke; Fujimori, Takahito; Suzuki, Yuki et al.

Computers in Biology and Medicine, 2024, 172, 108197

Number of Access:5,178（2025-07-23 20:49 Counts）

Identifier to cite or link to this item: https://hdl.handle.net/11094/95443

Link to primary information

File	Format	Terms of use	Size	Views	Date.Available	Description	information
ComputBiolMed_172_108197	pdf	None	2.54 MB	461	2025.04.01

Creative Commons : Attribution - NonCommercial - NoDerivatives

Item Information

Output File Export EndNote Basic Export Mendeley

Title	Automated entry of paper-based patient-reported outcomes: Applying deep learning to the Japanese orthopaedic association back pain evaluation questionnaire
Creator	CreatorName Kita, Kosuke
	NRID 1000080546888 1000080546888 researchmap permalink fujimori_takahito fujimori_takahito Scopus Author ID 35271904600 35271904600 CreatorName Fujimori, Takahito
	NRID 1000020845599 1000020845599 researchmap permalink ykszk ykszk Scopus Author ID 57204202740 57204202740 CreatorName Suzuki, Yuki
	NRID 1000070623982 1000070623982 ORCID 0000-0003-4882-2997 0000-0003-4882-2997 researchmap permalink 911_0 911_0 Scopus Author ID 25824322100 25824322100 CreatorName Kaito, Takashi
	NRID 1000040795861 1000040795861 CreatorName Takenaka, Shota
	NRID 1000010896377 1000010896377 researchmap permalink ykanie1985 ykanie1985 CreatorName Kanie, Yuya
	NRID 1000020987466 1000020987466 researchmap permalink furuya1019 furuya1019 CreatorName Furuya, Masayuki
	NRID 1000090983023 1000090983023 CreatorName Wataya, Tomohiro
	CreatorName Nishigaki, Daiki
	CreatorName Sato, Junya
	NRID 1000050294070 1000050294070 researchmap permalink 3430 3430 Scopus Author ID 7006024942 7006024942 CreatorName Tomiyama, Noriyuki
	NRID 1000030448435 1000030448435 ORCID 0000-0002-5107-8209 0000-0002-5107-8209 researchmap permalink okadaseiji okadaseiji Scopus Author ID 35079139100 35079139100 CreatorName Okada, Seiji
	NRID 1000090314814 1000090314814 ORCID 0000-0001-5293-4110 0000-0001-5293-4110 researchmap permalink read0196068 read0196068 Scopus Author ID 7004389358 7004389358 CreatorName Kido, Shoji
Subject	Artificial intelligence
	Back pain
	Convolutional neural network
	Deep learning
	HR-PRO
	JOABPEQ
	Questionnaire
Description	Kita K., Fujimori T., Suzuki Y., et al. Automated entry of paper-based patient-reported outcomes: Applying deep learning to the Japanese orthopaedic association back pain evaluation questionnaire. Computers in Biology and Medicine 172, 108197 (2024); https://doi.org/10.1016/j.compbiomed.2024.108197.
Abstract	Background: Health-related patient-reported outcomes (HR-PROs) are crucial for assessing the quality of life among individuals experiencing low back pain. However, manual data entry from paper forms, while convenient for patients, imposes a considerable tallying burden on collectors. In this study, we developed a deep learning (DL) model capable of automatically reading these paper forms. Methods: We employed the Japanese Orthopaedic Association Back Pain Evaluation Questionnaire, a globally recognized assessment tool for low back pain. The questionnaire comprised 25 low back pain-related multiple-choice questions and three pain-related visual analog scales (VASs). We collected 1305 forms from an academic medical center as the training set, and 483 forms from a community medical center as the test set. The performance of our DL model for multiple-choice questions was evaluated using accuracy as a categorical classification task. The performance for VASs was evaluated using the correlation coefficient and absolute error as regression tasks. Result: In external validation, the mean accuracy of the categorical questions was 0.997. When outputs for categorical questions with low probability (threshold: 0.9996) were excluded, the accuracy reached 1.000 for the remaining 65 % of questions. Regarding the VASs, the average of the correlation coefficients was 0.989, with the mean absolute error being 0.25. Conclusion: Our DL model demonstrated remarkable accuracy and correlation coefficients when automatic reading paper-based HR-PROs during external validation.
Publisher	Elsevier Ltd
Source Title	Computers in Biology and Medicine
Volume (Issue)	172
Page	108197
Date of Issued	2024-04-01
Language	English
Handle URL	https://hdl.handle.net/11094/95443
PISSN	00104825
eISSN	18790534
Relation.isVersionOf	DOI (Publisher Version) https://doi.org/10.1016/j.compbiomed.2024.108197
Access Rights	open access
CopyRight	© 2024. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/
oaire:version	Accepted Manuscript
Category	学術雑誌論文 Journal Article

Resource Type	journal article
Local Type	Journal Article
DCMI Type	Text
DCTERMS.bibliographicCitation	Computers in Biology and Medicine. 2024, 172, p. 108197
DC.title	Automated entry of paper-based patient-reported outcomes: Applying deep learning to the Japanese orthopaedic association back pain evaluation questionnaire
DC.creator	Kita, Kosuke
	Fujimori, Takahito
	Suzuki, Yuki
	Kaito, Takashi
	Takenaka, Shota
	Kanie, Yuya
	Furuya, Masayuki
	Wataya, Tomohiro
	Nishigaki, Daiki
	Sato, Junya
	Tomiyama, Noriyuki
	Okada, Seiji
	Kido, Shoji
DC.publisher	Elsevier Ltd
DC.language' scheme='DCTERMS.RFC1766	English
DC.type' scheme='DCTERMS.DCMIType	Text
DCTERMS.issued' scheme='DCTERMS.W3CDTF	2024-04-01
DC.identifier	https://doi.org/10.1016/j.compbiomed.2024.108197
DC.subject	Artificial intelligence
	Back pain
	Convolutional neural network
	Deep learning
	HR-PRO
	JOABPEQ
	Questionnaire
DC.description	Kita K., Fujimori T., Suzuki Y., et al. Automated entry of paper-based patient-reported outcomes: Applying deep learning to the Japanese orthopaedic association back pain evaluation questionnaire. Computers in Biology and Medicine 172, 108197 (2024); https://doi.org/10.1016/j.compbiomed.2024.108197.
DCTERMS.abstract	Background: Health-related patient-reported outcomes (HR-PROs) are crucial for assessing the quality of life among individuals experiencing low back pain. However, manual data entry from paper forms, while convenient for patients, imposes a considerable tallying burden on collectors. In this study, we developed a deep learning (DL) model capable of automatically reading these paper forms. Methods: We employed the Japanese Orthopaedic Association Back Pain Evaluation Questionnaire, a globally recognized assessment tool for low back pain. The questionnaire comprised 25 low back pain-related multiple-choice questions and three pain-related visual analog scales (VASs). We collected 1305 forms from an academic medical center as the training set, and 483 forms from a community medical center as the test set. The performance of our DL model for multiple-choice questions was evaluated using accuracy as a categorical classification task. The performance for VASs was evaluated using the correlation coefficient and absolute error as regression tasks. Result: In external validation, the mean accuracy of the categorical questions was 0.997. When outputs for categorical questions with low probability (threshold: 0.9996) were excluded, the accuracy reached 1.000 for the remaining 65 % of questions. Regarding the VASs, the average of the correlation coefficients was 0.989, with the mean absolute error being 0.25. Conclusion: Our DL model demonstrated remarkable accuracy and correlation coefficients when automatic reading paper-based HR-PROs during external validation.
DC.rights	© 2024. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/
DC.format	95443
citation_title	Automated entry of paper-based patient-reported outcomes: Applying deep learning to the Japanese orthopaedic association back pain evaluation questionnaire
citation_author	Kita, Kosuke
	Fujimori, Takahito
	Suzuki, Yuki
	Kaito, Takashi
	Takenaka, Shota
	Kanie, Yuya
	Furuya, Masayuki
	Wataya, Tomohiro
	Nishigaki, Daiki
	Sato, Junya
	Tomiyama, Noriyuki
	Okada, Seiji
	Kido, Shoji
citation_publisher	Elsevier Ltd
citation_language	English
citation_date	2024-04-01
citation_journal_title	Computers in Biology and Medicine
citation_volume	172
citation_firstpage	108197
citation_doi	https://doi.org/10.1016/j.compbiomed.2024.108197
citation_public_url	https://hdl.handle.net/11094/95443

Automated entry of paper-based patient-reported outcomes: Applying deep learning to the Japanese orthopaedic association back pain evaluation questionnaire

Link to primary information

Item Information

Show details