Development and evaluation of acceptance scale for artificial intelligence in digestive endoscopy by subjects

Zhong Nan Da Xue Xue Bao Yi Xue Ban. 2023 Dec 28;48(12):1844-1853. doi: 10.11817/j.issn.1672-7347.2023.230225.
[Article in English, Chinese]

Abstract

Objectives: Digestive endoscopy is an important diagnostic and therapeutic tool for digestive system diseases. The artificial intelligence (AI)-assisted system in endoscopy (hereinafter referred to as AI in digestive endoscopy) has broad application prospects in the field of digestive endoscopy. The trust and acceptance of endoscopic subjects are the cornerstone of the research, application, and promotion of AI in digestive endoscopy. Currently, the tools for measuring the acceptance of AI in digestive endoscopy by subjects are limited at home and abroad. This study aims to develop a scale for measuring the acceptance of AI in digestive endoscopy by subjects, then to evaluate its reliability and validity.

Methods: By conducting literature research, an item pool and dimensions were constructed, and a preliminary scale was constructed using Delphi method. Through the first stage of the survey on the subjects, the reliability and validity of the scale were tested, and the revised scale was used for the second stage of survey on the subjects to further verify the structural validity of the scale.

Results: The acceptance scale for AI in digestive endoscopy included 11 items in 3 dimensions: accuracy, ethics, benefit and willingness. In the first stage of the survey, 351 valid questionnaires were collected, and the Cronbach's α was 0.864. The correlation coefficient between the total score of the scale and the score of the test item was 0.636, and the Kaiser-Meyer-Olkin (KMO) value in exploratory factor analysis was 0.788. In the second stage of the survey, 335 valid questionnaires were collected, and in confirmatory factor analysis, the χ2/df was 3.774, while the root mean squared error of approximation (RMSEA) was 0.091.

Conclusions: Acceptance scale for AI in digestive endoscopy by subjects developed in this study has good reliability and validity.

目的: 消化内镜是消化系统疾病的重要诊治手段,消化内镜人工智能(artificial intelligence,AI)辅助系统(以下简称“消化内镜AI”)在消化内镜领域中具有广泛的应用前景。内镜受检者的信任和接受是消化内镜AI研发、应用、推广的基石,目前国内外缺乏受检者对消化内镜AI接受度的衡量工具。本研究旨在编制受检者对消化内镜AI接受度量表,并评估其信效度。方法: 通过文献调查构建条目池和维度,运用Delphi法构建初版量表。对受检者进行第1阶段的问卷调查,根据数据对量表进行信效度检验;利用修改后的量表对受检者进行第2阶段调查,进一步验证量表的结构效度。结果: 受检者对消化内镜AI接受度量表包含准确性、伦理、获益与意愿3个维度11个条目。第1阶段调查收回有效问卷351份,总克龙巴赫α系数为0.864;量表总分与验证条目得分的相关系数为0.636,结构效度中KMO(Kaiser-Meyer-Olkin)值为0.788。第2阶段调查收回有效问卷335份,结构效度中χ2/df为3.774,近似均方根误差(root mean squared error of approximation,RMSEA)为0.091。结论: 本研究编制的受检者对消化内镜AI接受度量表具有良好的信效度。.

Keywords: acceptance; artificial intelligence in digestive endoscopy; scale.

MeSH terms

  • Artificial Intelligence*
  • Endoscopy, Gastrointestinal*
  • Factor Analysis, Statistical
  • Humans
  • Reproducibility of Results