Copyright
©The Author(s) 2025.
World J Gastrointest Oncol. Oct 15, 2025; 17(10): 109792
Published online Oct 15, 2025. doi: 10.4251/wjgo.v17.i10.109792
Published online Oct 15, 2025. doi: 10.4251/wjgo.v17.i10.109792
Table 1 Questions posed to chat generative pretrained transformer
| No. | Question |
| 1 | What is the anatomy of the gastrointestinal tract? |
| 2 | What are the surgical indications/indications for ESD/EMR? |
| 3 | What is the specific surgical process for ESD/EMR? |
| 4 | What are the contraindications for ESD/EMR? |
| 5 | What should patients do before ESD/EMR? |
| 6 | What preoperative measures for ESD/EMR can help reduce surgical risks? |
| 7 | What are the possible problems and solutions that may be encountered during the ESD/EMR process? |
| 8 | Will sedation or anesthesia be used during ESD/EMR, and will the procedure cause pain or discomfort? How long does the procedure usually take? |
| 9 | What cooperation and precautions are required from the patient during an ESD/EMR procedure? |
| 10 | What are the factors influencing the safety and success rate of ESD/EMR procedures? |
| 11 | How is the resected tissue handled after an ESD/EMR procedure? |
| 12 | What is the expected timeframe and method for accessing pathology results after an ESD/EMR procedure? |
| 13 | Which terms in the pathology report after an ESD/EMR procedure should be given special attention? |
| 14 | What are the relevant definition standards and classifications for postoperative complications of ESD/EMR? |
| 15 | What are the common postoperative complications and related treatments of ESD/EMR? |
| 16 | What are the influencing factors of postoperative complications in ESD/EMR? |
| 17 | What are the observation indicators for the therapeutic effect of ESD/EMR? |
| 18 | What postoperative symptoms are considered normal after an ESD/EMR procedure? |
| 19 | Do patients need family accompaniment after an ESD/EMR procedure, and for how long is it recommended? |
| 20 | What are the postoperative care precautions for ESD/EMR? |
| 21 | What are the application and precautions of drugs and food after ESD/EMR surgery? |
| 22 | What are the daily life precautions for postoperative ESD/EMR? |
| 23 | How soon after an ESD/EMR procedure can a patient return to work, engage in physical activity, or take a shower? |
| 24 | What are the follow-up appointments and response methods for postoperative adverse events in ESD/EMR? |
| 25 | What is the likelihood of recurrence after an ESD/EMR procedure, and what are the related influencing factors? |
| 26 | What postoperative signs may indicate incomplete lesion removal or potential recurrence after an ESD/EMR procedure? |
| 27 | If follow-up after ESD/EMR suggests recurrence, what should be done next? |
| 28 | In endoscopic therapy, how are ESD and EMR selected? |
| 29 | What is the typical cost of an ESD/EMR procedure, and how is it covered by medical insurance? |
| 30 | How can the psychological state of patients be managed after an ESD/EMR procedure to reduce anxiety and concerns? |
Table 2 Likert scale scores for questions generated by chat generative pretrained transformer
| Question | Parameter | Rater 1 | Rater 2 | Rater 3 | mean ± SD |
| Q1 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ1 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q2 | Accuracy | 4 | 4 | 4 | 4 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ2 | Accuracy | 4 | 5 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q3 | Accuracy | 5 | 5 | 4 | 4.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ3 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 3 | 2 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q4 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ4 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q5 | Accuracy | 5 | 6 | 6 | 5.67 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ5 | Accuracy | 5 | 6 | 6 | 5.67 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q6 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ6 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q7 | Accuracy | 4 | 5 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 2 | 3 | 2 | 2.33 ± 0.47 | |
| RQ7 | Accuracy | 4 | 5 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Q8 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ8 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q9 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ9 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q10 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ10 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q11 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ11 | Accuracy | 6 | 5 | 6 | 5.67 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q12 | Accuracy | 6 | 5 | 6 | 5.67 ± 0.47 |
| Completeness | 3 | 2 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ12 | Accuracy | 6 | 6 | 5 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 2 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q13 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ13 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q14 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 3 | 3 | 2 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 2 | 2.67 ± 0.47 | |
| RQ14 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 2 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q15 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 3 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ15 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q16 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ16 | Accuracy | 5 | 6 | 6 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q17 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ17 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 3 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q18 | Accuracy | 6 | 5 | 6 | 5.67 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ18 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q19 | Accuracy | 6 | 6 | 5 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ19 | Accuracy | 6 | 5 | 6 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q20 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 2 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ20 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q21 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ21 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q22 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ22 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q23 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ23 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q24 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 2 | 3 | 2 | 2.33 ± 0.47 | |
| RQ24 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Q25 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ25 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q26 | Accuracy | 5 | 5 | 6 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ26 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q27 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ27 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q28 | Accuracy | 4 | 5 | 6 | 5 ± 1 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ28 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q29 | Accuracy | 5 | 4 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ29 | Accuracy | 5 | 4 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q30 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ30 | Accuracy | 6 | 6 | 5 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 |
- Citation: Wang SS, Gao H, Lin PY, Qian TC, Du Y, Xu L. Evaluating chat generative pretrained transformer in answering questions on endoscopic mucosal resection and endoscopic submucosal dissection. World J Gastrointest Oncol 2025; 17(10): 109792
- URL: https://www.wjgnet.com/1948-5204/full/v17/i10/109792.htm
- DOI: https://dx.doi.org/10.4251/wjgo.v17.i10.109792