A new study from the Regenstrief Institute and the Indiana University School of Medicine has found that natural language processing accurately tracks colonoscopy quality.
Clinician-researchers from the Regenstrief Institute have created and tested such a system in the nation's first multiple institution colonoscopy quality measurement study utilizing natural language processing, reporting that it is as accurate but less expensive than human review, according to Regenstrief officials.
Natural language processing allows a computer to rapidly "read" and "understand" the free text of reports prepared by the gastroenterologists who perform colonoscopies and the free text reports of pathologists who analyze the composition of growths removed from the colon. "We found that rapid and inexpensive natural language processing, which utilizes free-text data that was previously unusable for efficient computer-based analysis, was extremely accurate in measuring adenoma detection rate during colonoscopy," said Timothy Imler, M.D., a Regenstrief Institute investigator and Indiana University School of Medicine assistant professor of medicine in the division of gastroenterology and Z, who led the study. "The presence of adenomas in the colon is predictive of a patient's risk of later developing colon cancer, and the detection rate has been identified as the critical measure of a high-quality endoscopist, the specialist who performs colonoscopy," Imler said.
The study, to be published in the American Journal of Gastroenterolog, found that in spite of linguistic variation in the way providers at 13 medical centers across the country used words to express the same concept, 95 percent of the time computerized natural language processing was correct regarding type and location of an adenomatous polyp, compared to human expert reviewers who were assumed to be 100 percent correct. Thus, software can perform the same job in interpreting and correlating colonoscopy and pathology reports as humans, only much faster, reproducibly, and far less expensively, according to the researchers.
Of more than 90,000 colonoscopies performed at the medical centers, slightly fewer than half had findings that generated pathology reports. Seven hundred and fifty paired colonoscopy and pathology reports from this group were randomly sampled and compared by human reviewers using 19 measurements related to quality and procedure interval determination. The remaining 41,819 paired reports were processed through natural language processing to access performance consistency using the same 19 measurements.
"Confirming that humans and the computer had similar assessments on procedures performed at facilities across the country gives us a powerful, scalable tool to assess quality and determine the appropriate interval between colonoscopies based on the procedure findings. Natural language processing will enable comparison of adenoma detection rates across populations to determine geographic, racial, ethnic or gender disparities," said Dr. Imler. "It also could be used across health systems or colonoscopy centers or doctors to enable referers or patients themselves to make informed decisions about where they wish to go for a colonoscopy."
