American College of Radiology Develops AI Quality Assurance Program

Clinical stakeholder organizations are working to bring consensus-based building blocks of infrastructure, processes and governance in AI implementation to real-world practice. One such group is the American College of Radiology, which has launched the ACR Recognized Center for Healthcare-AI (ARCH-AI), an AI quality assurance program for radiology facilities.

By working toward, and attesting to, compliance within the tenets of the program, participation in ARCH-AI can help radiology practices provide safe and effective implementation of AI products and help radiologists provide better patient care, according to ACR. 

ARCH-AI site recognition criteria include:
• Establishing an interdisciplinary AI governance group.
• Maintaining an inventory of AI algorithms with detailed documentation.
• Ensuring adherence to security and compliance measures.
• Engaging in diligent review and selection of AI algorithms.
• Documenting use cases and training procedures.
• Monitoring algorithm performance, including safety and effectiveness.
• Contributing to the “Assess-AI” central AI registry for performance benchmarking.

“AI is different from previous technologies,” said Christoph Wald, M.D., Ph.D., M.B.A., vice chair of the ACR board of chancellors and chair of the ACR Commission on Informatics, in a statement. “Even a U.S. Food and Drug Administration-cleared AI product must be tested locally to ensure it works safely and as intended. Practice leaders must put safeguards in place to maximize the benefit of AI products while minimizing risk; ARCH-AI is a low-cost, efficient system to help sites do that.”

“ARCH-AI can help radiology practices structure QA processes that help them plan for what can go wrong, including the development of good AI governance practices, acceptance testing and effectiveness monitoring of AI products to ensure they continue to function as expected over time,” said Keith J. Dreyer, D.O., Ph.D., ACR Data Science Institute chief science officer, in a statement.

Radiology practices that complete the ARCH-AI process will receive an ACR Recognition badge to display in their waiting rooms and lobbies to demonstrate to their communities, patients, payers and referring physicians that they are committed to integrating AI in a safe, responsible manner that allows them to provide the best possible modern healthcare.

Organizations already recognized by ARCH-AI include Mayo Clinic Care Network, University of Washington Medical Center, Penn Medicine, University of Wisconsin Health, Yale New Haven Health, Cleveland Clinic, UT Southwestern Medical Center, Jefferson Health, the University of Maryland School of Medicine, and Beth Israel Lahey Health.