Āé¶¹“å

Skip to main content
Alex John London
Alex John London spoke about the importance of ensuring that advances in AI make health care more effective, efficient and equitable.

K&L Gates–Āé¶¹“å Conference Examines the Opportunities and Challenges of AI in Medicine

Media Inquiries
Name
University Communications and Marketing, Media Relations

Experts in artificial intelligence, medicine, ethics, law and policy gathered at Āé¶¹“å for theĀ K&L Gates Initiative in Ethics and Computational Technologies conference on Artificial Intelligence in Medicine: Opportunities and Challenges on Nov. 5.Ā 

The event explored how the rapidly increasing use of AI can positively and responsibly impact the healthcare sector while avoiding harm, as well as how AI tools can be developed and deployed in ways that support both patients and providers.Ā 

Farnam Jahanian

Farnam Jahanian

In the opening remarks, Āé¶¹“å President Farnam Jahanian said that the agenda spoke to the heart of Carnegie Mellon's interdisciplinary approach to discovery and innovation.

ā€œI believe that the great advances we can see in the next chapter in healthcare will be defined as much by our ability to govern and responsibly deploy these advances as by the breakthroughs that we're all eager to see and will continue to see. The institutions and partnerships that can bridge that divide between discovery and deployment for the benefit of humanity will help define the future of healthcare and medicine,ā€ Jahanian said.Ā 

Alex John London, the K&L Gates Professor of Ethics and Computational Technologies framed the event, highlighting the critical role of ethics for ensuring that AI in health care advances the goals of making health systems more effective, more efficient, and more equitable.Ā 

Barbara Shinn-Cunningham, Hana El-Samad and Kadija Ferryman

Barbara Shinn-Cunningham, the Glen de Vries Dean of theĀ Mellon College of Science, led a discussion with Kadija Ferryman (center), faculty at the Berman Institute of Bioethics and assistant professor at Johns Hopkins Bloomberg School of Public Health, and Hana El-Samad, senior vice president and director of the Institute of Computation at Altos Labs (right).Ā 

They discussed how to understand the unique challenges related to developing AI for healthcare. Reflecting on the challenges, Shinn-Cunningham noted that healthcare is a demanding test for AI.

ā€œBiology is complex. Clinical data reflect who receives care and the stakes can be life or death,ā€ said Shinn-Cunningham. ā€œĀé¶¹“å’s interdisciplinary culture can bring our core strengths in AI and computation together with foundational science and medical expertise to build tools that health professionals can understand, trust and implement to improve care.ā€

Jana Kainerstorfer and panelists

, a professor and associate department head for faculty and graduate affairs in the ’sĢż department, moderated a panel about how to best promote the benefits of AI while reducing the harms that AI can have in healthcare settings. She spoke with S. Matthew Liao (second from left), a professor of bioethics and director of the Center for Bioethics at New York University, Jenna Wiens (second from right), a professor of computer science and engineering at the University of Michigan and Brad Malin, a professor of biomedical informatics and vice chair for research at Vanderbilt University Medical Center (right).Ā 

ā€œThe problem that we're facing now with AI is that we have these general purpose tools, these foundation models that are not designed for specific concrete use cases, so it becomes far more challenging to anticipate the unintended consequences. We can be too slow to adopt technology, but we can also be too quick to adopt technology, and there can be harm,ā€ Wiens said.Ā 

Kainerstorfer asked the panel about how health systems should evaluate AI systems that are continually evolving. The panel discussed how there’s real risk in the rapid incorporation of AI into healthcare systems because the effects of these tools are often not being monitored regularly or effectively.Ā 

Holly Wiberg and panelists

, an assistant professor of operations research and public policy at theĀ , hosted a conversation about how to make AI work for everyone in healthcare and emphasized the importance of designing AI in ways that can be applied to the environments in which they’ll be deployed. She spoke with Sharona Hoffman, a professor of law and bioethics at Case Western University (center) and Judy Wawira Gichoya (right), a professor of radiology at Emory University.

The panelists discussed how AI models should be trained on the patient populations they are being used to treat — if they are not, it could lead to ineffective treatment. For example, they cited AI scribe tools, commonly used during patient visits.Ā 

ā€œEvaluating AI in healthcare isn’t only a technical problem, but rather it depends on context: understanding how a tool will be used in decisions and who those decisions impact, and ensuring that both perspectives are reflected into its design and deployment,ā€Ā said Wiberg.Ā ā€œThis systems-level perspective is core to work at Āé¶¹“å, spanning computer science, policy, ethics, and operations, and so it is especially exciting to bring in leaders in this space here to share their perspectives.ā€Ā 

Cassidy Sugimoto and panelists

Cassidy Sugimoto, Bess Family Dean of theĀ Dietrich College of Humanities and Social Sciences, hosted a discussion about how to maintain accountability and ensure responsibility when deploying AI in healthcare. She spoke with Megan Palmer (center), a senior adviser for national security and technology strategy at the U.S. Advanced Research Projects Agency for Health (ARPA-H) and Kirsten Bibbins-Domingo, editor in chief of the Journal of the American Medical Association (JAMA) and the JAMA Network.

"Responsible AI in medicine begins long before it reaches the patient, with how research is funded, how it is reviewed and published, and how we train the scientists who produce it, and Āé¶¹“å leads on every one of those fronts,ā€ said Sugimoto.

The conference is run by the Āé¶¹“å-K&L Gates Initiative in Ethics and Computational Technologies, which is funded by a $10 million gift from the firm. This gift reflects the growing importance of legal, regulatory and societal questions surrounding the development and use of AI. David Lehman, a partner at the firm, said the key to successful integration of AI in healthcare is to emphasize innovation without being reckless and likened the ethical implementation of AI in the medical field to what he has seen in his work as a lawyer.Ā 

ā€œThe changes are inevitable and important, but must be balanced with responsible implementation. We made a deliberate decision. Rather than react to generative AI, we would lead. We didn't just adopt tools; we built governance. We invested in training. We made commitments to our clients about data security and confidentiality; and most importantly, we maintain accessible lawyers' human judgment, professional responsibility and a commitment to our clients' interests,ā€ Lehman said.Ā 

The joint conference was first held atĀ Āé¶¹“å in 2018 and is led by initiative leadersĀ  from theĀ  and London from Dietrich College.

— Related Content —