Wednesday, October 30, 2024

Inaccurate Medical AI Transcription

"Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said"

But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.
Malpractice lawyers will have a field day with this.