# AI Tool Used in Hospitals Produces Fabricated Text, Researchers Warn! ⚠️ **URL:** \ **Category:** News & Articles\ **Tags:** tools\ **Created:** [October 28, 2024, 3:47pm UTC](https://onehack.st/t/ai-tool-used-in-hospitals-produces-fabricated-text-researchers-warn/294639 "2024-10-28T15:47:37Z")\ **Posts on this page:** 1\ **Page:** 1
**Author:** ![TheJoker](https://onehack.st/user_avatar/onehack.st/thejoker/32/22660_2.png) [@TheJoker](https://onehack.st/u/TheJoker)\ **Post date:** [October 28, 2024, 3:47pm UTC](https://onehack.st/t/ai-tool-used-in-hospitals-produces-fabricated-text-researchers-warn/294639/1 "2024-10-28T15:47:37Z")
**Summary:** 1. **Concerns Over AI Accuracy** Researchers have raised alarms about OpenAI’s transcription tool, **Whisper** , which has been found to generate fabricated text, referred to as “hallucinations,” that can include inappropriate or harmful content. 2. **Implications in Healthcare** As Whisper is utilized in various industries, including healthcare, the potential for generating false or misleading information poses significant risks, particularly when it comes to sensitive medical contexts. 3. **Expert Insights** Interviews with software engineers and researchers revealed that these fabrications can range from racial comments to fictitious medical treatments, raising ethical concerns about the use of AI in critical settings. 4. **Data Handling Issues** Companies like Nabla, which use Whisper for transcription, eliminate the original audio for “data safety reasons,” making it impossible to verify the accuracy of AI-generated transcripts against the original recordings. 5. **Need for Caution** The findings underscore the need for greater scrutiny and safeguards in the deployment of AI tools in sensitive environments, ensuring that such technologies do not compromise data integrity or patient safety. **Read more at:** [AP News](https://apnews.com/article/ai-artificial-intelligence-health-business-90020cdf5fa16c79ca2e5b6c4c9bbb14)