LLMs can be prompt-injected to give bad medical advice, including giving thalidomide to pregnant people 💊🤰⚠️
Read Full Article
#PromptInjection #MedicalAdvice #LLMs #Thalidomide #AIethics
Read Full Article
#PromptInjection #MedicalAdvice #LLMs #Thalidomide #AIethics
Jamanetwork
Vulnerability of Large Language Models to Prompt Injection When Providing Medical Advice
This quality improvement study evaluates the susceptibility of commercial large language models (LLMs) to prompt-injection attacks that may induce unsafe clinical advice contraindicated treatments.
🤷♂2😱2🤣2🦄1