Commercial LLMs (GPT-4o, Gemini 1.5 Pro-002, Llama 3.1 8B Instruct) 🧠💊, including after finetuning, showed poor average generalization accuracy (21-42%) 📉 when attempting to answer medical questions related to new drugs or updated recommendations.
Read Full Article
#CommercialLLMs #GPT4o #Gemini15Pro002 #Llama31 #MedicalAI
Read Full Article
#CommercialLLMs #GPT4o #Gemini15Pro002 #Llama31 #MedicalAI
NEJM AI
Limitations of Learning New and Updated Medical Knowledge with Commercial Fine-Tuning Large Language Models
Large language models (LLMs) used in health care need to integrate new and updated
medical knowledge to produce relevant and accurate responses. For example, medical
guidelines and drug information...
medical knowledge to produce relevant and accurate responses. For example, medical
guidelines and drug information...