Congratulations Lizhou “Leo” Fan - looking forward to you joining us in Boston!

Language models answer medical questions differently when brand vs. generic drug names are used. Memorization, biases in pre-training data & dataset contamination may be inflating model performance on common benchmarks. Check out our preprint & medical robustness leaderboard👇

Can you do MedMCQA next? We have found similar issues. But non-ambiguous ground truth isn't always possible in medicine - we need new benchmark and evaluation suites!

Excited to finally be in Mexico City for #NAACL24 #ClinicalNLP workshop tomorrow! Please stop by, check out the awesome research that's being presented, and meet like-minded people working at the health 👩‍⚕️ <-> NLP 💻 interface

Kicking off #ClinicalNLP at #NAACL24 with our Keynote, David Restrepo, discussing #LLMs in LMICs. How can move forward, knowing that existing foundation models are unlikely to generalize to LMIC healthcare settings?

⚠️They discovered that when different names were used for the same drug, #LLM performance on standard medical benchmarks decreased. This suggests that LLM performance might be influenced by memorization rather than reasoning ability.

About to start this important program! I am speaking about rechallenge of IO therapies after an #irAE in just a few minutes! Dana-Farber Society for Immunotherapy of Cancer (I will be discussing SWOG Cancer Research Network S1609 early on based an ASCO abstract we had)

Join us on 10 Sept for an insightful day at the intersection of healthcare and data technology at the 4th Clinic Meets Data Science Symposium in Zurich! usz.ch/en/event/4th-c… Janna Hastings 🏳️‍🌈 Charlotte Tumescheit Dr Chloé Azencott ➡️🐘 @[email protected] Danielle Bitterman, MD Julio Saez-Rodriguez Unispital_USZ usz.ch/en/event/4th-c…

You should work with William La Cava !

Looking forward to discussing how #AI, including NLP/LLMs, can help us better understand SDoH and support patients receiving #immunotherapy with National Cancer Institute and Society for Immunotherapy of Cancer. Sign up and check the other exciting webinars in the series - free to attend and open to all!

On July 30 at 1:30 pm ET, Danielle Bitterman, MD Dana-Farber will share new methods to analyze electronic health record data for social determinant indicators that could help enhance #immunotherapy during an National Cancer Institute & Society for Immunotherapy of Cancer computational IO webinar: sitcancer.org/education/webi…

Took 1-8y off science for family during your postdoc or faculty position? Contact an NIH-funded lab to see if they will write a reentry with you. Please RT these little-known supplements: nigms.nih.gov/Research/Mecha…

new preprint: reporting guideline for large language model use in healthcare medrxiv.org/content/10.110… Danielle Bitterman, MD Gary Collins 🇪🇺 Carl Moons jack gallifant Judy Gichoya Roxana Daneshjou MD/PhD Dr. Giovanni E Cacciamani MD MSc FEBU 🇮🇹🇺🇸🇪🇺 #ArtificialIntelligence #LLM #AI #transparency

TRIPOD-LLM, an extension of TRIPOD+AI for LLMs in healthcare. 📋 19 main items, 50 subitems 🔄 Modular format 🎯 Emphasizes transparency and human oversight #HealthcareAI #LLM #ClinicalResearch #AIStandards #Pub2Post tinyurl.com/4xfhmw49 Danielle Bitterman, MD Gary Collins 🇪🇺 Carl Moons

Super excited to be in Yokohama for #ASCOBT24! I would love to meet up with colleagues working in oncology, AI, and NLP - reach out if you are here!

🌟Happening NOW #ASCOBT24 Day1⃣ 🔥Artificial Intelligence (#AI) in the Cancer Clinic 🎯Large Language Models (#LLM) for Applications in the Clinic 🎙️Danielle Bitterman, MD OncoAlert ASCO 日本臨床腫瘍学会（JSMO） conferences.asco.org/breakthrough/

Just out @JACC CardioOncol, we intricately map #radiation exposure from #radiotherapy for #LCSM to different sub-structures of the heart to predict the risk of 5 different classes of #cardiac arrhythmias, pointing to possibly distinct pathophys pathways. sciencedirect.com/science/articl…

Check out our work on prompt engineering efforts and deployment for Epic GPT-4 Mychart message use case!

Thank you so much for having me! It was an honor!

Welcome to the fall semester! 🍂📚 Join CRCS for our Social Impact seminar series, taking place on 5 Mondays during the fall (Sept 9, Oct 7, 21, 28, and Nov 4) in the Science and Engineering Complex at Harvard SEAS. More info here: crcs.seas.harvard.edu/ai-social-impa… Hope to see you there!