This event is archived. Final snapshot from when the story concluded. View on Dashboard
Events / Technology / Penn State Study AI Chatbot Accuracy
Tech research study

Penn State Study AI Chatbot Accuracy

Analysis based on 7 articles · First reported May 28, 2026 · Last updated May 31, 2026

Sentiment
20
Attention
3
Articles
7
Market Impact
General
Live prominence charts, article sentiment distribution, and event development timeline available on the Ergen Dashboard
Market Impact

The study highlights the potential and limitations of AI in healthcare, which could influence investment and development in medical AI technologies. Companies like ChatGPT, Google Gemini, and Large language model may see increased scrutiny or demand for their AI models in medical applications, depending on how their accuracy and safety are perceived.

Healthcare Technology
Event Summary

Researchers at Pennsylvania State University conducted a study on the accuracy of AI-powered chatbots, including ChatGPT, Google Gemini, and Large language model, in responding to everyday health-related questions. The study, led by Amulya Yadav>>> and Bonam Mingole>>>, found that AI chatbots provided accurate information nearly 76% of the time. However, error rates exceeding 20% raised concerns about their trustworthiness for patient-facing applications, especially in specialized areas like neurology and dermatology. The researchers suggest AI tools may be more effective for trained physicians than for patients. Jennifer Kraschnewski>>> and S. Shyam Sundar>>> also contributed to the study, which will be presented at the 2026 Association for Computing Machinery>>> FAccT conference in Montreal, Canada>>>. The findings emphasize the need for improved AI literacy and responsible integration of AI in healthcare.

Entities Involved
per
Amulya Yadav
Amulya Yadav, an associate professor at Penn State, co-authored the study, emphasizing the focus on everyday healthcare scenarios for AI usage.
Importance 70.0 Sentiment 20.0
per
Bonam Mingole
Bonam Mingole, lead author of the study, highlighted the participatory research approach to replicate real-world AI usage in healthcare.
Importance 60.0 Sentiment 20.0
per
Jennifer Kraschnewski
Jennifer Kraschnewski, a co-author, emphasized the opportunity for healthcare transformation through AI integration for clinicians.
Importance 60.0 Sentiment 20.0
per
S. Shyam Sundar
S. Shyam Sundar, a co-author, stressed the importance of understanding AI use patterns and testing validity to advance literacy on medical advice.
Importance 60.0 Sentiment 20.0
ngo
Association for Computing Machinery
The Association for Computing Machinery Fairness, Accountability and Transparency (FAccT) conference is where the study's findings will be presented.
Importance 20.0 Sentiment 0.0
cnt
Canada
Canada is the host country for the 2026 Association for Computing Machinery Fairness, Accountability and Transparency (FAccT) conference where the study findings will be presented.
Importance 10.0 Sentiment 0.0
ERGEN INTELLIGENCE
Track this event live

Set up alerts, explore entity relationships, search across thousands of events, and build custom intelligence feeds.

Open Dashboard

About Ergen

Ergen is a news intelligence platform that converts raw news articles into structured data. It tracks events, entities, and the relationships between them, with sentiment and attention metrics derived from thousands of articles. Pages on this site are daily static snapshots from the platform's live database. For real-time tracking, search, and alerts, the full dashboard is at app.ergen.ai.