Thumbnail Image
Item

Readability and Health Literacy Scores for ChatGPT-Generated Dermatology Public Education Materials: Cross-Sectional Analysis of Sunscreen and Melanoma Questions

Roster, Katie
; 
Kann, Rebecca B.
; 
Farabi, Banu
; 
Gronbeck, Christian
; 
Brownstone, Nicholas
; 
Lipner, Shari R.
Citations
Altmetric:
Genre
Journal article
Date
2024-03-06
Advisor
Committee member
Group
Temple University. Hospital
Department
Subject
AI
 ChatGPT
 LLM
 LLMs
 NLP
 Artificial intelligence
 Comprehensibility
 Comprehensible
 Dermatology
 Disparities
 Disparity
 Generative
 Health disparities
 Health education
 Health information
 Health literacy
 Language model
 Language models
 Large language model
 Natural language processing
 Online information
 Patient education
 Public education
 readability
 Understandability
Permanent link to this record
https://scholarshare.temple.edu/handle/20.500.12613/11858
Collections
Faculty/Researcher Works
Show all metadata
Files
Thumbnail Image
Brownstone-JournalArticle-2024-03.pdf
Adobe PDF, 43.61 KB
Research Projects
Organizational Units
Journal Issue
DOI
https://doi.org/10.2196/50163
Abstract
A study of 402 randomly selected Medicaid enrollees reported an average of a 5th-grade reading level, which is lower than the average 8th-grade level of US adults [1,2]. Therefore, the American Medical Association (AMA) recommends developing health materials at a 6th-grade reading level or lower [3]. However, a 2018 systematic review of 7891 health websites reported that educational health materials are often at 10th- to 15th-grade reading levels [4]. In a study evaluating ChatGPT-generated materials for 14 dermatological diseases, content was at a 10th-grade reading level [5]. We hypothesized that ChatGPT could be prompted to generate rewritten health materials at a lower grade level and in line with AMA recommendations. The readability of ChatGPT-generated dermatology information and public educational resources on the American Academy of Dermatology Association’s (AAD) website was assessed and determined whether strategic prompting would enhance the material’s readability.
Description
Citation
Roster K, Kann RB, Farabi B, Gronbeck C, Brownstone N, Lipner SR Readability and Health Literacy Scores for ChatGPT-Generated Dermatology Public Education Materials: Cross-Sectional Analysis of Sunscreen and Melanoma Questions JMIR Dermatol 2024;7:e50163 doi: 10.2196/50163
Citation to related work
JMIR Publications Inc.
Has part
JMIR Dermatology, Vol. 7
ADA compliance
Embedded videos
License
Attribution CC BY
cb