Published on in Vol 6 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48140, first published .
Short-Form Medical Media: A Multi-Platform Analysis of Acne Treatment Information in TikTok Videos, Instagram Reels, and YouTube Shorts

Short-Form Medical Media: A Multi-Platform Analysis of Acne Treatment Information in TikTok Videos, Instagram Reels, and YouTube Shorts

Short-Form Medical Media: A Multi-Platform Analysis of Acne Treatment Information in TikTok Videos, Instagram Reels, and YouTube Shorts

Research Letter

1John Sealy School of Medicine, University of Texas Medical Branch, Galveston, TX, United States

2Texas A&M University, College Station, TX, United States

3Department of Dermatology, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, United States

4Department of Dermatology, Brigham and Women’s Hospital, Boston, MA, United States

Corresponding Author:

John S Barbieri, MBA, MD

Department of Dermatology

Brigham and Women’s Hospital

221 Longwood Ave

Boston, MA, 02115

United States

Phone: 1 617 732 4918

Email: jbarbieri@bwh.harvard.edu




Social media has emerged as a medium for dermatologists to disseminate educational content [1-3]. Adolescents extensively use social media as a resource [1], with 75% of adolescent patients with acne reporting they consult social media for treatment information [4]. However, many dermatologic posts are low in educational quality, especially those made by non–board-certified dermatologists [2]. TikTok has emerged as a wide-reaching, short-form video platform used by millions of adolescents and adults worldwide [1,3]. The short-form video structure has since been emulated in Instagram Reels (IGR) and YouTube Shorts (YTS). However, little is known about how the quality of acne treatment content varies across these platforms and how they compare to each other.


To assess the content and educational quality of videos on acne treatment across TikTok, IGR, and YTS, we acquired the top 300 videos per platform from TikTok (search: “acne treatment”), IGR (search: “#acnetreatment”), and YTS (search: “#shorts + acne treatment”) on March 9, 2023. Videos were excluded if they were irrelevant to acne treatment, noneducational, duplicate content, not in English, or made unavailable, as well as if they had hidden metrics or the treatment was unspecified. Video metrics and video engagement rate (VER) ([likes + comments per post]/[followers] × 100] were determined [3]. Video creators were stratified by creator type through review of their profile (dermatologist/dermatology practice, nondermatologist physician/medical clinic, layperson, influencer, or other). “Influencer” was defined as a layperson with at least 40,000 followers [3]. “Other” was categorized as having a specific profession or niche related to skin health (eg, skincare company, aesthetician). Two independent reviewers rated videos using the DISCERN Instrument, which allows health care providers to evaluate the quality of consumer health information, and the Global Quality Scale (GQS), which scores each video based on clinical usefulness [5]. Any discrepancies were handled by consensus. Following video exclusion, a multiple regression analysis was performed to evaluate the association between the platform (ie, TikTok, IGR, and YTS) and creator type with DISCERN and GQS scores, controlling for upload date.


Of the videos analyzed, 32.8% (82/250) were created by dermatologists/dermatology practices, 5.60% (14/250) were by nondermatologist physicians/medical clinics, 27.2% (68/250) were by laypersons, 20.8% (52/250) were by influencers, and 13.6% (34/250) were by others. The average number of views per video was 1,639,969 on TikTok, 689,897 on YTS, and 27,192 on IGR. DISCERN and GQS scores were significantly higher for dermatologists than any other creator type across all platforms (Table 1). Posts from laypersons had a significantly higher VER compared to posts from dermatologists (Table 1). The most common therapies discussed were benzoyl peroxide, salicylic acid, adapalene, and preventative measures. IGR had a higher rate of discussion of complementary and alternative therapies compared to other platforms (Table 2).

Table 2 presents the number of treatment recommendations among those videos. Topical prescription medications included retinoids, antibiotics, antiandrogens, and steroids. Oral hormonal therapy included birth control pills and spironolactone. Procedural treatments included lasers or lights, chemical peels, extraction, and corticosteroid injections. Complementary and alternative therapies included treatments and suggestions that did not fall into any other category and were nonpreventative measures. Preventative measures included optimizing diet, avoiding pore-clogging makeup, managing stress, exercising, and avoiding picking at pimples.

Table 1. Analysis of the DISCERN score, the Global Quality Scale (GQS) score, and the video engagement rate (VER).

DISCERNGQSVER
 Score, meanCoefficient (95% CI)P valueaScore, meanCoefficient (95% CI)P valueRate (%), meanCoefficient (95% CI)P value
Platform  
  
  

Instagram Reels (n=64)36.9Refb
2.70Ref
4.3Ref

TikTok (n=112)40.81.99 (–0.19 to 4.17).072.94–0.03 (–0.26 to 0.21).83689.41025.87 (479 to 1572.75)<.001

YouTube Shorts (n=74)42.41.49 (–1.27 to 4.25).293.260 (–0.3 to 0.3).9862.4492.64 (–199.73 to 1185).16
Creator type  
  
  

Dermatologist/dermatology clinic (n=82)46.1Ref
3.88Ref
80.7Ref

Nondermatologist physician/medical clinic (n=14)41.6–4.41 (–8.09 to –0.73).023.00–0.88 (–1.28 to –0.49)<.00186.8149.1 (–774.82 to 1073.01).75

Layperson (n=68)36.3–9 (–11.19 to –6.81)<.0012.41–1.46 (–1.7 to –1.22)<.0019731069.21 (519.91 to 1618.51)<.001

Influencer (n=52)37.5–8.25 (–10.53 to –5.96)<.0012.60–1.27 (–1.52 to –1.02)<.00170.3–47.59 (–621.53 to 526.35).87

Other (n=34)38.1–7.67 (–10.28 to –5.06)<.0012.50–1.37 (–1.65 to –1.08)<.00113111.22 (–644.61 to 667.06).97

aItalicized values are significant.

bRef: reference.

Table 2. Acne treatments specified across platforms TikTok, Instagram Reels, and YouTube Shorts and creator types.

TikTokInstagram ReelsYouTube Shorts

Dermatologist/dermatology practice (n=36)Nondermatologist (n=76)Dermatologist/dermatology practice (n=10)Nondermatologist (n=54)Dermatologist/dermatology practice (n=36)Nondermatologist (n=38)
Treatments mentioned, N97176168410967
Benzoyl peroxide, n (%)18 (19)22 (13)2 (13)3 (4)20 (18)8 (12)
Salicylic acid, n (%)15 (15)26 (15)1 (6)24 (29)17 (16)12 (18)
Other topical OTCa treatments, n (%)21 (22)53 (30)4 (25)41 (49)19 (17)24 (36)
Adapalene (OTC), n (%)17 (18)8 (5)2 (13)0 (0)14 (13)1 (1)
Topical prescription medications, n (%)6 (6)24 (14)2 (13)1 (1)12 (11)3 (4)
Oral antibiotics, n (%)1 (1)2 (1)0 (0)0 (0)3 (3)3 (4)
Oral hormonal therapy, n (%)3 (3)6 (3)1 (6)0 (0)5 (5)1 (1)
Isotretinoin, n (%)7 (7)5 (3)0 (0)0 (0)6 (6)1 (1)
Procedural treatments, n (%)1 (1)7 (4)0 (0)5 (6)5 (5)6 (9)
Complementary and alternative therapies, n (%)0 (0)8 (5)3 (19)6 (7)0 (0)2 (3)
Preventative measures, n (%)8 (8)15 (9)1 (6)4 (5)8 (7)6 (9)

aOTC: over the counter.


Our study demonstrates that short-form social media platforms predominantly feature dermatology content created by nondermatologists; however, content produced by board-certified dermatologists was of significantly higher quality as evaluated by the DISCERN and GQS scores. Given the popularity of social media among adolescents with acne [1,4], there is an opportunity for more dermatologists to create content in these spaces where patients seek information. Although the rigorous outcome assessment with DISCERN and GQS scores is a strength of this study, given the rapidly evolving nature of social media, it will be important to reassess these findings over time.

Overall, content on these platforms heavily skewed toward over-the-counter (OTC) treatments, which may reflect the types of treatments that those with acne seek out on social media. However, for many with acne, OTC treatments will be insufficient and prescription therapy will be required. Consequently, dermatologists may find an opportunity on social media to better educate the community regarding prescription acne treatments and to correct misconceptions regarding how to approach OTC management of acne.

Acknowledgments

JSB is supported by the National Institute of Arthritis and Musculoskeletal and Skin Diseases of the National Institutes of Health under award number 1K23AR078930.

Authors' Contributions

CJT created the study. CJT and DG scored the videos in the study. JT acquired all study videos and video metrics. JSB performed the statistical analysis and supervised the study design and implementation. JBL assisted in data interpretation and table design. CJT, DG, JBL, and JSB drafted the manuscript.

Conflicts of Interest

JSB has received consulting fees from Dexcel Pharma for work unrelated to the current submission. JBL is an editorial board member of JMIR Dermatology. The authors have no other conflicts to declare.

  1. Roche L, Nic Dhonncha E, Murphy M. TikTok™ and dermatology: promises and pearls. Clin Exp Dermatol. Jul 31, 2021;46(4):737-739. [CrossRef] [Medline]
  2. Guzman AK, Wang RH, Nazarian RS, Barbieri JS. Evaluation of YouTube as an educational resource for treatment options of common dermatologic conditions. Int J Dermatol. Mar 20, 2020;59(3):e65-e67. [FREE Full text] [CrossRef] [Medline]
  3. Szeto MD, Presley CL, Pulsipher KJ, Harp T, Rundle CW, Sivesind TE, et al. Dermatologist influencers on social media: Instagram Reels and TikTok interactive short videos. J Am Acad Dermatol. Oct 2021;85(3):e185-e188. [CrossRef] [Medline]
  4. Aslan Kayıran M, Karadağ AS, Alyamaç G, Çevirgen Cemil B, Demirseren DD, Aksoy H, et al. Social media use in patients with acne vulgaris: what do patients expect from social media? J Cosmet Dermatol. Aug 18, 2021;20(8):2556-2564. [CrossRef] [Medline]
  5. Steeb T, Reinhardt L, Harlaß M, Heppt MV, Meier F, Berking C. Assessment of the quality, understandability, and reliability of YouTube videos as a source of information on basal cell carcinoma: web-based analysis. JMIR Cancer. Mar 11, 2022;8(1):e29581. [FREE Full text] [CrossRef] [Medline]


GQS: Global Quality Scale
IGR: Instagram Reels
OTC: over the counter
VER: video engagement rate
YTS: YouTube Shorts


Edited by R Dellavalle; submitted 12.04.23; peer-reviewed by M Szeto, V Long, K Roster; comments to author 15.06.23; revised version received 07.07.23; accepted 25.07.23; published 09.08.23.

Copyright

©Christopher J Thang, David Garate, Joseph Thang, Jules B Lipoff, John S Barbieri. Originally published in JMIR Dermatology (http://derma.jmir.org), 09.08.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Dermatology, is properly cited. The complete bibliographic information, a link to the original publication on http://derma.jmir.org, as well as this copyright and license information must be included.