This paper is in the following e-collection/theme issue:

Skin Cancer and Melanoma Prevention (112) Web-based and Mobile Health Interventions (3297) Mobile Health (mhealth) (2939) Formative Studies and eHealth/mHealth Development (524) RCTs - Pilots/Feasibility Studies (eHealth) (84) Methods and Feasibility Studies (379) mHealth for Wellness, Behavior Change and Prevention (2871) Design and Formative Evaluation of Mobile Apps (694) Prevention and Health Promotion (986) Formative Evaluation of Digital Health Interventions (2410) Failure analysis (12) Mobile Apps for Dermatology and Prevention (18)

Published on in Vol 1, No 1 (2018): Jan-Jun

Acceptability and Feasibility of a Trial Testing Allocation to Sunscreen and a Smartphone App for Sun Protection: Discontinued Randomized Controlled Trial

Acceptability and Feasibility of a Trial Testing Allocation to Sunscreen and a Smartphone App for Sun Protection: Discontinued Randomized Controlled Trial

Acceptability and Feasibility of a Trial Testing Allocation to Sunscreen and a Smartphone App for Sun Protection: Discontinued Randomized Controlled Trial

Authors of this article:

Angela M Rodrigues1 Author Orcid Image ;   Falko F Sniehotta1 Author Orcid Image ;   Mark A Birch-Machin1 Author Orcid Image ;   Patrick Olivier1 Author Orcid Image ;   Vera Araújo-Soares1 Author Orcid Image
Article Authors Cited by (2) Tweetations (18) Metrics

    Original Paper

    Newcastle University, Newcastle, United Kingdom

    Corresponding Author:

    Angela M Rodrigues, MSc, PhD

    Newcastle University

    Baddiley-Clark Building

    Richardson Road

    Newcastle, NE2 4AX

    United Kingdom

    Phone: 44 191 208 8974

    Fax:44 191 208 6043

    Email: angela.rodrigues@newcastle.ac.uk


    Background: Recreational sun exposure has been associated with melanoma prevalence, and tourism settings are of particular interest for skin cancer prevention. Effective, affordable, and geographically flexible interventions to promote sun protection are needed.

    Objective: The aim of this study was to describe the protocol for a definitive randomized controlled trial (RCT) evaluating a smartphone mobile intervention (mISkin app) promoting sun protection in holidaymakers and to assess the acceptability and feasibility of the mISkin app and associated trial procedures in an internal pilot study.

    Methods: Participants were recruited from the general community. Holidaymakers traveling abroad and owning a smartphone were enrolled in the internal pilot of a 2 (mISkin vs control) x 2 (sun protection factor [SPF] 15 vs SPF 30) RCT with a postholiday follow-up. The smartphone app is fully automated and entails a behavioral intervention to promote sun protection. It consisted of five components: skin assessment, educational videos, ultraviolet (UV) photos, gamification, and prompts for sun protection. Participants were also randomly allocated to receive sunscreen SPF 15 or SPF 30. Primary outcomes for the internal pilot study were acceptability and feasibility of trial procedures and intervention features. Secondary outcomes were collected at baseline and after holidays through face-to-face-assessments and included skin sun damage, sunscreen use (residual weight and application events), and sun protection practices (Web-based questionnaire).

    Results: From 142 registers of interest, 42 participants were randomized (76% [32/42] female; mean age 35.5 years). Outcome assessments were completed by all participants. Random allocation to SPF 15 versus SPF 30 was found not to be feasible in a definitive trial protocol. Of the 21 people allocated to the mISkin intervention, 19 (91%) installed the mISkin on their phones, and 18 (86%) used it at least once. Participants were satisfied with the mISkin app and made suggestions for further improvements. Due to difficulties with the random allocation to SPF and slow uptake, the trial was discontinued.

    Conclusions: The internal pilot study concluded that randomization to SPF was not feasible and that recruitment rate was slower than expected because of difficulties with gatekeeper engagement. Possible solutions to the problems identified are discussed. Further refinements to the mISkin app are needed before a definitive trial.

    Trial Registration: International Standard Randomized Controlled Trial Number ISRCTN63943558; http://www.isrctn.com/ISRCTN63943558 (Archived by WebCite at http://www.webcitation.org/6xOLvbab8)

    JMIR Dermatol 2018;1(1):e1

    doi:10.2196/derma.8608

    Keywords

    sunscreening agents; sun protection factor; smartphone; mobile applications; feasibility studies; randomized controlled trial; skin neoplasms; melanoma; skin aging; holidays; health promotion; health behavior 


    Skin cancer is the most common form of all types of cancer diagnosed in the United Kingdom [1]. In 2014, about 15,400 new melanoma skin cancer and 132,000 new nonmelanoma cases were registered [2]. Melanoma incidence rates have increased by almost a half (45%) over the last decade in the United Kingdom [2]. Intermittent sun exposure, in particular, (eg, summer holidays in sunny destinations) has been shown to increase melanoma risk considerably [3]. Epidemiologic studies suggest that implementation of sun protection behaviors would decrease intermittent sun exposure and would reduce skin cancer incidence [4,5]. Although applying sunscreen has been widely promoted, there is some discrepancy regarding the recommended sunscreen protection factor. The National Institute for Health and Care Excellence (NICE) recommends using a sun protection factor (SPF) of 15, whereas the British Association of Dermatologists, Cancer Research UK, and the British Skin Foundation suggest the use of at least SPF 30 [6].

    Tourism settings are of particular interest for skin cancer prevention [3]. Sunburn is a common experience [7,8], and sun-related behaviors such as intentional sun seeking associated with lifestyle changes (eg, holidays in sunny destinations and fashion trends) are increasingly high [9]. Holidaymakers are a volatile population present at different locations, which may make them difficult to reach. A scalable and geographically flexible mobile phone intervention might be an effective way of reaching this population. Mobile phone interventions have been shown to improve sun protection behaviors either by using SMS text messaging (short message service, SMS) interventions or mobile phone apps [10-12]. A novel mobile phone intervention (mISkin app) to promote sun protection among holidaymakers has recently been developed based on evidence [13,14], experts’ knowledge and experience, and user involvement [15].

    The starting point for this research was to address the main challenges identified by a recent systematic review of sun protection interventions, including (1) poor reporting of intervention development, design, and contents; (2) poor outcome measurement; and (3) poor study methodology [13]. In line with this, this study describes an internal pilot study evaluating an evidence-based behavior change intervention to promote sun protection among holidaymakers, using both objective and self-reported outcome measures. The study also provides evidence to inform guidelines regarding the recommended sunscreen SPF. The specific study objectives are to:

    1. Test the acceptability of recruitment, allocation, measurement, and intervention procedures.
    2. Assess the feasibility of a mobile phone intervention to promote sun protection (feasibility).
    3. Collect feedback regarding satisfaction with the intervention (acceptability).
    4. Explore users’ engagement with the app and its active ingredients (fidelity).

    Full details of the research protocol have been registered: ISRCTN3943558 [16]. Ethical approval was obtained from the Faculty of Medical Sciences at Newcastle University.

    Trial Design

    The study was initially designed as a single center assessor-blinded parallel group, individually randomized controlled trial (RCT), using a 2 (mISkin app intervention vs no intervention) x 2 (sunscreen provision: SPF 15 vs SPF 30) factorial design. This study sought to explore the independent main effects of both sunscreen SPF and mobile app that would result in consistent differences between the levels (SPF 15 vs SPF 30; app vs no app), rather than an interaction effect.

    The intended number of participants to be recruited for the definitive trial was 200, with the first 30 comprising the internal pilot phase. The internal pilot was conducted from September 2012 to October 2013. A schedule of events is presented in Multimedia Appendix 1 (schedule of events for the trial, including enrollment, interventions, and outcome assessments).

    Participants

    Holidaymakers from the North East of England traveling abroad, older than 18 years, and owning an Android smartphone were recruited. The recruitment strategy involved placing posters in local urban community areas such as universities, travel agency; large companies; and using social media (ie, Twitter and Facebook). Interested individuals contacted the research team by email. Participants were assessed for inclusion criteria by a researcher (AR) and provided informed consent before participation.

    Interventions

    mISkin Intervention Group

    Participants randomized to the intervention group engaged in a behavioral intervention (mISkin) delivered through a mobile phone (Android smartphone) during their holiday (see Template for Intervention Description and Replication checklist in Multimedia Appendix 2). The mISkin app (Figure 1) is fully automated and was designed to promote holidaymakers’ sun protection behavior by providing information, addressing appearance-related concerns (eg, ultraviolet [UV] photo), and prompting sun protection based on location (ie, global positioning system, GPS) [15]. The content of the mISkin app was unchanged during the trial. The mISkin app had four main menus: (1) My skin, (2) How to be sun smart, (3) Sun safety quiz, and (4) Sun alert service. First, the My skin menu assessed skin sensitivity and provided advice depending on skin type. Second, the How to be sun smart menu contained videos on sun protection recommendations, detailed information on how to apply sunscreen appropriately (quantity, frequency, SPF, when to apply, where to apply, and guidance on costs), and skin damage information depicted in UV photographs. Third, the Sun safety quiz component engaged participants by answering questions on general principles of sun protection practices, information on positive consequences of sun protection, tanning, vitamin D, and UV index.

    ‎
    Figure 1. Main screen of the mISkin app.
    View this figure

    This involved a gamification component, by which participants received performance-based rewards (ie, positive feedback and a final score message), with immediate feedback on general recommendations for sun protection. Fourth, the Sun alert service menu allowed participants to receive sun protection reminders. The default setting for this feature comprised a minimum of two prompts, but participants could customize these to suit their preferences (eg, times and frequency). This menu also included a self-monitoring feature that recorded sun protection from 11 AM to 3 PM.

    The development of the app was based on evidence [13,14], experts’ knowledge and experience, and user involvement, and the systematic and iterative development process has been detailed elsewhere [15]. The process incorporated both theory and evidence-based approaches outlined by the Medical Research Council framework [17,18], engaging users’ perspectives in the development process of the mISkin app [19,20].

    No Mobile App Control Group

    Participants allocated to the control condition did not receive the mISkin app on their phones.

    Sunscreen Sun Protection Factor

    All participants received two bottles of sunscreen (Ambre Solaire, 200 mL), and they were randomly allocated to receive either SPF 15 or SPF 30. To reflect the current guidelines for sunscreen use [21], the following instructions for sunscreen use were provided to all participants: (1) participant information sheet defined SPF 15 as medium SPF and SPF 30 as high SPF, stating that there is general agreement for the need of sunscreen use with an SPF of 15 or higher (SPF 15+); (2) the sunscreen bottles provided could not be shared with traveling partners; and (3) participants were asked to use the provided sunscreen.

    The sunscreen bottles used in the study had a standard label, providing information on application, other forms of sun protection, dangers of overexposure, and long term prevention of UV-induced skin damage and premature skin ageing.

    Protocol Deviations

    Participant feedback over the course of the trial indicated that random allocation to the distinct SPF strengths was not acceptable. Although the random allocation to sunscreen SPF continued, the protocol was amended to give participants three options: (1) SPF 15, (2) SPF 30, or (3) both. Records were kept about participant allocation acceptance and any request to change allocation.

    Primary Outcomes
    Acceptability and Feasibility

    The primary outcome of the internal pilot trial was to assess the quality and quantity of the delivery of the trial procedures and the mISkin intervention, including (1) acceptability and feasibility of trial procedures—procedures used to recruit holidaymakers, materials provided, meeting arrangements, outcomes assessment, and group allocation and (2) acceptability and fidelity of the intervention—satisfaction and app usage.

    Postholiday, face-to-face interviews were conducted to obtain detailed information regarding acceptability and feasibility of recruitment, allocation, outcome measurement procedures, and intervention components. These interviews were conducted with the first 30 participants involved in the study providing consent to be recruited to the interviews and lasting 8 to 34 min for intervention participants and 3 to 8 min for control. The analyses focused on the general feedback and main issues arising from trial procedures.

    Secondary Outcomes

    This section describes the variables that would be the main outcomes for the definitive trial.

    Mitochondrial Deoxyribonucleic Acid Damage

    Skin damage caused by UV exposure was measured objectively using a reliable epithelial skin swab to test for mitochondrial deoxyribonucleic acid (mDNA) before and after holiday. These samples were taken at baseline and follow-up. Cotton swabs were collected from sterilized skin from the nose bridge and forearm and stored in a sterile collection tube until extraction following standard procedures [22].

    Sunscreen Use

    Participants were given sunscreen bottles with a built-in triaxial accelerometer (AX3; time- and date-stamped) recording sunscreen application. This method has shown to have a sensitivity of 91% and specificity of 98% in detecting sunscreen use events. Due to shortage, sensors were allocated to participants on the basis of availability at baseline (N=28). Sunscreen use (quantity) was also measured by weighing bottles at baseline and posttest. The same scale (Salter, model 1234SSDR) was used for all sunscreen assessments.

    Self-Reported Sun Protection Behaviors

    A web-based self-reported questionnaire with seven items on sun protection was also completed by all participants. This questionnaire assessed exposure times; sunscreen, hat, t-shirt, and sunglasses usage; seeking shade; and experience of sunburn [23].

    Process Variables Assessment

    Participants completed a Web-based questionnaire at baseline and posttest, adapted from previous studies [24-30], assessing knowledge, intentions, attitudes, self-efficacy, social influences, and time perspective (see Multimedia Appendix 3).

    Sample Size

    This study was originally intended to be a full-scale definitive trial. The period until the first 30 participants to enter the study was defined as the internal pilot study.

    Stopping Guidelines

    The following stop rules were defined:

    • If more than 10 out of the first 30 participants do not accept the group allocation, measurement procedures, or other aspects of the trial procedures or if the postholiday interviews identify any significant problems with the acceptability of the trial protocol, the protocol will either be modified to enhance acceptability and feasibility based on the insights gained, or the trial will be discontinued.
    • If during this period no significant problems with acceptability and feasibility are detected, the data from the internal pilot will become part of the main dataset and analyzed as part of the definitive trial.
    • If any major modifications to the protocol needed to be implemented, the data from the internal pilot will not be analyzed alongside the definitive trial.

    Randomization

    A simple randomization was used with a 1:1:1:1 allocation ratio to assign participants to the experimental conditions. This was performed using a telephone-based randomization service provided by a staff member independent and blinded to the identity of individuals. An independent researcher generated and administered the randomization list. Only after baseline assessment were participants assigned to experimental groups.

    Blinding

    At baseline assessment, the outcome assessor was blinded to allocation. At follow-up, assessors were aware of the allocation, and it was hypothesized that outcome assessors could not influence outcome measurements as these were mainly objective. Researchers conducting the lab analyses for skin damage were blinded to allocation, and samples were given a code unrelated to the trial ID. This coding was performed by an independent lab researcher.

    Analytical Methods

    The analyses focused on descriptive data regarding recruitment rates and attrition, as well as acceptability and participants’ satisfaction with the intervention. The main aim was to test whether the proposed protocol was viable for a definitive trial.

    For the secondary outcomes, the focus of the analysis was on data yield and quality. Descriptive statistics are provided for participants’ characteristics and trial outcomes at baseline and follow-up.


    Participants

    A total of 42 participants were recruited from December 2012 to October 2013. Figure 2 shows the flow of participants through the feasibility study. As seen on the flow diagram, there were six protocol deviations.

    Participants’ characteristics and demographics can be found in Table 1. The mean age of the participants was 35.5 years (SD 9.7; N=42), with more women participating (76% [32/42]). The majority of participants reported that they usually burn and tan minimally (35% [15/42]). The most frequent holiday destination was Spain (N=12) and lasting more than 14 days (N=15).

    ‎
    Figure 2. Consolidated Standards of Reporting Trials (CONSORT) diagram for the trial.
    View this figure
    Table 1. Demographics of study participants by group (N=42).
    VariablesSPFa15SPF 30Total

    		mISkin app (N=10)Control (N=9)mISkin app (N=11)Control (N=12)
    Age in years, mean (SD)37.2 (11.2)34.2 (9.1)36.6 (9.3)34.0 (10.1)35.5 (9.7)
    Gender (female), n (%)5 (50)7 (78)9 (81)11 (92)32 (76)
    Skin type, n (%)





    		I—Burns easily, never tans0 (0)0 (0)0 (0)1 (8)1 (3)

    		II—Burns easily, tans minimally3 (30)1 (14)3 (33)3 (25)10 (26)

    		III—Burns and tans moderately2 (20)1 (14)6 (67)5 (42)14 (37)

    		IV—Burns minimally, tans easily4 (40)4 (57)0 (0)2 (17)10 (26)

    		V—Rarely burns, tans profusely1 (10)1 (14)0 (0)0 (0)2 (5)

    		VI—Never burns, tans profusely0 (0)0 (0)0 (0)1 (8)1 (3)

    aSPF: sun protection factor.

    Primary Outcomes for the Internal Pilot Study: Acceptability and Feasibility

    Feasibility of Trial Procedures
    Recruitment

    Out of the 142 participants that registered interest, 42 (29.6%) met the inclusion criteria and provided consent to participate in this study. The main reasons for exclusion were as follows: (1) ineligible smartphone (eg, iPhone; 21.8% [31/142]) and (2) unwillingness to be randomized to SPF 15 or SPF 30 (3.5% [5/142]).

    Randomization

    Two breaches in the trial protocol occurred, as 2 participants were allocated to receive the mISkin app but were unable to install it because of smartphone technical issues.

    Outcome Assessment

    All participants consenting to participate in the study completed baseline and follow-up assessments.

    Mitochondrial Deoxyribonucleic Acid Skin Damage

    The skin swabs were obtained for all participants at both time points. Data on mDNA skin damage for the nose was retrieved from 34 (81% [34/42]) samples at baseline and 33 (79% [33/42]) at follow-up. Data were available for 31 (74% [31/42]) samples at baseline and 36 (86% [36/42]) at follow-up for the arm. Two reasons explain these missing data: (1) polymerase chain reaction analyses could not be computed (4.2% [7/168]; the total number of mDNA samples was 168, as a total of four samples were taken from each participant [nose and arm; before and after holiday]) and (2) samples were mislabeled during analyses and therefore lost when decoding (16.1% [27/168]).

    Residual Sunscreen Weight

    Sunscreen weight was available for 41 out of 42 participants at both baseline and follow-up. For one participant, a value could not be obtained because of a fault in the scale used.

    Sunscreen Use Patterns (Accelerometry)

    AX3 sensors measuring sunscreen-use events were allocated to only 28 participants out of 42 participants because of a lack of sensors at baseline. Reliable data detecting sunscreen use was extracted from 28 participants. Due to battery issues, data were missed at the end of the holiday period for 14 participants. Battery life lasts approximately 14 days, but sometimes the time between the initial assessment and the postholiday assessment was longer.

    Self-Reported Sunburn and Sun Protection Practices

    The survey was completed at baseline by 38 participants (90% [38/42]) and at follow-up by 41 participants (98% [41/42]).

    Acceptability of Trial Procedures

    A total of 30 interviews were conducted (mISkin app: N=13, no app: N=17), and data were collected about three main areas: consent, allocation to interventions, and assessment.

    Consent

    All participants stated that information received before or during enrollment was easy to understand and clear. All participants were also very positive about the arrangements made for the assessment meetings.

    Allocation to Interventions

    Participants were satisfied with being randomized to the mISkin app or control group. App installation was not possible because of technical difficulties in two cases. The randomized group allocation to SPF 15 versus SPF 30 was not acceptable to many participants. A total of 11 participants raised concerns about the random allocation to sunscreen SPF. From this, 10 were unwilling to be randomly allocated to SPF 15, as it was considered to be too low. Only one participant raised concerns about SPF 30 being too high. Overall, 7 people declined participation based on the random allocation to SPF.

    Taking into account this information, after the initial 16 participants, the trial procedures were changed to give participants the option to choose from three options: (1) SPF 15, (2) SPF 30, or (3) both. With the introduction of this change, 6 participants chose a different SPF to what they had been allocated to: 3 participants asked to change allocation to SPF 30 instead of SPF 15, 1 participant asked to change allocation to SPF 15 instead of SPF 30, and 2 participants asked for one bottle of each.

    Outcome Assessment

    The main findings for secondary outcomes with descriptive data for the total sample at baseline and follow-up can be seen in Multimedia Appendix 4.

    Mitochondrial Deoxyribonucleic Acid Skin Damage

    The skin swabs procedure was described as painless and made easy by the provision of information detailing the procedure. Some participants reported that it might be helpful to mention that the swabs would remove makeup.

    Sunscreen Use Patterns (Accelerometry)

    Participants indicated that they did not experience problems carrying the AX3 sensors attached to the sunscreen bottle. A total of 5 participants (18% [5/28]) mentioned, though, that their silicone band snapped, which in some cases led to problems in calculating data events. To overcome this, when possible, participants were given an extra silicone band and were instructed on how to fit it.

    Self-Reported Sun Protection Behaviors and Psychological Variables

    Questionnaires were described as being straightforward, easy to understand, and the length was considered acceptable. One participant mentioned that some questions were difficult to understand, in particular questions about social norms and skin color.

    Acceptability of the mISkin App Intervention

    A total of 13 participants were interviewed to collect data on acceptability of the mISkin app. However, one interview was lost because of recording problems.

    Data collected showed that 6 out of the 12 holidaymakers were very satisfied with the app, 4 were somehow satisfied, and 2 were dissatisfied. All participants commented and made suggestions to improve the app (Multimedia Appendix 5).

    Participants were highly satisfied with the initial skin type identification, the videos, and the Sun safety quiz. Participants suggested that the Sun alert service could be improved by having a system that is able to learn from participants’ sun protection habits, preferences, personal risk, and personalize prompts according to these (eg, time until sunburn risk). A few technical problems regarding the GPS functionality to detect indoor or outdoor location were also reported. Participants also recommended that the UV level forecast should be integrated with the Sun alert service to create a parsimonious system. Another reported issue was the disturbance created by keeping the phone on British time (Greenwich Mean Time) so that the sensor data could be synchronized with the app log usage data. This was described as disruptive, as time shown on the phones was incorrect and led to prompts not being received appropriately.

    Acceptability of the Sunscreen Sun Protection Factor

    One participant allocated to SPF 15 reported being slightly sunburnt at the beginning of the holiday. Some participants allocated to SPF 30 mentioned that using this SPF prevented them from being sunburnt. Others also reported the lack of a tan after their holidays as a consequence of using SPF 30. Participants felt that they used more sunscreen than they would normally (n=7). Two participants reported using sunscreens other than the ones provided.

    Fidelity: mISkin App Usage

    Data about the usage of the app can be seen in Table 2. A total of 19 participants (91% [19/21]) installed the mISkin on their phones, and 18 (86% [18/21]) used it at least once during holidays (ie, logging and utilized of the app features). Rates of usage were high, with a median of 60 log-in events. The median number of cues acknowledged by participants was 9 (range: 0-43). The Sun safety quiz was completed by 17 participants (81%). The median number of ecological momentary assessments completed was 2 (range: 0-11).

    Optimization of the Trial Procedures

    The problems identified and potential changes to the trial protocol are presented in Table 3. The main change introduced was the possibility of participants choosing their SPF: (1) SPF 15, (2) SPF 30, or (3) both.

    Reasons for Stopped Trial

    Modification and potential improvements have been recorded in Table 3, following guidelines to produce an informed decision on the internal pilot trial [31]. Evidence gathered during the internal pilot study identified significant problems influencing acceptability and feasibility of the internal pilot that led to stop the trial early, namely the SPF allocation and improvements to the app. The trial was stopped in October 2013, and a definitive trial on the mISkin app has not been conducted. The study was part of a PhD thesis [32], and funding ran out to relaunch the new protocol.

    Table 2. Descriptive statistics about the mISkin app usage.
    mISkin app featuresDescriptive statistics

    		FrequenciesMedianInterquartile rangeMaximumMinimum
    Log-in events—60631813
    Ecological Momentary Assessments—24110
    Cues received—1712470
    Cues acknowledged—97430
    Videos watched—0570
    Videos (any), n (%)9 (47)————
    Video “Protecting sensitive skin,” n (%)6 (32)————
    Video “Sun protection tips,” n (%)5 (26)————
    Video “Choosing a good sunscreen,” n (%)7 (37)————
    Video “How to apply sunscreen,” n (%)8 (42)————
    Video “Preventing damage,” n (%)7 (37)————
    Video “Protecting children,” n (%)6 (32)————
    Video “Other’s use of sun protection,” n (%)3 (16)————
    Sun safety quiz, n (%)17 (81)————
    Table 3. Main problems and changes introduced to the trial protocol.
    Trial procedures and problemsChanges introduced during pilot studySuggestions for definitive trial
    Recruitment

    		Initial low recruitment rateRecruitment was scaled up (eg, by involving local councils), and holiday duration was enlarged to 3 weeks.Alternative pathways for recruitment, such as pharmacies where people buy their holiday medicines.



    		mISkin app to be available in different platforms (ie, iPhone operating system)

    		mISkin app installation problemsStandard operating procedure (SOP) was changed to fully check participants’ smartphone suitability for the mISkin app installation before the randomization procedure.—
    Measurement

    		Samples lost during blinding procedureSkin swabs blinding SOP was changed to ensure that trial number can be fully retrieved by keeping the original skin swab package where both trial number and new labeling is written.—

    		Samples lost because of incorrect labeling during analysesSkin swabs samples labeling SOP during lab analyses was changed to ensure samples have a more meaningful label (ie, date plus numbers from labeling procedure will not conducted more than 24 samples per day). SOP also now recommends that lab analyses are conducted in sets of 24 samples to prevent tiredness of the researcher and potential mistakes.—

    		Loss of accelerometer data on final days of holiday—Important to keep the time between baseline and follow-up assessments constant as battery life of accelerometers only lasts up to 14 days.
    Randomization

    		Random allocation to SPF 15 or SPF 30 reported as problematicSOP and materials were changed to give participants the possibility to choose form three options: (1) two bottles of SPF 15, (2) two bottles of SPF 30, or (3) one bottle of SPF 15 and one bottle of SPF 30.A preference design trial might be appropriate. Alternatively participants could be given the possibility of buying their own sunscreen (eg, voucher for high-street retailer).
    Intervention

    		The need to keep phone time on British time (Greenwich Mean time) reported as problematicSOP was changed to allow participants to keep their time preference on their smartphone. Data from sensors will be analyzed taking into account details provided by participants on the holiday location and local time.—

    		Suggested changes to mISkin app (interviews)—Improve Sun alert service by having a system that is able to learn participants’ sun protection habits and preferences.



    		Ultraviolet levels forecast information should be integrated with the Sun alert service.

    Principal Findings

    This study described an internal pilot study aimed at testing acceptability and feasibility of the trial procedures and the mISkin app. The internal pilot study revealed potential issues on participant recruitment, acceptability of the randomization to participants, and features of the intervention. A list of possible solutions to the problems identified within pilot and feasibility RCT was mapped (Table 3) following the algorithm for  decision making after pilot and feasibility trials guidelines [33].

    Despite most trial procedures being considered acceptable and feasible, the random allocation to SPF 15 versus SPF 30 was found not to be feasible in a definitive trial protocol. During the internal pilot, the SPF allocation procedures were modified to improve acceptability of participants’ allocation. A preference design trial based on a participant’s preference regarding sunscreen SPF could be a possible solution for a definitive trial.

    Regarding the feasibility of recruitment, this was limited by the inclusion requirement to own an Android smartphone. Several participants were excluded because they owned other smartphones, showing the need to improve the interoperability of the mISkin app in a definitive trial. The relatively low rate of recruitment could also be improved by diversifying the pathways of recruitment (eg, pharmacies).

    The key issue reported about the mISkin app was the Sun alert service, and future revisions of the app should consider improving this feature. The need for more intelligent and interactive systems has been reported previously [34]. The study by Buller and colleagues [35] also shows that participants were interested in a system that would (1) display how long they could be exposed to the sun without burning (including vitamin D synthesis), (2) show daily UV levels, (3) advice on recommended SPF, and (4) send prompts to reapply sunscreen. Nevertheless, such a system would need to tackle some of the uncertainties related to vitamin D synthesis and sunscreen use. The estimation of time needed to synthesize vitamin D is a complex and challenging calculation influenced by various factors, including skin type, age, body fat, genetic factors, lifestyle, sun protection, solar zenith angle, and atmospheric conditions [36,37]. For sunscreen, most calculations rely on the assumption that people apply the recommended amount (2 mg of sunscreen per cm2of skin surface) to achieve the labeled protection [38,39]. However, evidence suggests that individuals tend to apply less than the recommended amount [14,40], dramatically reducing its protective features. In addition, NICE [41] does not recommend any specific amount of sunlight exposure to stimulate vitamin D production, only stating that longer periods of exposure may be needed for those with darker skin [21].

    Comparison With Other Studies

    Sun protection information delivered via a purpose-designed mobile phone app was feasible, attractive, and convenient, and usage was high with 86% using it at least once during holidays. Users were particularly interested in the Sun alert service, highlighting the value of receiving prompts and advice in convenient place (eg, holiday setting). These findings, although preliminary, are very promising and align with those found in other investigations of mobile apps to promote sun protection, in which usage and acceptability have been similarly demonstrated [11,12,35]. The systematic and iterative development of the app [15] and the theory-driven nature of the app [42], including active components shown to be key in interventions promoting sun protection [13], may have led to greater usage. Further research is required to assess whether the mISkin app can successfully change sun protection behaviors and to identify factors that can contribute to the uptake of the app. As it is easy and convenient to receive advice, delivering sun protection information via a mobile phone app is a promising alternative or addition to existing skin cancer prevention interventions.

    Overall, sunscreen use was low in this study, with an average daily use of 14.46 g. This is a special concern if the average exposure time of 5.36 hours per day is taken into consideration. The guideline for sunscreen application thickness is 2 mg/cm2 [43]. According to Diffey [44], a full body application will consist of 35 g of the sunscreen (ie, one-third of a bottle). In line with our findings, a study conducted by Nicol and colleagues [40], with 364 beachgoers, shows that the daily amount of sunscreen used was 7.67 g/day and 9.33 g/day for the intervention groups. Rodrigues and colleagues [14] also showed that participants used less than the recommended sunscreen amount (1.34 mg/cm2) in an experimental setting. Future preventive strategies should provide more explicit instructions of sunscreen application thickness, possibly relating to practical examples (eg, “as much as a golf ball or a full shot glass” for whole body coverage).

    Even though the use of gamification within the mISkin app is original, more efforts could be made to make this feature more engaging. Gamification can be defined as the use of gaming elements in a nongaming context to foster motivation [45]. Two core ingredients of gamification (linked to behavior change techniques) were used in the mISkin app: reinforcement and progress comparison. A key aspect of gamification is the concept of rewards that promote continuous participation, promoting not only engagement, but also behavior change [46]. Gamification applied to digital health has the potential to make the interventions more fun and engaging [45]. Recent findings have shown the potential of health apps to change behavior though gamification [47-49]. The current quiz has a set of questions that, despite allowing participants to go through it several times, does not change. A possible way to make this more attractive and further “gamify” would be to use gaming principles more systematically, such as allowing users to gain points every time they reapply sunscreen; or engage with app features; or by gradually increase the difficulty of the quiz (ie, different levels to increase challenge) [50].

    Strengths and Limitations

    This paper describes the efforts in addressing the main challenges identified in a previous systematic review on sun protection interventions: (1) poor reporting of intervention development, design, and contents; (2) poor outcome measurement; and (3) poor study methodology [13]. The tested intervention was developed based on the most recent evidence base available [13,14], and the development process followed a systematic approach, with a thorough report of the process and description of intervention [15]. In addition, the use of digital technologies followed the most recent advances in the area of behavioral science, with a close involvement of users in the design and development of the app [51]. The use of a combination of biologic, technological, and self-report outcome measures to understand and assess sun protection also provided a step forward in the field. Finally, the mISkin intervention was subject to intensive pilot testing, following the preregistered methods of a definitive trial. The methodology implemented aims to reduce the risk of bias by using robust procedures of blinding, allocation concealment, and intention to treat.

    The process evaluation alongside the internal pilot trial is also a strength, as it provides relevant information on the mISkin intervention acceptability and how the trial procedures could be enhanced. However, the findings should be interpreted in the context of the study limitations given the nature of the study (ie, feasibility study), and some caution should be taken in generalizing these results.

    The feedback on the app and trial procedures was collected through face-to-face interviews and could have introduced bias to the self-reported acceptability of the intervention and trial procedures. The possibility of measurement reactivity was also a concern, especially considering the comprehensive list of self-reported outcomes used. A recent systematic review on the topic [52] did not find any study assessing question-behavior effect on sun protection behavior and concluded that the “question-behavior effect” on health-related behavior is small and was therefore not considered when designing the protocol.

    The amount of sunscreen provided might have not been enough, as it is possible that participants inferred (incorrectly) that by giving them 2 bottles (2 x 200 mL) this amount would be sufficient for their whole holiday, and therefore they tried to eke it out. The app highlighted that sunscreen should not be the first line of defense and targeted other forms of sun protection, such as wearing protective clothes and avoiding sun exposure at midday [4].

    For practical reasons and resources available at the time of this study, the UV photos shown in the mISkin app were not personalized. Recent evidence suggests the importance of appearance-based beliefs and how interventions should aim at tackling those by showing personalized UV photos that depict damage [13,53,54]. Future studies should explore whether the effects of visualizing nonpersonalized UV photos are equivalent to personalized UV photos.

    Unfortunately, this study faced considerable challenges in recruitment. Despite several attempts to involve high-street travel agencies and the local airport, the involvement of a gatekeeper to facilitate the access to holidaymakers was unsuccessful. It took several contacts to reach the relevant decision makers, and many highlighted that the aim of the study to promote sun protection would conflict with their products. This is consistent with other studies that have encountered similar difficulties when involving tourism industries [55,56].

    Conclusions

    This paper summarizes an internal pilot and feasibility RCT, testing the acceptability and feasibility of the trial procedures and the newly developed mISkin app. The evidence-based intervention was highly acceptable to participants, but the recruitment strategy and allocation to SPF 15 versus 30 were not feasible. This pilot study offers potential solutions to inform the trial procedures of a future trial and to improve the mISkin app, namely the possibility of participants choosing their sunscreen SPF, using alternative pathways to recruit holidaymakers (ie, pharmacies), and upgrading the interoperability of the mISkin app.

    Acknowledgments

    The work described in this paper was funded by a PhD fellowship from the Portuguese Science and Technology Foundation (FCT; Reference: SFRH/BD/60392/2009). AMR and FFS were funded by Fuse, the Centre for Translational Research in Public Health, a UK Clinical Research Collaboration Public Health Research Centre of Excellence based on funding from the British Heart Foundation, Cancer Research UK, the Economic and Social Research Council, Medical Research Council, and the National Institute for Health.

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix 1

    Schedule of events for the trial, including enrolment, interventions, and outcome assessments.

    PDF File (Adobe PDF File), 33KB
    ‎

    Multimedia Appendix 2

    Template for Intervention Description and Replication checklist.

    PDF File (Adobe PDF File), 36KB
    ‎

    Multimedia Appendix 3

    Web-based questionnaire.

    PDF File (Adobe PDF File), 89KB
    ‎

    Multimedia Appendix 4

    Main findings for secondary outcomes with descriptive data.

    PDF File (Adobe PDF File), 60KB
    ‎

    Multimedia Appendix 5

    Feedback on the mISkin app provided by participants in the internal pilot study.

    PDF File (Adobe PDF File), 63KB
    ‎

    Multimedia Appendix 6

    CONSORT‐EHEALTH checklist (V 1.6.1).

    PDF File (Adobe PDF File), 525KB
    1. Cancer Research UK. Cancer Research UK. 2013. Skin cancer facts   URL: http://www.cancerresearchuk.org/about-cancer/causes-of-cancer/sun-uv-and-cancer/skin-cancer-facts [accessed 2018-02-16] [WebCite Cache]
    2. Cancer Research UK. Cancer Research UK. 2016. Skin cancer statistics   URL: http:/​/www.​cancerresearchuk.org/​health-professional/​cancer-statistics/​statistics-by-cancer-type/​skin-cancer [accessed 2018-02-16] [WebCite Cache]
    3. Mitchell-Box K, Braun KL. Fathers' thoughts on breastfeeding and implications for a theory-based intervention. J Obstet Gynecol Neonatal Nurs 2012;41(6):E41-E50. [CrossRef] [Medline]
    4. Armstrong BK, Kricker A. The epidemiology of UV induced skin cancer. J Photochem Photobiol B 2001 Oct;63(1-3):8-18. [Medline]
    5. English DR, Armstrong BK. Identifying people at high risk of cutaneous malignant melanoma: results from a case-control study in Western Australia. Br Med J (Clin Res Ed) 1988 May 07;296(6632):1285-1288 [FREE Full text] [Medline]
    6. The British Skin Foundation. The British Skin Foundation. 2011. Responde to NICE about skin cancer Guidance   URL: http://www.bad.org.uk//site/734/default.aspx [accessed 2018-02-16] [WebCite Cache]
    7. Cancer Research UK. Cancer Research UK. 2013. Advice for tour operators   URL: http://www.sunsmart.org.uk/advice-and-prevention/touroperators/ [accessed 2018-02-16] [WebCite Cache]
    8. World Health Organisation. WHO. 2002. Sun protection: an essential element of health-promoting schools   URL: http://www.who.int/hpr/gshi/ [accessed 2018-02-16] [WebCite Cache]
    9. de Vries E, Coebergh JW. Cutaneous malignant melanoma in Europe. Eur J Cancer 2004 Nov;40(16):2355-2366. [CrossRef] [Medline]
    10. Finch L, Janda M, Loescher LJ, Hacker E. Can skin cancer prevention be improved through mobile technology interventions? a systematic review. Prev Med 2016 Sep;90:121-132. [CrossRef] [Medline]
    11. Buller DB, Berwick M, Lantz K, Buller MK, Shane J, Kane I, et al. Smartphone mobile application delivering personalized, real-time sun protection advice: a randomized clinical trial. JAMA Dermatol 2015 May;151(5):497-504 [FREE Full text] [CrossRef] [Medline]
    12. Buller DB, Berwick M, Lantz K, Buller MK, Shane J, Kane I, et al. Evaluation of immediate and 12-week effects of a smartphone sun-safety mobile application: a randomized clinical trial. JAMA Dermatol 2015 May;151(5):505-512 [FREE Full text] [CrossRef] [Medline]
    13. Rodrigues A, Sniehotta FF, Araujo-Soares V. Are interventions to promote sun-protective behaviors in recreational and tourist settings effective? a systematic review with meta-analysis and moderator analysis. Ann Behav Med 2013 Apr;45(2):224-238. [CrossRef] [Medline]
    14. Rodrigues AM, Sniehotta FF, Birch-Machin MA, Araujo-Soares V. Aware, motivated and striving for a 'safe tan': an exploratory mixed-method study of sun-protection during holidays. Health Psychol Behav Med 2017 Jun;5(1):276-298 [FREE Full text] [CrossRef] [Medline]
    15. Rodrigues AM, Sniehotta FF, Birch-Machin MA, Olivier P, Araújo-Soares V. Systematic and iterative development of a smartphone app to promote sun-protection among holidaymakers: design of a prototype and results of usability and acceptability testing. JMIR Res Protoc 2017 Jun 12;6(6):e112 [FREE Full text] [CrossRef] [Medline]
    16. Controlled-trials.: Current Controlled Trials, c/o BioMed Central; 2013. A factorial randomised controlled trial of the mISkin smartphone intervention and sunscreen with SPF 15 vs. SPF 30 to prevent epidermal DNA skin damage amongst holidaymakers   URL: http://www.controlled-trials.com/isrctn/pf/63943558 [accessed 2018-02-16] [WebCite Cache]
    17. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new medical research council guidance. BMJ 2008 Sep 29;337(sep29 1):a1655. [CrossRef]
    18. Peter C, Paul D, Sally M, Susan M, Irwin N, Mark P. Developing and evaluating complex interventions: an introduction to the new Medical Research Council guidance. In: Killoran A, Kelly M, editors. Evidence-based Public Health: Effectiveness and efficiency. Oxford: Oxford Scholarship Online; 2010.
    19. Eun-Ok B, Kursat C, Elizabeth B, Theodore F. User-centered design and development. In: Spector MJ, Merrill DM, Elen J, Bishop MJ, editors. Handbook of research on educational communications and technology. New York: Lawrence Erlbaum Associates; 2008:659-670.
    20. Yardley L, Morrison L, Bradbury K, Muller I. The person-based approach to intervention development: application to digital health-related behavior change interventions. J Med Internet Res 2015 Jan;17(1):e30 [FREE Full text] [CrossRef] [Medline]
    21. NICE. NICE. 2016. Sunlight exposure: risks and benefits   URL: https://www.nice.org.uk/guidance/ng34/ [accessed 2018-02-16] [WebCite Cache]
    22. Harbottle A, Maki J, Reguly B, Wittock R, Robinson K, Parr R, et al. Real-time polymerase chain reaction analysis of a 3895-bp mitochondrial DNA deletion in epithelial swabs and its use as a quantitative marker for sunlight exposure in human skin. Br J Dermatol 2010 Dec;163(6):1291-1295. [CrossRef] [Medline]
    23. Glanz K, Yaroch AL, Dancel M, Saraiya M, Crane LA, Buller DB, et al. Measures of sun exposure and sun protection practices for behavioral and epidemiologic research. Arch Dermatol 2008 Feb;144(2):217-222. [CrossRef] [Medline]
    24. Mitchell-Box K, Braun KL. Fathers' thoughts on breastfeeding and implications for a theory-based intervention. J Obstet Gynecol Neonatal Nurs 2012;41(6):E41-E50. [CrossRef] [Medline]
    25. Bandura A. Social cognitive theory: an agentic perspective. Annu Rev Psychol 2001;52(1):1-26. [CrossRef] [Medline]
    26. Mahler HI, Kulik JA, Gibbons FX, Gerrard M, Harrell J. Effects of appearance-based interventions on sun protection intentions and self-reported behaviors. Health Psychol 2003 Mar;22(2):199-209. [Medline]
    27. Jackson KM, Aiken LS. A psychosocial model of sun protection and sunbathing in young women: the impact of health beliefs, attitudes, norms, and self-efficacy for sun protection. Health Psychol 2000 Sep;19(5):469-478. [Medline]
    28. Adams J. Consideration of immediate and future consequences, smoking status, and body mass index. Health Psychol 2012 Mar;31(2):260-263. [CrossRef] [Medline]
    29. Orbell S, Kyriakaki M. Temporal framing and persuasion to adopt preventive health behavior: moderating effects of individual differences in consideration of future consequences on sunscreen use. Health Psychol 2008 Nov;27(6):770-779. [CrossRef] [Medline]
    30. Schüz N, Schüz B, Eid M. Adding perspective: predicting adolescent sunscreen use with an extended health action process approach. Appl Psychol Health Well Being 2016 Jul;8(2):155-171. [CrossRef] [Medline]
    31. Charlesworth G, Burnell K, Hoe J, Orrell M, Russell I. Acceptance checklist for clinical effectiveness pilot trials: a systematic approach. BMC Med Res Methodol 2013 Jun 13;13:78 [FREE Full text] [CrossRef] [Medline]
    32. Rodrigues AM. NCL. 2014. Systematic development of a behavioural intervention to promote sun-protection behaviours amongst holidaymakers   URL: https://theses.ncl.ac.uk/dspace/bitstream/10443/2569/1/Rodrigues%2C%20A.%202014.pdf [accessed 2018-02-20] [WebCite Cache]
    33. Bugge C, Williams B, Hagen S, Logan J, Glazener C, Pringle S, et al. A process for decision-making after pilot and feasibility trials (ADePT): development following a feasibility study of a complex intervention for pelvic organ prolapse. Trials 2013 Oct 25;14:353 [FREE Full text] [CrossRef] [Medline]
    34. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res 2013 Apr;15(4):e86 [FREE Full text] [CrossRef] [Medline]
    35. Buller DB, Berwick M, Shane J, Kane I, Lantz K, Buller MK. User-centered development of a smart phone mobile application delivering personalized real-time advice on sun protection. Transl Behav Med 2013 Sep;3(3):326-334 [FREE Full text] [CrossRef] [Medline]
    36. Faurschou A, Beyer DM, Schmedes A, Bogh MK, Philipsen PA, Wulf HC. The relation between sunscreen layer thickness and vitamin D production after ultraviolet B exposure: a randomized clinical trial. Br J Dermatol 2012 Aug;167(2):391-395. [CrossRef] [Medline]
    37. Rhodes L. NICE. 2015. Sunlight-induced vitamin D synthesis   URL: https:/​/www.​nice.org.uk/​guidance/​ng34/​evidence/​expert-paper-5-sunlightinduced-vitamin-d-synthesis-pdf-2311152881 [accessed 2018-02-16] [WebCite Cache]
    38. Faurschou A, Wulf HC. Ecological analysis of the relation between sunbeds and skin cancer. Photodermatol Photoimmunol Photomed 2007 Aug;23(4):120-125. [CrossRef] [Medline]
    39. Schalka S, Dos Reis VM, Cucé LC. The influence of the amount of sunscreen applied and its sun protection factor (SPF): evaluation of two sunscreens including the same ingredients at different concentrations. Photodermatol Photoimmunol Photomed 2009 Aug;25(4):175-180. [CrossRef] [Medline]
    40. Nicol I, Gaudy C, Gouvernet J, Richard MA, Grob JJ. Skin protection by sunscreens is improved by explicit labeling and providing free sunscreen. J Invest Dermatol 2007 Jan;127(1):41-48 [FREE Full text] [CrossRef] [Medline]
    41. National Institute for Health and Care Excellence. 2016. Vitamin D deficiency in adults - treatment and prevention   URL: https://cks.nice.org.uk/vitamin-d-deficiency-in-adults-treatment-and-prevention#!topicsummary [WebCite Cache]
    42. Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health 2011 Nov;26(11):1479-1498. [CrossRef] [Medline]
    43. British Association of Dermatologists. British Association of Dermatologists. 2013. Sunscreen factsheet   URL: http://www.bad.org.uk/desktopDefault.aspx?TabId=734 [accessed 2018-02-16] [WebCite Cache]
    44. Diffey BL. People do not apply enough sunscreen for protection. BMJ 1996 Oct 12;313(7062):942. [CrossRef]
    45. Cugelman B. Gamification: what it is and why it matters to digital health behavior change developers. JMIR Serious Games 2013 Dec;1(1):e3 [FREE Full text] [CrossRef] [Medline]
    46. Nour M, Yeung SH, Partridge S, Allman-Farinelli M. A narrative review of social media and game-based nutrition interventions targeted at young adults. J Acad Nutr Diet 2017 May;117(5):735-52.e10 [FREE Full text] [CrossRef] [Medline]
    47. Miller AS, Cafazzo JA, Seto E. A game plan: gamification design principles in mHealth applications for chronic disease management. Health Informatics J 2016 Jun;22(2):184-193. [CrossRef] [Medline]
    48. King D, Greaves F, Exeter C, Darzi A. 'Gamification': influencing health behaviours with games. J R Soc Med 2013 Mar;106(3):76-78. [CrossRef] [Medline]
    49. Lister C, West JH, Cannon B, Sax T, Brodegard D. Just a fad? gamification in health and fitness apps. JMIR Serious Games 2014 Aug;2(2):e9 [FREE Full text] [CrossRef] [Medline]
    50. Hale AR, Young VL, Grand A, McNulty CA. Can gaming increase antibiotic awareness in children? a mixed-methods approach. JMIR Serious Games 2017 Mar 24;5(1):e5 [FREE Full text] [CrossRef] [Medline]
    51. Pagoto S, Bennett GG. How behavioral science can advance digital health. Transl Behav Med 2013 Sep;3(3):271-276 [FREE Full text] [CrossRef] [Medline]
    52. Rodrigues AM, O'Brien N, French DP, Glidewell L, Sniehotta FF. The question-behavior effect: genuine effect or spurious phenomenon? a systematic review of randomized controlled trials with meta-analyses. Health Psychol 2015 Jan;34(1):61-78. [CrossRef] [Medline]
    53. Dodd LJ, Forshaw MJ. Assessing the efficacy of appearance-focused interventions to prevent skin cancer: a systematic review of the literature. Health Psychol Rev 2010 Sep;4(2):93-111. [CrossRef]
    54. Williams AL, Grogan S, Clark-Carter D, Buckley E. Appearance-based interventions to reduce ultraviolet exposure and/or increase sun protection intentions and behaviours: a systematic review and meta-analyses. Br J Health Psychol 2013 Feb;18(1):182-217. [CrossRef] [Medline]
    55. Buller DB, Andersen PA, Walkosz BJ, Scott MD, Beck L, Cutter GR. Rationale, design, samples, and baseline sun protection in a randomized trial on a skin cancer prevention intervention in resort environments. Contemp Clin Trials 2016 Jan;46:67-76 [FREE Full text] [CrossRef] [Medline]
    56. Buller DB, Andersen PA, Walkosz BJ, Scott MD, Beck L, Cutter GR. Effect of an intervention on observed sun protection by vacationers in a randomized controlled trial at North American resorts. Prev Med 2017 Jun;99:29-36 [FREE Full text] [CrossRef] [Medline]

    ‎
    AX3: triaxial accelerometer
    GPS: global positioning system
    mDNA: mitochondrial deoxyribonucleic acid
    NICE: National Institute for Health and Care Excellence
    RCT: randomized controlled trial
    SMS: short message service
    SPF: sun protection factor
    UV: ultraviolet

    Edited by G Eysenbach; submitted 01.08.17; peer-reviewed by J Makin, D Buller; comments to author 12.10.17; revised version received 15.12.17; accepted 29.01.18; published 27.02.18

    Copyright

    ©Angela M Rodrigues, Falko F Sniehotta, Mark A Birch-Machin, Patrick Olivier, Vera Araújo-Soares. Originally published in JMIR Dermatology (http://derma.jmir.org), 27.02.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Dermatology Research, is properly cited. The complete bibliographic information, a link to the original publication on http://derma.jmir.org, as well as this copyright and license information must be included.