Evaluating the tolerability and acceptability of an alcohol-based hand rub – real-life experience with the WHO protocol
Antimicrobial Resistance and Infection Controlvolume 4, Article number: 18 (2015)
Optimizing user satisfaction with alcohol-based hand rubs (ABHR) may be vital to enhance hand hygiene performance. This study tested the tolerability and acceptability of a new ABHR (EVO9; Ecolab) in healthcare workers under daily working conditions and evaluated the practicability of the corresponding WHO protocol.
We strictly applied the WHO single product ABHR evaluation protocol. A trained observer assessed hand skin conditions of healthy volunteers using at least 30 ml ABHR per day during their clinical work at baseline, day 3–5 and one month (visit 1–3). Participants rated ABHR tolerability and acceptability at visit 2 and 3. Additionally, we registered study time for participants and study team.
Among 46 volunteers, 76% were female; 37% nurses, 28% physicians. Skin was observer-rated “not” or “incidentally” dry in 64.4%, 77.8%, and 90.9% participants at visit 1, 2, and 3, respectively. EVO9 was scored ≥5 (progressive scale, 1–7) for appearance, intactness, moisture content, and sensation by 95.7%, 97.7%, 88.9%, and 97.8% participants at visit 3, respectively. All WHO benchmarks were exceeded except for “speed of drying” at visit 2, and “texture” at visit 2 and 3. Cumulative study time expenditure was 14 days for the observer and four days for participants.
EVO9 was well tolerated and accepted according to the WHO single ABHR evaluation protocol with the potential for improvement for stickiness. The WHO protocol is feasible but requires considerable time and logistics. It does not preclude bias, in this case especially due to the necessary switch to personal dispensers.
The World Health Organisation (WHO) ‘Guidelines on Hand Hygiene in Healthcare’ were issued by WHO Patient Safety in May 2009 on the occasion of the launch of the “Save Lives: Clean Your Hands” initiative . Since publication of the guidelines there has been convincing evidence of an improvement in hand hygiene (HH) practices and that, in turn, has resulted in a reduction of hospital acquired infections and/or transmission of multidrug-resistant organisms [2-6]. The WHO suggests five avenues of action as a multimodal strategy of which system change, i.e. facilitated access to well-tolerated alcohol-based handrub (ABHR), is one component.
However, not all initiatives to improve HH are successful and, sustaining high levels of HH compliance among health care personnel are ambitious goals [7,8]. Some of the self-reported reasons given for failing to correctly apply hand cleansing include lack of time, inconveniently located and/or scarcity of facilities, forgetfulness, and agents that cause skin irritations and dryness . In fact, skin tolerability has been reported as one of the main reasons for disinclination towards HH [10-12].
User's acceptance and good skin tolerability are therefore considered being among the most important criteria for the selection of an ABHR . Thus, a product that is pleasant to use with no harmful effect to the hands is a major asset for the promotion of optimal hand hygiene practices.
The WHO provides and promotes the application of two study protocols to evaluate the acceptability and tolerability of an ABHR: “Method 1” for testing a single product planned to be introduced, “Method 2” for comparing two different products [13-15].
The aim of this study was to investigate the tolerability and acceptability of a new ABHR (EVO9; Ecolab) in healthcare workers by using an established WHO protocol, to report the experience with this protocol under real life conditions, and to exemplarily quantify the effort necessary to conduct such a formal evaluation. The study ABHR has successfully been tested according to the European Norm EN1500 and EN12791 and has been registered with Swissmedic under the registration number CHZN3080.
Study setting and protocol
The study was conducted between May and July 2013 at the Division of Infectious Diseases and Infection Control, University Hospital Zurich, Zurich, Switzerland. The methodology was based on the published WHO protocol “Method 1 for Evaluation of tolerability and acceptability of alcohol-based hand rub in use or planned to be introduced” . Three minor modifications were made to the WHO protocol: skin type was assessed with by observer according to Fitzpatrick skin sensitivity type (and not self-assessed by participant), participants were allowed to continue their usual hand care products during the whole study period, and a question on product accessibility was added.
The study was carried out in healthy adults of ≥18 years of age. Participants were not allowed to have significant skin or systemic disease or any intolerance to any component of the test preparation. The observer was a medical doctor (AW) trained by an expert who participated in establishing and validating the WHO protocol (MNC, see acknowledgements).
Study design and endpoints
Each participant received the test product in a 100 ml personal dispenser. Three visits took place: a baseline visit 1 at day 0, visit 2 between day 3 and 5 of product use, visit 3 at the study end after one month of product use.
The quantity of product used was measured at visit 2 and 3 to assure a minimal mean daily use of at least 30 ml of the test product.
The primary endpoint was the observer assessment of skin condition of the participants’ hands using validated scales with higher scores meaning worse conditions including the items redness (score, 0–4), scaliness (0–3), fissures (0–3), and visual scoring of skin (1–5). This primary endpoint was evaluated at all three study visits .
Secondary endpoints were participant assessment of skin tolerability on a rating scale 1–7 including the items appearance, intactness, moisture content, and sensation (all, ‘abnormal’-‘normal’) and overall skin integrity (‘very altered’-‘perfect’) and product acceptability including the items color (‘unpleasant’-‘pleasant’), smell (‘unpleasant’-‘pleasant’), texture (‘very sticky’-‘not sticky at all’), irritation (‘very irritating’-‘not irritating’), drying effect (‘very much’-‘not at all’), ease of use (‘very difficult’-‘very easy’), speed of drying (‘very slow’-‘very fast’), application (‘unpleasant’-‘pleasant’), overall evaluation (‘dissatisfied’-‘very satisfied’). Participant evaluations were carried out at visit 2 and visit 3.
WHO hand rub quality benchmarks
WHO defined benchmark criteria for an acceptable quality for ABHR to help purchasing decision-making. Objective scores for skin condition must score lower than 2 in ≥ 75% of assessments. Participant evaluation of skin condition must score above 4 in ≥ 75% of cases. Participant acceptance must score for color and smell above 4 in ≥ 50% of the answers and above 4 in ≥ 75% of ratings for the other items in this dimension .
The results were interpreted descriptively according to the WHO ‘Method 1’ .
Evaluation of WHO protocol feasibility and applicability
To evaluate the practicability of the WHO protocol, observer and participant time was registered.
The study was formally accepted by the Ethics board of the Canton of Zurich (ID number KEK-ZH-Nr. 2012–0444).
Overall, 46 participants out of a staff of approximately 90 were included after having given their informed consent. Participant mean age was 35 years (standard deviation, ±12); 35 (76%) were female; 17 (37%) were nurses, 13 (28%) medical doctors, five (11%) students, and 11 (24%) belonged to other professions. Fitzpatrick skin sun sensitivity types  were: type II, 28 (62%); type III, 14 (31%); and type I, IV, V, one participant (2%) each. Eight participants (17%) were smokers. The remaining participant characteristics are shown in Table 1, data on hand hygiene behavior and product preference in Table 2.
Skin tolerability by observer evaluation
Skin condition met the WHO benchmark at all visits and scores improved over time (Table 3).
Skin tolerability by participant evaluation
The second WHO criterion for skin tolerability by participant rating was also fulfilled at both visit 2 and 3 (Figure 1).
Product acceptability by participate evaluation
The WHO criteria for product acceptability for the items color and fragrance was fulfilled at each time point. The WHO criteria for all the other items were met in all but two categories at visit 2 and in all but one category at visit 3. The investigational product failed to meet the WHO criterion for acceptability by study participants only for texture at visits 2 and 3 and speed of drying at visit 2. Additionally, while still meeting WHO benchmark ‘smell after application’ received lower scores than the other items (Figure 2).
One non-serious adverse event (AE) was reported during the study period. The affected participant complained about erythema and pruritus on his/her hands, which was determined to be a local allergic or irritative reaction to the investigational product. The AE was rated as mild, lasted for four hours and disappeared without any treatment. The participant reported similar skin reactions to other products in the past and was withdrawn from the study without further investigation. There were no serious AEs.
The test ABHR was used at a mean quantity of 35 ml per day at visit 2 and 37 ml per day thereafter. The required frequency of use criterion according to the WHO protocol of a minimum consumption of 30 ml per day was met.
Information, instruction and informed consent procedures required 15 minutes per participant. Time for filling in the questionnaires required five minutes each, time for meeting the observer for evaluation of skin state, distribution and return of bottles accounted for three minutes each. In total every test person spent 40 minutes on study procedures, resulting in 30 hours for all the 46 participants. The observer had to prearrange the study, including preparation of the bottles and questionnaires, which took two working days. Time expenditure for information and recruitment of participants was about two working days. The objective skin evaluation, distribution and return of questionnaires and bottles and measurement of product consumption took about 60 minutes per participant, summing up to six working days in this case. Data analysis and calculation took another four working days. In total the observer/investigator spent 14 working days for conducting the evaluation.
The aim of this study was to investigate the skin tolerability and product acceptability of a new ABHR (EVO9; Ecolab) in healthcare workers under daily working conditions and to evaluate the practicability of the WHO protocol “Method 1 for evaluation of tolerability and acceptability of alcohol-based hand rub in use or planned to be introduced” (WHO 2009). To our knowledge this is the first formal report on the application of the abovementioned WHO protocol.
The primary endpoint concerned participant skin condition rated by a trained observer according to well-established dermatological criteria. The test product surpassed the corresponding WHO benchmark. Moreover, there was a trend to improved ratings with time of use in follow-up visits. These findings were corroborated by participants reporting above-benchmark ratings for “skin tolerability by participant” in every category, i.e., appearance, intactness, moisture content, and sensation, at both study visits. In terms of acceptability the test product failed the WHO benchmark only for texture at visit 2 and 3 and speed of drying at visit 2. After one month of use, 67% of participants preferred the investigational product over the product they normally used.
However, the results have to be interpreted with some caution. Study procedures made it necessary to provide participants with personal bottles of ABHR, which presented a novelty against the habitual bed- and wall-mounted dispensers in our hospital. Many participants told the study observer that they liked the personal ABHR bottles. Such preference might have led to a positive halo effect on product judgment. If feasible, change of provision form for the test product should be avoided since it can lead to positive or negative confounding. For the sake of a real world assessment we allowed participants to continue their habitual hand cream use during the study. This might have offset overall skin condition results favorably but did most likely not change trends over time. Additionally, the quantification in Table 1 that is in accordance with the WHO protocol, allows for comparison with results of other studies. Lastly, it is well known that in an non-blinded study the results tend to be biased towards a beneficial effect of the product under study . This flaw would be mitigated when using the WHO “Method 2” to compare two different products using a randomized blinded protocol.
The WHO protocol proofed to be clear and easy to understand. Yet, its implementation presented some challenges. First, the necessary 14 working days for the observer and four cumulative working days for participants might be perceived as an unusually high workload given the considerable number of potential ABHR available for testing. Thus, if used to select an ABHR for an institution it is advisable to apply this protocol to a limited number of serious ABHR candidates. Second, participants had to use the product for four weeks without interruption for more than five days, otherwise the study duration had to be extended for the same number of days. Fulfilling these requirements in part-time HCWs on irregular shifts proved to be challenging. Third, to prevent inter-individual variation, all skin assessments had to be carried out by the same investigator requiring the person to be available for the whole assessment period.
The new ABHR (EVO9; Ecolab) was well tolerated and user-accepted with a potential for improvement regarding texture, i.e. stickiness. While the subjective usability and tolerability rating by the users should be interpreted with caution, the skin tolerability assessed by a trained observer may be more reliable. The WHO protocol proofed to be useful but demanding for everyday application.
Pittet D, Allegranzi B, Boyce J, World Health Organization World Alliance for Patient Safety First Global Patient Safety Challenge Core Group of E. The World Health Organization Guidelines on Hand Hygiene in Health Care and their consensus recommendations. Infect Control Hosp Epidemiol. 2009;30:611–22.
Chen YC, Sheng WH, Wang JT, Chang SC, Lin HC, Tien KL et al. Effectiveness and limitations of hand hygiene promotion on decreasing healthcare-associated 297 infections. PLoS One. 2011;6:e27163
Grayson ML, Russo PL, Cruickshank M, Bear JL, Gee CA, Hughes CF, et al. Outcomes from the first 2 years of the Australian National Hand Hygiene Initiative. Med J Aust. 2011;195:615–9.
Behnke M, Gastmeier P, Geffers C, Monch N, Reichardt C. Establishment of a national surveillance system for alcohol-based hand rub consumption and change in consumption over 4 years. Infect Control Hosp Epidemiol. 2012;33:618–20.
Roberts SA, Sieczkowski C, Campbell T, Balla G, Keenan A. Implementing and sustaining a hand hygiene culture change programme at Auckland District Health Board. N Z Med J. 2012;125:75–85.
Stone SP, Fuller C, Savage J, Cookson B, Hayward A, Cooper B, et al. Evaluation of the national Cleanyourhands campaign to reduce Staphylococcus aureus bacteraemia and Clostridium difficile infection in hospitals in England and Wales by improved hand hygiene: four year, prospective, ecological, interrupted time series study. BMJ. 2012;344:e3005.
Borges LF, Rocha LA, Nunes MJ, Gontijo Filho PP. Low compliance to handwashing program and high nosocomial infection in a brazilian hospital. Interdiscip Perspect Infect Dis. 2012;2012:579681.
Boyce JM. Update on hand hygiene. Am J Infect Control. 2013;41:S94–96.
The World Health Organisation (2009) WHO Guidelines on Hand Hygiene in Health Care: a Summary. [http://whqlibdoc.who.int/hq/2009/WHO_IER_PSP_2009.07_eng.pdf?ua=1]
Larson E, Killien M. Factors influencing handwashing behavior of patient care personnel. Am J Infect Control. 1982;10:93–9.
Larson E, Girard R, Pessoa-Silva CL, Boyce J, Donaldson L, Pittet D. Skin reactions related to hand hygiene and selection of hand hygiene products. Am J Infect Control. 2006;34:627–35.
Zimakoff J, Kjelsberg AB, Larsen SO, Holstein B. A multicenter questionnaire investigation of attitudes toward hand hygiene, assessed by the staff in fifteen hospitals in Denmark and Norway. Am J Infect Control. 1992;20:58–64.
The World Health Organisation (2009). Tools for evaluation and feedback [http://www.who.int/gpsc/5may/tools/evaluation_feedback/en/]: Protocol for Evaluation of tolerability and acceptability of alcohol-based handrub in use or planned to be introduced: Method 1. [http://www.who.int/entity/gpsc/5may/Protocol_for_Evaluation_of_Handrub_Meth1.doc?ua=1]
The World Health Organisation (2009). Tools for evaluation and feedback [http://www.who.int/gpsc/5may/tools/evaluation_feedback/en/]: Protocol for Evaluation of tolerability and acceptability of alcohol-based handrub in use or planned to be introduced: Method 2. [http://www.who.int/entity/gpsc/5may/Protocol_for_Evaluation_of_Handrub_Meth2.doc?ua=1]
Pittet D, Allegranzi B, Sax H, Chraiti MN, Griffiths W, et al. Double-blind, randomized, crossover trial of 3 hand rub formulations: fast-track evaluation of tolerability and acceptability. Infect Control Hosp Epidemiol. 2007;28:1344–51.
Highley DR, Savoyka B, Oneill JJ, Ward JB. A Stereomicroscopic Method For The Determination Of Moisturizing Efficacy In Humans. St. Louis, Mo: Presented May 30, 1976, SCC Annual Seminar; 1975.
Fitzpatrick TB. The validity and practicality of sun-reactive skin types I through VI. Arch Dermatol. 1988;124:869–71.
Wood L, Egger M, Gluud LL, Schulz KF, Juni P, Altman DG, et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008;336:601–5.
The author would like to express their thankfulness to their colleagues who volunteered to participate in this study. Special thanks go to Marie-Noëlle Chraiti, Geneva, who provided training for the observer.
Financial support for this study was provided by Ecolab. The funding source was not involved in study design, collection and interpretation of the data, and manuscript submission. The authors declare that they have no competing interests.
AW, ND, JM, EA participated in the planning and execution of the study. AW and HS performed the data analysis and wrote the manuscript. The manuscript was revised and approved by all authors.