- Open Access
National observational study to evaluate the “cleanyourhands” campaign (NOSEC): a questionnaire based study of national implementation
Antimicrobial Resistance and Infection Controlvolume 4, Article number: 52 (2015)
The number of national hand-hygiene campaigns has increased recently, following the World Health Organisation’s (WHO) “Save Lives: clean your hands” initiative (2009), which offers hospitals a multi-component hand-hygiene intervention. The number of campaigns to be evaluated remains small. Most evaluations focus on consumption of alcohol hand rub (AHR). We are not aware of any evaluation reporting implementation of all campaign components. In a previously published report, we evaluated the effects of the English and Welsh cleanyourhands campaign (2004–8) on procurement of AHR and soap, and on selected healthcare associated infections. We now report on the implementation of each individual campaign component: provision of bedside AHR, ward posters, patient empowerment materials, audit and feedback, and guidance to secure institutional engagement.
Setting: all 189 acute National Health Service (NHS) hospitals in England and Wales (December 2005–June 2008). Six postal questionnaires (five voluntary, one mandatory) were distributed to infection control teams six-monthly from 6 to 36 months post roll-out. Selection and attrition bias were measured.
Response rates fell from 134 (71 %) at 6 months to 82 (44 %) at 30 months, rising to 167 (90 %) for the final mandatory one (36 months). There was no evidence of attrition or selection bias. Hospitals reported widespread early implementation of bedside AHR and posters and a gradual rise in audit. At 36 months, 90 % of respondents reported the campaign to be a top hospital priority, with implementation of AHR, posters and audit reported by 96 %, 97 % and 91 % respectively. Patient empowerment was less successful.
The study suggests that all campaign components, apart from patient empowerment, were widely implemented and sustained. It supports previous work suggesting that adequate piloting, strong governmental support, refreshment of campaigns, and sufficient time to engage institutions help secure sustained implementation of a campaign’s key components. The results should encourage countries wishing to launch coordinated national campaigns for hospitals to participate in the WHO’s “Save Lives” initiative, which offers hospitals a similar multi-component intervention.
National hand-hygiene campaigns have increased in number recently [1, 2], following the First Global Patient Safety Challenge (2005)  and the World Health Organisation’s “Save Lives: clean your hands” initiative (2009)  which offers participating hospitals or countries a multi-component hand-hygiene intervention tool. The number of campaigns that have been evaluated remains small and mainly restricted to monitoring procurement of AHR . We are not aware of any national campaign which has evaluated short or long term implementation of all campaign components. Such an evaluation would be helpful to other countries planning similar campaigns.
The English and Welsh “cleanyourhands campaign” [5, 6] was rolled out to all 189 acute NHS hospitals between 1st December 2004 and 30th June 2005 as a high profile national initiative reflecting public and political concern over health-care associated infections and poor hand-hygiene compliance . The main components of the campaign, which was continued until December 2010, were: provision of AHR at each bedside, distribution of posters to each ward reminding health-care workers to clean their hands, audit and feedback of hand-hygiene compliance, provision of materials empowering patients to remind healthcare workers to clean their hands, and detailed guidance to help infection control teams secure institutional engagement.
The National Observational Study to Evaluate the cleanyourhands Campaign (NOSEC study) was a four year ecological study (1st October 2004-30th September 2008) in which we evaluated the effects of the English and Welsh cleanyourhands campaign on procurement of AHR and soap, and on selected healthcare associated infections [7, 8]. This publication however, reports on the implementation of the individual campaign components in acute NHS hospitals, at 6–36 months after roll out of the campaign, using a voluntary self-report questionnaire.
Repeated cross-sectional voluntary questionnaire-based survey.
All 189 English and Welsh NHS acute hospital trusts. Data were collected at the acute trust level, a trust being the administrative unit of a small number of acute hospitals; these are described as “hospitals” throughout the report. The campaign was rolled out to all hospitals by the end of June 2005.
Timing and distribution of questionnaire
Postal questionnaires were sent to infection control teams in December 2005 (NOSEC 1), June 2006 (NOSEC 2) December 2006 (NOSEC 3) June 2007 (NOSEC 4), December 2007 (NOSEC 5) and June 2008 (NOSEC 6). This covered the period from 6 to 36 months post completion of roll out of the campaign.
In order to maximise response rates the questionnaire was piloted in 8 acute hospitals. The National Patient Safety Agency wrote to chief executives asking that they facilitate compliance with the study ahead of the first and fourth questionnaires. Hospitals were given two months to respond to questionnaires after which they received two postal reminders. The National Audit Office, which was conducting the third mandatory survey of infection control practice in the autumn of 2008 , included the NOSEC questions in their own survey soon after the final questionnaire was sent out.
Respondents were asked to respond to the following questions:
To what extent do you agree with the statement: “The actions of hospital management show that the cleanyourhands campaign is a top priority in this trust”?
What proportion of inpatient wards have alcohol hand rub at each bedside?
What proportion of inpatient wards use the cleanyourhands campaign posters?
To what extent do you agree with the statement “The cleanyourhands patient empowerment materials are reaching patients on wards”?
To what extent do you agree with the statement: “The cleanyourhands campaign has encouraged patients in this hospital to ask staff to clean their hands”?
In what proportion of inpatient wards has hand-hygiene compliance been directly monitored by a member of the infection control team or by a member of ward staff in the past six months?
Response options for questions 1, 3 and 4 were “strongly agree”, “agree”, “neither agree nor disagree”, “disagree” or “strongly disagree”. Potential responses to questions 2 and 5 were “none” “1–25 %”, “26–50 %”, “51–75 %”, “76–99 %”, and “100 %”.
Two extra questions were included in the National Audit Office questionnaire:
If you have answered less than 100 % regarding the percentage of wards with bedside AHR, in which wards is AHR unavailable at the bedside/end of bed etc.”
If your trust has a rolling programme of hand hygiene audits how often are they done?
Response options for the first question were “Psychiatric”, “Paediatric”, “Hepatic” and “Other”. For the second question, response options were “Weekly”, Monthly”, “Quarterly”,”Annually”, “Other”, “No rolling programme of audit”.
The proportion of hospitals responding to each NOSEC questionnaire was recorded, and the responses to questions on campaign implementation were expressed as a percentage of the total number of responses.
The results were assessed for attrition bias, as response rates fell, by comparing responses from consistent responders (hospitals who responded to all questionnaires) with those from inconsistent responders, using Pearson’s Chi Squared (χ2) and Fisher’s Exact tests for each of the first five voluntary questionnaires. The same calculations were done to compare the questionnaire returns of those who responded to the sixth voluntary questionnaire with those that responded to the mandatory National Audit Office questions.
Selection bias with respect to hospital type, using the Health Protection Agency classification of acute, teaching or specialist , was examined by comparing the proportions of acute, teaching and specialist hospitals responding to each questionnaire for significance (Z scores).
In order to identify potential selection bias whereby responders might also be those using more hand hygiene consumables and therefore more compliant with the campaign, the amount of AHR and soap procured (mls/patient-bed day)  was compared in responding and non responding hospitals for each questionnaire.
The study was ethically approved by Multicentre Research Ethics Committee (reference number 04MRE/10/66 Scotland). Data was anonymised and confidential.
Response rates (Table 1)
Response rates to the voluntary questionnaires (NOSEC 1–5) were initially high but declined from 71 % (NOSEC 1) to 44 % (NOSEC 5). This rose to 90 % for the final questionnaire (NOSEC 6), 90 respondents to the National Audit Office survey and 77 respondents to the voluntary version. This gave a national “snap shot” of campaign implementation at three or more years post roll out. Fifty-three (28 %) hospitals responded to all six questionnaires.
Campaign implementation (Table 1)
Throughout the study, the majority of infection control teams agreed or strongly agreed with the statement “The actions of hospital management show that the cleanyourhands campaign is a top priority in this trust and reported. Widespread implementation of bedside AHR and ward display of posters was also reported, with a steady rise in audit of hand-hygiene compliance over time. At three years or more post-roll out (NOSEC 6), the campaign still appeared to be a top priority, with near universal implementation of bedside AHR, ward posters, and audit of hand-hygiene compliance. Patient empowerment was the least successfully implemented component and most respondents did not think it had altered patients’ behaviour.
Bedside AHR was reported to be present in 100 % of wards in 22 % (NOSEC 1), 17 % (NOSEC 2), 45 % (NOSEC 3), 46 % (NOSEC 4), 49 % (NOSEC 5) and 40 % (NOSEC 6) of responding hospitals. From responses to questions included only in the National Audit Office questionnaire  it appeared the wards without AHR were those where there was a perceived risk of patients ingesting it. Hospitals reported that the wards without AHR were psychiatric wards (94: 56 %] hospitals), mental health wards (19: 11 % hospitals) and hepatology wards (7: 4 % hospitals).
Audit and feedback was reported to be carried out in all wards in 23 % (NOSEC 1), 25 % (NOSEC 2), 21 % (NOSEC 3), 32 % (NOSEC 4), 49 % (NOSEC 5) and 60 % (NOSEC 6) of responding hospitals. In response to questions included only in the National Audit Office questionnaire, the frequency of audit and feedback was weekly in 77 (46 %), monthly in 60 (36 %) and quarterly in 12 (7 %) of responding hospitals.
Assessment of attrition and selection bias
There was no evidence of attrition or response bias when the returns of consistent responders and inconsistent responders were compared, or when those of responders to the voluntary and mandatory versions of the final questionnaire were compared. The only exception to this concerned responses to one question in NOSEC 2, when non-consistent responders were significantly more likely to report having campaign posters on >75 % of wards than consistent responders (χ2 = 7.66, p = 0.006). There was no evidence of selection bias with respect to type of hospital or the amount of AHR or soap procured.
The principal findings of the study were that hospitals reported widespread and sustained implementation of all main components of the campaign, with the exception of patient empowerment. Institutional engagement, as reflected by infection control teams’ perception of management’s actions to support the campaign, was reported to be high, even at three years after completion of national roll out. Audit and feedback was reported to have risen thoughout the study until it was reported to be widespread on nearly all wards.
The strengths of the study included use of a mandatory final questionnaire with a high response rate to provide a national “snapshot” of institutional engagement and campaign implementation at 3 years post roll out. Other strengths were that measures were taken to maximise the voluntary questionnaire response rate (providing a short questionnaire, asking the National Patient Safety Agency to write to chief executives, issuing two reminders to late returning hospitals) and that potential attrition and selection biases were assessed. Systematic review shows that 85 % of health care worker questionnaire studies fail to take measures to maximise response rates with only 16 % formally assessing attrition or selection bias .
The main limitation of the study was its use of self-reported data. Although national self-report questionnaires run the risk that respondents may overestimate the quality of their service, they remain a standard tool of health service research, and their findings have been used to drive national policy in infection control and other fields [9, 11–14]. The experience of all three questionnaire-based National Audit Office reports on infection control, in particular, showed that infection control teams consistently revealed widespread deficiencies in their services [9, 11, 12] and were often highly critical of management’s attitudes towards infection control. In this context, the finding in the mandatory final questionnaire that 90 % of infection control teams considered that their hospital’s management viewed the campaign as a top priority three years after national roll-out is striking and indicates that the campaign was successful in securing institutional engagement.
The second main limitation was the falling response rate to the voluntary questionnaires. This is a well-recognised trend in questionnaire-based research over the last decade, attributed to the increased demands for information in general from healthcare workers . Although all response rates to the voluntary NOSEC questionnaires were below the 75 % conventionally thought necessary to minimise bias , extensive analyses were undertaken to exclude bias and provide reassurance that the responses are representative of the national picture. The initial response rate of 71 % was well above the median of 50 % and at the high end of the interquartile range (37–71 %) reported in the literature for nurse-directed questionnaires , and remained above this for the first four questionnaires. There was no difference in reported implementation between voluntary and mandatory returns, which might suggest that making reporting mandatory for those trusts that had not already voluntarily reported did not lead them to report higher levels of implementation. Hospitals reported poor implementation of many other aspects of infection control in their responses to the same mandatory National Audit Office questionnaire  that included the final NOSEC questionnaire. This suggests that the rise in implementation of the campaign components was genuine. It is not clear why implementation of nearly all components was reported to be higher in the final questionnaire, although it is possible that this represents a long term and cumulative change in culture.
The final limitation was that, because of the much faster than anticipated rollout, it was not possible to collect baseline data for the poster, patient empowerment, and audit components in the period prior to the introduction of the campaign. Although it is possible that some hospitals already had local initiatives incorporating elements of the campaign, it seems implausible that these were widespread, especially given the very low levels of AHR procurement pre-campaign .
It is difficult to compare this study with other reports evaluating national campaigns, as many have not examined implementation of these individual campaign components [15–17]. There are data, however, from the German national campaign, which reported that over three years, availability of AHR at the bedside had risen to 100 % in intensive care units and to 91.3 % in other wards , and that audit was carried out in 180 of over 700 hospitals. A voluntary questionnaire distributed at three years into the campaign to 450 out of over 700 hospitals, received 211 replies (47 %), reporting active management support for the campaign in 62 % of responding hospitals, with nearly 40 % reporting no managerial support. A single hospital study from Mali evaluating a very similar hand hygiene campaign, also used a self report questionnaire which also indicated that the campaign had been associated with widespread bedside availability of AHR, poster display and audit and feedback but less successful implementation of patient empowerment . We too report that the patient empowerment component was the most poorly implemented. This finding may reflect the relative absence in campaign materials of detailed guidance on how to achieve this. It is also consistent with research showing that there appear to be more many more barriers than facilitators for patient empowerment in hand hygiene, and that it was “generally perceived as one of the most challenging roles” for patients to adopt, compared to other patient empowerment roles . Further research carried out for the National Patient Safety Agency on patient empowerment came to the same conclusion, recommending to the Chief Medical Officer that further work to expand this component be terminated (report available from authors).
The findings of this study are best understood alongside those of the rest of the NOSEC study , which showed that procurement of soap and alcohol hand rub tripled, and that the rate of change of procurement at the individual hospital level increased significantly in association with each phase of the campaign. Taken together, the studies appear to show that the campaign was effectively implemented and sustained long term.
Although analysis of the mechanisms responsible for its effective long term implementation are beyond the scope of this study, systematic review of smaller scale hand hygiene interventions has suggested that frequent refreshment of interventions may be needed . Guidelines for implementing and evaluating complex interventions stress the importance of a pilot phase  and government support for national hand hygiene campaigns in France, Belgium and Germany was identified [2, 22] as central to their success. The piloting of the campaign in a small number of hospitals , the three month preparation time given to infection control teams to engage their institution, and the ongoing co-ordination and support given by a dedicated centrally funded national campaign team with two refreshments or relaunches of the campaign and strong governmental support , may all therefore have been factors in securing sustained implementation of the campaign’s key components.
The World Health Organization’s “Save Lives” initiative , which has been taken up by over 170 countries, offers a multi-component intervention very similar to the English and Welsh cleanyourhands campaign. The findings of this study suggest that a national campaign can successfully influence and sustain acute hospitals’ promotion of hand-hygiene. These results should encourage countries wishing to launch coordinated national campaigns for hospitals to participate in the WHO’s “Save Lives” initiative, the implementation of whose components they could evaluate themselves through the WHO hand-hygiene intervention self-assessment tool .
National Observational Study to Evaluate the cleanyourhands Campaign
National Health Service
Alcohol hand rub
Latham JR, Magiorakos A-P, Monnet DL, Alleaume S, Aspevall O, Blacky A, et al. The role and utilisation of public health evaluations in Europe: a case study of national hand-hygiene campaigns. BMC Public Health. 2014;14:131. doi:10.1186/1471-2458-14-131.
Reichardt C, Koeniger D, Bunte-Schoenberger K, van der Lindena P, Moench N, Schwabb F, et al. Three years of national hand-hygiene campaign in Germany: what are the key conclusions for clinical practice? J Hosp Infect. 2013;83 Suppl 1:S11–6.
WHO|Clean Care is Safer Care The first global patient safety challenge. 2005; Available: http://www.who.int/patientsafety/events/05/GPSC_Launch_ENGLISH_FINAL.pdf (Accessed 12 August 2015).
World Health Organization: Guidelines on Hand Hygiene in Health Care: a Summary. Geneva: World Health Organization; 2009. http://www.who.int/gpsc/5may/tools/who_guidelines-handhygiene_summary.pdf.
National Patient Safety Agency [NPSA]. Ready, Steady, Go. The full guide to implementing the cleanyourhands campaign in your Trust. London: NPSA. 2004.
National Patient Safety Agency [NPSA]. Flowing with the go. The complete year two campaign maintenance handbook for cleanyourhands partner trusts. The sequel to Ready, steady, go. London: NPSA. 2006.
Stone SP, Fuller F, Savage J, Cookson B, Hayward A, Cooper B, et al. Evaluation of the national Cleanyourhands campaign to reduce Staphylococcus aureus bacteraemia and Clostridium difficile infection in hospitals in England and Wales by improved hand hygiene: four year, prospective, ecological, interrupted time series study. Br Med J. 2012;344, e3005.
Stone S, Fuller C and the NOSEC/FIT investigators. Report to the Patient Safety Research Programme. University of Birmingham, Patient Safety Programme. Report number PS029. 2010 http://www.birmingham.ac.uk/Documents/collegemds/haps/projects/cfhep/psrp/finalreports/PS029FinalReportStone.pdf (accessed 12 August 2015)
National Audit Office [NAO]. Reducing Healthcare Associated Infections in Hospitals in England. Report by the comptroller and auditor general HC 560 session 2008–9 12 June 2009. 2009
Cook JV, Dickinson HO, Eccles MP. Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study. BMC Health Serv Res. 2009;9:160.
National Audit Office [NAO]. The management and control of hospital acquired infection in acute NHS trusts in England. National Audit Office. Report by the Comptroller and Auditor General - HC 230 Session 1999–2000. 2000.
National Audit Office [NAO]. Improving patient care by reducing the risk of hospital acquired infection. National Audit Office. Report by the Comptroller and Auditor General HC 876 Session 2003–2004: 14 July 2004. 2004.
Intercollegiate Stroke Working Party. National Sentinel Stroke Audit Report 2004. Royal College of Physicians. 2005
The Continence Working Party. The National Audit of Continence Care for Older People. Royal College of Physicians. 2006
Leens E. Vous êtes en de bonnes mains: résultats de la troisième campagne nationale pour l’hygiène des mains dans les hôpitaux. Episcoop. 2010;10(1):4. [French]. Available from: http://www.iph.fgov.be/epidemio/epifr/episcoop/201001fr.pdf
Leens E. Nationale campagne ter bevordering van de handhygiëne, 2008-2009. Resultaten. Brussels, Belgium: Scientific Institute of Public Health. 2009. Contract No.: D/2009/2505/63. [Flemish]. Available from: http://www.iph.fgov.be/nsih/download/HH/RAPPORT_HH20082009_nl_definitief2.pdf
Roche F, Fitzpatrick, F, Increase in alcohol hand rub indicates rise in hand hygiene activity. Epi-Insight 2010: 11(5). http://ndsc.newsweaver.ie/epiinsight/kbrp32bqeif12elq5r7tbh
Allegranzi B, Sax H, Bengaly L, Richet H, Minta DK, Chraiti MN, et al. World Health Organization "Point G" Project Management Committee. (2010). Successful Implementation of the World Health Organization Hand Hygiene Improvement Strategy in a Referral Hospital in Mali, Africa. Infect Control Hosp Epidemiol. 2010;31:133–41.
Watt I on behalf of the Patient Involvement in Patient Safety Research Group.) A review of strategies to promote patient involvement, a study to explore patient’s views and attitudes and a pilot study to evaluate the acceptability of selected patient involvement strategies. Patient Safety Research Programme. Report number PS/034. 2009.
Naikoba S, Hayward A. (2001) The effectiveness of interventions aimed at increasing handwashing in healthcare workers—a systematic review. J Hosp Infect. 2001;47:173–80.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
Magiorakos A, Leens E, Drouvot V, May-Michelangeli L, Reichardt C, Gastmeier PK, et al. Pathways to clean hands: highlights of successful hand hygiene implementation strategies in Europe. Eurosurveillance. 2010;15:19560.
National Patient Safety Agency [NPSA]. Achieving our aims: evaluating the results of the pilot cleanyourhands campaign. NPSA. 2004.
World Health Organization: Hand Hygiene Self-Assessment Framework 2010 http://www.who.int/gpsc/country_work/hhsa_framework_October_2010.pdf?ua=1 (accessed 12 August 2015)
Thanks to all participating hospitals and the “cleanyourhands” team. This work was funded by the Patient Safety Research Programme; GOJO industries and the Royal Free Hospital Trustees.
SS received supplementary funding for the study from GOJO industries. None of the funders had input into the design, running or reporting of the results. No other conflicts of interest are reported.
Development of the initial ideas and steering for the project: SPS, BC, BC, AJ, SM, AH AC, LT & GD. Data collection and analysis : CF and JS. The first draft was written and revised by CF. All authors reviewed the final draft. All authors read and approved the final manuscript.