- Open Open Peer Review
Co-design and implementation research: challenges and solutions for ethics committees
BMC Medical Ethicsvolume 16, Article number: 78 (2015)
Implementation science research, especially when using participatory and co-design approaches, raises unique challenges for research ethics committees. Such challenges may be poorly addressed by approval and governance mechanisms that were developed for more traditional research approaches such as randomised controlled trials.
Implementation science commonly involves the partnership of researchers and stakeholders, attempting to understand and encourage uptake of completed or piloted research. A co-creation approach involves collaboration between researchers and end users from the onset, in question framing, research design and delivery, and influencing strategy, with implementation and broader dissemination strategies part of its design from gestation. A defining feature of co-creation is its emergent and adaptive nature, making detailed pre-specification of interventions and outcome measures impossible. This methodology sits oddly with ethics committee protocols that require precise pre-definition of interventions, mode of delivery, outcome measurements, and the role of study participants. But the strict (and, some would say, inflexible) requirements of ethics committees were developed for a purpose – to protect participants from harm and help ensure the rigour and transparency of studies. We propose some guiding principles to help square this circle. First, ethics committees should acknowledge and celebrate the diversity of research approaches, both formally (through training) and informally (by promoting debate and discussion); without active support, their members may not understand or value participatory designs. Second, ground rules should be established for co-design applications (e.g. how to judge when ‘consultation’ or ‘engagement’ becomes research) and communicated to committee members and stakeholders. Third, the benefits of power-sharing should be recognised and credit given to measures likely to support this important goal, especially in research with vulnerable communities. Co-design is considered best practice, for example, in research involving indigenous peoples in New Zealand, Australia and Canada.
Findings from clinical trials, even when disseminated widely in journals and conference presentations and incorporated into clinical practice guidelines, do not always change clinical practice or produce patient-relevant impacts . One reason for this is that interventions which fit closely to context in one setting (e.g. are acceptable, operationally feasible, affordable and culturally congruent) may be a poor fit in another setting.
The question of ‘fit’ is the basis for the emerging discipline of implementation science – research that addresses the application of interventions in ‘real world’ settings with a view to understanding what works, how and why, in specific contexts, and testing approaches to improve their implementation and effective uptake . Here, the focus is on knowledge production and translation (rather than dissemination of findings), exploring such issues as factors influencing implementation, the results of implementation, and how to scale up an intervention to achieve wider uptake and sustainability.
In conventional clinical trials, different contexts are generally controlled or adjusted for, and populations made as homogenous as possible, with atypical settings and outliers excluded. Protocols are prescriptive and standardised, with the aim to reduce ‘noise’ and create the circumstances for ideal implementation. In contrast, implementation research embraces heterogeneity, addressing complex system integration, and developing an adaptive framework to enable context-sensitive scale-up that is equitable for different populations . Successful implementation involves ongoing adaption to a changing context and feedback processes for longer term spin-offs, transposition and sustainability. Rather than logic models (linking inputs to processes and outputs in a more or less linear way) and point estimates of effect, implementation research uses theory of change, examining natural diversity and the interaction of the intervention in context to produce actionable knowledge. It often uses mixed (quantitative and qualitative) methodologies, and analyses in terms of ‘intention to reach’, rather than ‘intention to treat’, for equitable population health impact .
One approach to implementation research involves developing democratic partnerships between researchers and community stakeholders with a view to involving end-users in the design of research, promoting their understanding and capacity, and encouraging uptake of findings . This may involve iterative processes of reflection and action, ‘carried out with and by local people rather than on them’ . Known as participatory action research, this methodology seeks to empower participants to tailor an intervention to suit their own contexts. Interventions need to have contextual fit, to be responsive to the community and the participants they serve . Stakeholders may be the potential recipients of the intervention, or responsible for implementing it, including patients, health care providers, managers and policy-makers. Ideally, collaboration occurs between researchers and end users from the onset – in question framing, research design and delivery, and influencing strategy. This co-creation approach places end-user value at its very heart, with implementation and broader dissemination strategies part of its design from gestation. It also generally seeks to establish an ongoing, collaborative approach between researchers and end users, which is long-term rather than programme or project-specific; and which builds synergistically as partners build trust, work together and learn from successive projects [5, 7].
Ramaswamy et al., in their ‘Cocreation Paradigm’, describe six steps toward a culture of operational co-creation:
Identify the key stakeholders and promote their willingness to engage
Set up platforms purposefully designed to engage more co-creatively
Identify and support new champions
Expand the circle of stakeholders and joint value creation opportunities
Deepen the impact and enable the spread of more win-more, win-more strategies
Engage stakeholders to expand benefits for all .
Examples of the success of this approach in ‘locking down’ research uptake into the dynamic and time-constrained environment of community-based healthcare are accumulating [9–13]. However, because collaborative partnerships inevitably bring logistical complexities as well as competing values and conflicts of interest, challenges to research governance, flexibility and timeframes are common [9, 10, 14–16].
One particular challenge in co-creation research, and the focus of the remainder of this paper, relates to the traditional ethics approval processes.
Challenges in gaining ethics committee approval in co-creation research
Research involving human participants puts people at risk, largely for the benefit of the researchers . The current system of research ethics in biomedicine emerged partly as a response to international scandals such as the infamous experiments on prisoners under the Nazi regime and the Tuskeegee syphilis study (in which life-saving treatment was withheld from poor Black Americans, who had no knowledge of the research, for more than 30 years) . Building on the landmark Nuremberg Code  the Declaration of Helsinki  and the International Ethical Guidelines for Biomedical Research Involving Human Subjects,  medical research has become increasingly regulated in the past five decades. Formal codes of practice are now the norm, with the goal of ensuring that the methodology is rigorous; that potential harm to participants is minimised; that people know exactly what they are signing up to; and that the potential benefits of study outcomes outweigh possible risks of safety or confidentiality.
To that end, current clinical ethics and governance procedures are oriented to confirming that research interventions (drugs, procedures, educational or behavioural measures) are carefully defined and explained to potential participants before they agree to join the study; that consent procedures are non-coercive; that people receive no more or less than the intervention(s) stipulated in the protocol; that responses to that intervention are systematically monitored; that the welfare and choices of participants remain paramount (even if this necessitates withdrawing people from a study or compromising on what data are collected); and that a clear trail of accountability can be demonstrated should harm occur. Such procedures have been criticised for being bureaucratic, inefficient and inconsistent,  but there is broad agreement that a stringent and transparent system of governance is preferable to a repeat of past scandals .
By their nature, intervention studies (offering a drug, procedure or complex intervention with the aim of preventing, diagnosing or managing a condition and then assessing its effectiveness and safety) carry greater risk to participants than observational studies (in which no active manoeuvre is offered beyond usual care). Ethics committees rightly view themselves as responsible for what interventions are offered, to whom, and how. Furthermore, as much clinical research has become centred on randomised controlled trials (many of which are sponsored by industry), research governance has evolved to ensure that clinical trials are registered at the outset to prevent selective censorship of negative results  and to reduce protocol deviations (e.g. alteration of drug dose or scheduling, change of primary endpoint or length of follow-up) designed to influence the outcome .
Increasingly, therefore, the role of research ethics committees (institutional review boards in USA) is to carefully check study protocols and supporting documentation in advance of an intervention study and then ensure that these are strictly adhered to for its duration. For complex interventions, pre-specified information is likely to include participants’ anticipated time commitment, interview schedules, questionnaires and so on. This rational and (some would say) technocratic approach means that flexibility, adaptation to context and the very essence of co-creation is systematically ‘designed out’.
Pre-specification of the study protocol and other documents is a quality feature in randomised trials. But when the focus of research is the achievement of intervention-system fit (as in implementation science) and/or the emergent co-creation of research through multi-stakeholder partnerships, rigid pre-specification is at best ironic and at worst a recipe for failure, since by definition, the definitive intervention and its application is not pre-determined. Rather, the research question, the nature and delivery of the intervention and how its impact is measured, must be co-determined by researchers and other stakeholders – usually over weeks or months and in parallel with establishing programme governance, developing research capacity in community partners, building trust and working through conflict. These are ongoing and mutually reinforcing processes, not one-off procedures that can be ticked off as having been ‘achieved’.
Because of the emergent nature of the co-creation process and the crucial importance of relationships and partnership synergy, compromises may need to be made with respect to methodology to facilitate impact. But this emergent methodology creates unique challenges to ethics committees, whose protocols, as noted above, tend to require precise definition of the intervention, its mode of delivery, outcome measurements, and the role of participants in the study.
Some principles for handling ethics committee applications in implementation research involving co-creation elements
The need (on the one hand) to co-create and adapt interventions for the purposes of maximising fit and (on the other hand) to pre-specify them for the purposes of ethical approval creates a tension for which there is no simple or formulaic solution. Furthermore, it is important, whilst acknowledging the need for flexibility in some studies, not to create loopholes that will allow partisan interests to ‘move the goalposts’ in more conventional research designs.
Furthermore, ethics committees aim to protect the autonomy and rights of individuals participating in clinical research, but individually-based ethical frameworks are not necessarily of benefit to the community at large, who are collectively involved in the research process . With co-creation design, there is a move from protection of individual participants to the development of a relationship between researchers and community partners which is mutually advantageous . The participant is not someone on whom research is ‘done’, but is actively engaged in designing and implementing the research process.
Banks et al., writing about community-based participatory research (CBPR, a type of co-creation research linked to community development and the quest for social justice), point out that whereas conventional research ethics is principle-based and focused primarily on ensuring rule-following to meet regulatory requirements, CBPR is value-based and focused on relationships and the distribution of power between ‘researchers’ and ‘researched’ (and acknowledging that the boundaries between these groups may be blurred) .
With these caveats in mind, and assuming that co-creation approaches will continue to be assessed by existing systems of research governance, we offer four principles to guide ethics committees when considering applications.
First, ethics committees should acknowledge and celebrate the diversity of research – both formally (by ensuring that ethics committee members receive broad training in the full range of research methods, study designs and the rationale for these) and informally (by encouraging discussion and debate). The make-up of research ethics committees may be very diverse, with individual members who may be selected for their professional expertise in different fields (for example nursing, law, ethics) and/or for their ‘lay’ contribution – but these members may have little or no formal training in research methodologies . Even those well versed in laboratory science or randomised trials may have little knowledge or understanding of the characteristics of high-quality implementation and/or co-design research. Researchers can play their part in educating committee members on the nature of such research, and why a co-creation approach may increase the likelihood of impact and reduce harm to participants. Other commentators have similarly highlighted the importance of educating ethics committees in this regard . Approaches may include researchers explicitly mentioning these issues in their application; supplying a key paper outlining this type of research as supplementary material; or seeking the opportunity to meet with the committee and explain co-design in the context of their proposal.
Second, researchers and other stakeholders in the co-creation process should work with research ethics committees, perhaps at national level, to establish some ground rules for participatory research applications and communicate these to all parties. For example, preliminary consultation with potential beneficiaries (‘patients and carers’) is already defined by most ethics committees as a necessary step before an application can be submitted. While a Code of Research Ethics has previously been developed for participatory research,  this was not intended to be imposed on all research; rather to be individually developed for different projects . Establishing partnership governance and outlining the core components of a planned intervention can and should begin before the ethics application is finalised. There are likely to be some components that are integral aspects of the intervention, not amenable to change, and other aspects such as the setting or application that can be co-created. Hawe et al’s distinction between the theoretical ‘core’ of a complex intervention, which must be kept constant, and its local application, which can and should be flexible across sites and settings, may be a useful conceptual framework . It will often (though perhaps not always) be possible to make explicit the elements open to modification, and stipulate the nature of the facilitation process through which this will occur.
Third, research ethics committees should acknowledge the benefits of power-sharing in the co-design process and give credit to measures that support this goal; researchers in turn should make such measures explicit in their ethics applications. The reciprocity of co-creation serves to diminish participant risk. Researchers and stakeholders work together, and this power-sharing – to the extent that it is effective – will serve to reduce inequality and empower vulnerable communities. Co-design, for example, is considered best practice in research involving indigenous peoples (some of whom are especially vulnerable and/or have been exploited by researchers in the past ). In New Zealand, best practice is methodology that empowers indigenous Māori to take a governance role in the ‘planning, development and execution of research as well as monitoring the project through its life cycle’ . In Australia, it is recognised that ‘indigenous communities and individuals have a right to be involved in any research project focused upon them and their culture’ and researchers are encouraged to include Traditional Owners, custodians, Elders, and community members to be involved in the research as collaborators, advisers or assistants . Similarly the Canadian Panel of Ethics directs that research involving Aboriginal peoples in Canada, including Indian (First Nations), Inuit and Métis peoples, should be premised on respectful relationships, and encourages collaboration and engagement between researchers and participants .
Finally, our fourth principle is one of emergence and continuing learning by all parties. The ethics of co-creation are an emerging area on which there is, appropriately, ongoing debate. Other commentators in the recent literature have made suggestions about how ethics committees may consider participatory research. Chen and colleagues, for example, suggest a framework which includes respect for potential and enrolled participants, community partners and research partners . Another study failed to find consensus regarding who represents and speaks for a community . Blake proposes participants only signing consent forms after all interviews or focus groups have been completed, and including preferences regarding anonymity and use of audio recordings .
To continue to inform the debate, we suggest that data should be prospectively collected on the types of applications that are received by research ethics committees how issues such as the lack of a definitive intervention and its application have been addressed, and identification of the learning points, and these findings disseminated. Examination of such cases and how they have been resolved will help to move the debate onwards. Collecting and assessing such data could be a role for organisations such as the National Research Ethics Service (now part of the Health Research Authority) in the UK, and the Health and Disability Ethics Committee in New Zealand, which are charged with ensuring that the rights and safety of research participants are protected, and ethical research of potential benefit to science and society is conducted.
There is no simple answer to the question of how to balance the laudable principle of co-creation with the need for robust and transparent governance of research on human participants. The principles proposed in this paper are preliminary; we invite discussion and recommend further research on the ethical dimension of this rapidly developing field.
Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998;317(7156):465–8.
Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753.
Edwards N, Barker PM. The importance of context in implementation research. J Acquir Immune Defic Syndr. 2014;67 Suppl 2:S157–162.
Nilsen P, Ståhl C, Roback K, Cairney P. Never the twain shall meet?-a comparison of implementation science and policy implementation research. Implement Sci. 2013;8(1):63.
Jagosh J, Macaulay AC, Pluye P, Salsberg J, Bush PL, Henderson J, et al. Uncovering the benefits of participatory research: implications of a realist review for health research and practice. Milbank Q. 2012;90(2):311–46.
Cornwall A, Jewkes R. What is participatory research? Soc Sci Med. 1995;41(12):1667–76.
Janamain T, Jackson C, Dunbar J. Co-creating value in research: stakeholders’ perspectives. Med J Aust. 2014;201(3):S44–6.
Ramaswamy V, Gouillart F. Building the co-creative enterprise. Harv Bus Rev. 2010;88(10):100–9.
Wehrens R, Bekker M, Bal R. Hybrid management configurations in joint research. Sci Technol Hum Values. 2014;39(1):6–41.
Hinchcliff R, Greenfield D, Braithwaite J. Is it worth engaging in multi-stakeholder health services research collaborations? Reflections on key benefits, challenges and enabling mechanisms. Int J Qual Health Care. 2014;26(2):124–8.
Rycroft-Malone J, Wilkinson JE, Burton CR, Andrews G, Ariss S, Baker R, et al. Implementing health research through academic and clinical partnerships: a realistic evaluation of the collaborations for leadership in applied health research and care (CLAHRC). Implement Sci. 2011;6(1):74.
Kosmala-Anderson JP, Wallace LM, Turner A, Bourne C. Self-reported effects of attending the health foundation’s co-creating health self-management programme for patients with type 2 diabetes mellitus in London, England. AMS. 2014;10(4):773–81.
Whitehouse SR, Lam P-Y, Balka E, McLellan S, Deevska M, Penn D, et al. Co-creation with TickiT: designing and evaluating a clinical eHealth platform for youth. JMIR Res Protoc. 2013;2(2):e42. doi:10.2196/resprot.2865.
Fitzgerald L, Harvey G. Translational networks in healthcare? evidence on the design and initiation of organizational networks for knowledge mobilization. Soc Sci Med. 2015;138:192–200.
Boyd H, McKernon S, Mullin B, Old A. Improving healthcare through the use of co-design. NZ Med J. 2012;125(1357):76–87.
Piper D, Iedema R, Gray J, Verma R, Holmes L, Manning N. Utilizing experience-based co-design to improve the experience of patients accessing emergency departments in New South Wales public hospitals: an evaluation study. Health Serv Manag Res. 2012;25(4):162–72.
Eccles MP, Weijer C, Mittman B. Requirements for ethics committee review for studies submitted to implementation science. Implement Sci. 2011;6:32.
Jones JH. Bad blood: the tuskeegee syphilis experiment: Simon and Schuster. 1993.
Shuster E. Fifty years later: the significance of the Nuremberg code. N Engl J Med. 1997;337(20):1436–40.
World Medical Association. World medical association declaration of Helsinki: ethical principles for medical research involving human subjects. Jama. 2013;310(20):2191.
Council for International Organizations of Medical Sciences and World Health Organisation: International Ethical Guidelines for Biomedical Research Involving Human Subjects. Accessed 27.7.15 on http://www.cioms.ch/publications/layout_guide2002.pdf. Geneva: CIMS and WHO; 2002.
Berge E, Ford GA, Bath PM, Stapf C, Worp HB, Demotes J, et al. Regulation and governance of multinational drug trials in stroke: barriers and possibilities. Int J Stroke. 2015;10(3):425–8.
Dixon-Woods M, Ashcroft RE. Regulation and the social licence for medical research. Med Health Care Philos. 2008;11(4):381–91.
Laine C, Horton R, DeAngelis CD, Drazen JM, Frizelle FA, Godlee F, et al. Clinical trial registration—looking back and moving ahead. N Engl J Med. 2007;356(26):2734–6.
Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.
Brugge D, Kole A. A case study of community-based participatory research ethics: the healthy public housing initiative. Sci Eng Ethic. 2003;9(4):485–501.
Cross J, Pickering K, Hickey M: Community-based participatory research, ethics, and institutional review boards: untying a Gordian knot. Critical Sociology 2014:1–20. doi:10.1177/0896920513512696
McNutty AN, Banks S, Armstrong A, Carter K, Graham H, Hayward P, et al. Everyday ethics in community-based participatory research. Contemp Soc Sci. 2013;8(3):263–77.
Druml C, Wolzt M, Pleiner J, Singer EA. Research ethics committees in Europe: trials and tribulations. Intensive Care Med. 2009;35(9):1636–40.
Boser S. Power, ethics, and the IRB dissonance over human participant review of participatory research. Qual Inq. 2007;13(8):1060–74.
INVOLVE: Patient and public involvement in research and research ethics committee review [http://www.invo.org.uk/wp-content/uploads/2011/12/INVOLVENRESfinalStatement310309.pdf]
Macaulay AC, Delormier T, McComber AM, Cross EJ, Potvin LP, Paradis G, et al. Participatory research with native community of Kahnawake creates innovative code of research ethics. Can J Public Health. 1998;89(2):105–8.
Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomised controlled trial be? BMJ. 2004;328(7455):1561.
Jones R, Crengle S, McCreanor T. How tikanga guides and protects the research process. Soc Policy J N Z. 2006;29(Nov):60–77.
Health Research Council. Guidelines for researchers on health research involving māori, vol. 48. Wellington: HRC; 2010.
Australian Institute of Aboriginal and Torres Strait Islander Studies. Guidelines for ethical research in Australian indigenous studies, vol. 20. Canberra: AIATSIS; 2012.
Panel on Research Ethics. Research involving the first nations, Inuit and Métis peoples of Canada. In: TCPS 2. Ottawa: Government of Canada; 2015.
Chen DT, Jones L, Gelberg L. Ethics of clinical research within a community-academic partnered participatory framework. Ethn Dis. 2006;16(1 Suppl 1):S118–135.
Blake M. Formality and friendship: research ethics review and participatory action research. ACME: An Intl E-J for critical Geogr. 2007;6(3):411–21.
No funding was obtained in the writing of this manuscript.
The authors have no competing interests to declare.
All three authors conceived of the issue during a workshop on co-creation research; FG wrote the first draft; TG and CJ edited and added to the original paper. All authors read and approved the final manuscript.