What makes public health studies ethical? Dissolving the boundary between research and practice
BMC Medical Ethics volume 15, Article number: 61 (2014)
The generation of evidence is integral to the work of public health and health service providers. Traditionally, ethics has been addressed differently in research projects, compared with other forms of evidence generation, such as quality improvement, program evaluation, and surveillance, with review of non-research activities falling outside the purview of the research ethics board. However, the boundaries between research and these other evaluative activities are not distinct. Efforts to delineate a boundary – whether on grounds of primary purpose, temporality, underlying legal authority, departure from usual practice, or direct benefits to participants – have been unsatisfactory.
Public Health Ontario has eschewed this distinction between research and other evaluative activities, choosing to adopt a common framework and process to guide ethical reflection on all public health evaluative projects throughout their lifecycle – from initial planning through to knowledge exchange.
The Public Health Ontario framework was developed by a working group of public health and ethics professionals and scholars, in consultation with individuals representing a wide range of public health roles. The first part of the framework interprets the existing Canadian research ethics policy statement (commonly known as the TCPS 2) through a public health lens. The second part consists of ten questions that guide the investigator in the application of the core ethical principles to public health initiatives.
The framework is intended for use by those designing and executing public health evaluations, as well as those charged with ethics review of projects. The goal is to move toward a culture of ethical integrity among investigators, reviewers and decision-makers, rather than mere compliance with rules. The framework is consonant with the perspective of the learning organization and is generalizable to other public health organizations, to health services organizations, and beyond.
Public Health Ontario has developed an ethics framework that is applicable to any evidence-generating activity, regardless of whether it is labelled research. While developed in a public health context, it is readily adaptable to other health services organizations and beyond.
The practice of public health involves both the generation and use of a wide variety of evidence for decision-making. Evaluation routinely accompanies the introduction of new public health programs and services or the modification of established programs. Surveillance programs monitor indicators of health status as well as social and environmental conditions that may affect public health. Quality improvement activities collect data to ensure that ongoing programs and services are being implemented to appropriate standards. Research serves to address broader knowledge gaps to inform all of these activities.
Traditionally, ethics has been addressed differently in research projects, as compared with quality improvement, program evaluation, and surveillance, with only research requiring formal review by a research ethics board (REB). However, all these initiatives involve the systematic collection of data about individuals, their communities, their environments, and the health and social services they receive. They require either the primary collection of new data or the use of existing data for these purposes. They frequently use common methods and pose common risks to participants. Ethical issues may arise at any point in the conduct of any of these activities. Otto and colleagues point out that distinguishing between research and public health practice is particularly challenging, as public health practice may include hypothesis testing and use of the same epidemiologic study design, sampling and analysis techniques as a research project . While not necessarily intended, public health practice may also lead to generalizable knowledge and be published .
There is general agreement that some form of ethical reflection or review is important for all types of evidence-generating initiatives, whether or not they constitute formal research [2–6]. It is widely suggested that review of non-research activities falls outside the purview of the REB [2, 5, 7, 8]. However, the establishment of separate review processes for research and other types of evidence-generating initiatives is problematic because it requires one to differentiate between research and these other non-research initiatives. Efforts to delineate such a boundary [3, 4, 9, 10] – whether on grounds of primary purpose (generalizable knowledge), temporality (turn-around time from evidence to action), underlying legal authority, departure from usual practice, or direct benefits to participants – have been unsatisfactory.
The wisdom of maintaining this artificial division between research and other evaluative activities has been debated in a number of circles in recent years. Fairchild and Bayer  note:
The recent efforts to provide definitional solutions to the question of research and public health practice involve twists and turns that inevitably produce results that are riddled with inconsistencies and that are conceptually unsatisfying.
In the context of clinical care and research, Kass and colleagues have systematically delineated the conceptual, moral, and empirical problems with attempting to draw a sharp distinction between clinical research and practice, with a view to taking a more holistic approach .
In summary, there is a growing recognition that the distinction between research and other evidence-generating activities is artificial and selective ethics review of activities labeled “research” is problematic. With this in mind, we sought to develop a common ethics framework for all evidence-generating activities, regardless of the label.
Public Health Ontario (PHO) is a government agency charged with the protection and promotion of health and the reduction of health inequities for Ontarians . Through legislation, it operates as a separate entity from the government but within a broader accountability framework set in government directives and procedures. The services offered by PHO are broad in nature and include: research, program evaluation, surveillance and population health assessment. As a new agency, PHO had no prior policies or infrastructure to address the ethical review of research or other evaluative activities conducted by its staff. Recognizing the challenges with the blur between research and other evaluative activities, we sought to adopt a holistic approach to the ethical conduct of these initiatives. We found no literature describing any other organization that had done this. So, with the support of our President and CEO, we set out to develop a conceptual framework for the ethical conduct of public health initiatives that addresses, in an integrated fashion, research, surveillance, and other evidence-generating activities involving humans, their data or their biological samples, proportionate to the risk to human participants . The use of a single system avoids the problems associated with trying to distinguish research from non-research described above, and ensures that all initiatives receive ethics assessment proportionate to the risk.
The PHO framework was developed by a working group of public health and ethics professionals and scholars, in consultation with individuals representing a wide range of public health roles. The concepts in the document were presented at various fora and early drafts were circulated to public health practitioners and ethicists for comment. The resulting feedback was incorporated into the first completed version of the framework document, which was released broadly for discussion in June 2011 to public health units across Ontario, independent academics working in the areas of public health and ethics, and individuals at specific organizations described in the acknowledgements. These comments informed the revision of the framework document into its current version.
Why build on a research ethics paradigm?
The framework consists of two parts. The first part interprets the existing Canadian research ethics policy statement through a public health lens. The second part consists of ten questions that guide the investigator in the application of the core ethical principles to public health initiatives.
Our framework builds on the joint research ethics policy statement of the three federal research agencies in Canada, commonly known as the TCPS 2 . All Canadian institutions must agree to comply with the TCPS 2 to be eligible to administer funds from the three federal research agencies in Canada. Like many other research guidance documents, TCPS 2 has been criticised for being too strongly driven by the biomedical research paradigm. We considered developing or adapting an ethics framework that was specifically grounded in public health values. The decision to use the TCPS 2 and its three core principles of respect for persons, concern for welfare, and justice as the starting point was based on a number of considerations:
We sought to create a single process for all our public health evaluative activities while remaining compliant with TCPS 2 requirements for research.
The foundational principles of TCPS 2 – respect for persons, concern for welfare and justice – are consonant with other internationally accepted bioethics principles. While additional principles that are particularly relevant to public health may also be introduced, the three principles of the Policy serve as the core.
Concerns about the limitations of the TCPS 2 largely relate to misapplication. Perceived challenges with the applicability of the TCPS 2 in many instances reflect overly rigid interpretations amidst a cultural bias towards individual autonomy and a focus on avoiding risk, and not limitations in the actual guidance provided by the TCPS 2.
Ten guiding questions
The public health lens we apply to the TCPS 2 considers how the three core principles may be read in the context of community or population interests, expanding the ethical considerations to include: the relational interests of the individual as part of a community (relational autonomy); solidarity; social justice; and reciprocity. To facilitate application of the three principles to specific projects, the PHO framework poses ten guiding questions to be considered when planning and reviewing evidence-generating public health initiatives. In Table 1, we provide a brief synopsis of the public health framing of each of the ten questions. The full discussion may be found elsewhere  It is important that the guiding questions be considered together and that they not be used in isolation from the discussion regarding their interpretation and application through a public health lens.
These questions are informed by several earlier frameworks developed for clinical research , public health , and health services research . Many of the questions themselves do not differ from what REBs typically address when reviewing a research protocol. The added value we provide is the public health perspective in the explanatory text – e.g. considering harm to communities, reciprocity, and the levelling of autonomy with other principles.
Question ten may be the most contentious. It asks about the potential longer-term consequences, with an emphasis on unanticipated adverse effects of a study. Some research guidance specifically identifies this question as being out of scope of ethics review . While this may be reasonable in an academic setting, in the applied world of public health one must consider the potential implications of an evaluation on future policy.
Application of the PHO framework
The PHO framework is more than a tool for the external review of a public health protocol. It was designed for use by those who are developing the protocol – from the formulation of objectives through to reporting of the findings . We believe this will assist public health professionals in taking ownership of the ethical issues inherent in their practice, rather than complying with requirements imposed by an external ethics authority. This is particularly important in emergency situations, where action may need to be taken before formal ethics review could take place.
We recognize that extending ethics review to all knowledge-generating activities has major workload implications for an institution’s ethics oversight process. To address this issue, we are rolling out a number of tools and processes to manage the increased volume of projects that will come under scrutiny. These include:
a risk screening tool that creates a new risk category for minimal risk evaluative activities that have relatively well defined risks and which can be reviewed by the research ethics officer for appropriate measures to mitigate those risks.
the development of standardized protocols for certain types of routine evaluative activities that are pre-reviewed for ethics.
Once evaluated, these will be the subjects of future papers.
Adoption of this framework by public health organizations will require training of ethics review board members to manage the cultural shift to this framework from the traditional model of ethics review. This shift may not be particularly challenging, given the alignment of the framework with widely accepted public health principles. At PHO, we have used the framework as the basis for reviewer assessment forms, so that the ten questions are systematically applied to each project.
The PHO Framework in the context of other calls for ethics reform
Our PHO framework is consonant with a recent call for an ethics framework for the learning health care system, which also advocates for the integration of rather than the distinction between research and practice . That framework is structured around the obligations of multiple parties to contribute to the common purpose of improving the quality and value of clinical care and health care systems. Our framework particularly resonates with the last three obligations: to reduce health inequalities among populations; to conduct responsible activities that foster learning from clinical care and clinical information; and to contribute to the common purpose of improving the quality and value of clinical care and health care systems. With regard to the last obligation, the authors identify an obligation of the individual patient to contribute, under limited conditions, to learning that is integrated with their care. Similarly, public health is founded on the assumption that there are certain common goods that ought to be promoted. Rather than referring to obligations of individual patients, we have framed this in terms of the inter-dependence among members within and between communities and draw upon the principle of solidarity to promote our collective welfare.
While we acknowledge that the current research oversight system is often too bureaucratic, we do not agree with calls for exemption from ethics review as a class for surveys, focus groups, and similar research involving competent adults, as has been advocated in some circles . There may still be non-trivial risks associated with these data collection activities – particularly in public health, where one may be working with vulnerable populations, asking sensitive questions, or working with information that is not in the public domain. Consequently, at a minimum, all new evaluative studies involving human participants must complete the risk screening tool and undergo an initial screen by the ethics officer.
We are unaware of any published literature describing institutions that have taken an integrated perspective similar to that which we have put forward. Anecdotally, as we developed our framework, we learned that several local public health units also review quality improvement and research studies through the same process, but they had not created a comprehensive conceptual framework like ours. This may well be the case with other institutions.
Public Health Ontario has developed a framework to guide ethical reflection on all public health evaluative projects throughout their lifecycle – from initial planning through to knowledge exchange – eschewing the distinction between research and other evaluative activities. The framework is intended for use by those designing and executing public health evaluations, and not only for those charged with ethics review of projects.
While we have built upon the TCPS 2’s three core principles of respect for persons, concern for welfare, and justice, we have augmented these with concepts of: relational autonomy and respect for communities; the inter-relationship of individual and community welfare; solidarity and the common good; the positive obligation to promote social justice; and the importance of reciprocity in circumstances when individuals or subgroups put themselves at risk or bear substantial burden for the benefit of others.
The use of guiding questions rather than statements of principles or rules was chosen to help move toward a culture of ethical integrity among investigators, reviewers and decision-makers, rather than one of compliance with rules. We believe this to be consistent with the perspective of the learning organization. We believe the framework is generalizable to public health practitioners in other jurisdictions and, with appropriate adaptation, even beyond public health to any discipline engaged in applied evaluation of public programs and services including health services, education, and social sciences.
Otto JL, Holodniy M, Robert FD: Research or practice? Public health practice is not research. Am J Public Health. 2014, 104: 596-10.2105/AJPH.2013.301663.
Alberta Research Ethics Community Consensus Initiative: ARECCI Recommendations - FINAL. Protecting People While Increasing Knowledge: Recommendations for a Province-Wide Approach to Ethics Review of Knowledge-Generating Projects (Research, Program Evaluation, and Quality Improvement) in Health Care. 2005, Edmonton, AB: Alberta Heritage Foundation for Medical Research,http://www.assembly.ab.ca/lao/library/egovdocs/2005/alhfm/173539.pdf,
Baily MA, Bottler M, Lynn J, Jennings B: The Ethics of Using QI Methods to Improve Health Care Quality and Safety. 2006. 2006, New York, NY: The Hastings Center
Thurston WE, Vollman AR, Burgess MM: Ethical review of health promotion program evaluation proposals. Health Promot Pract. 2003, 4: 45-50. 10.1177/1524839902238290.
MacQueen KM, Buehler JW: Ethics, practice, and research in public health. Am J Public Health. 2004, 94: 928-931. 10.2105/AJPH.94.6.928.
Taylor HA, Pronovost PJ, Sugarman J: Ethics, oversight and quality improvement initiatives. Qual Saf Health Care. 2010, 19: 271-274. 10.1136/qshc.2009.038034.
National Research Ethics Service: Defining Research: NRES Guidance to Help you Decide if Your Project Requires Review by a Research Ethics Committee. 2013, Ottawa, Canada: National Patient Safety Agency,http://www.hra.nhs.uk/documents/2013/09/defining-research.pdf,
Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, Social Sciences and Humanities Research Council of Canada: Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans. 2010, Ottawa, Canada: Her Majesty the Queen in Right of Canada,http://www.pre.ethics.gc.ca/pdf/eng/tcps2/TCPS_2_FINAL_Web.pdf,
National Health & Medical Research Council: When Does Quality Assurance in Health Care Require Independent Ethical Review?. 2003, Canberra: Commonwealth of Australia,https://www.nhmrc.gov.au/_files_nhmrc/publications/attachments/e46.pdf,
Hodge JG: An enhanced approach to distinguishing public health practice and human subjects research. J Law Med Ethics. 2005, 33: 125-141.
Fairchild AL, Bayer R: Ethics and the conduct of public health surveillance. Science. 2004, 303: 631-632. 10.1126/science.1094038.
Kass NE, Faden RR, Goodman SN, Pronovost P, Tunis S, Beauchamp TL: The research-treatment distinction: a problematic approach for determining which activities should have ethical oversight. Hastings Cent Rep Special Report. 2013, 43 (1): S4-S15.
Ontario Agency for Health Protection and Promotion Act. S.O. Chapter 10, Schedule K. 2007, Toronto: Queen’s Printer for Ontario
Ontario Agency for Health Protection and Promotion (Public Health Ontario): A Framework for the Ethical Conduct of Public Health Initiatives. 2012, Toronto: Queen’s Printer for Ontario, 11-4-0013-http://www.publichealthontario.ca/en/eRepository/PHO%20%20Framework%20for%20Ethical%20Conduct%20of%20Public%20Health%20Initiatives%20April%202012.pdf,
Emanuel EJ, Wendler D, Grady C: What makes clinical research ethical?. JAMA. 2000, 283: 2701-2711. 10.1001/jama.283.20.2701.
Kass NE: An ethics framework for public health. Am J Public Health. 2001, 91: 1776-1782. 10.2105/AJPH.91.11.1776.
Fleischman A, Levine C, Eckenwiler L, Grady C, Hammerschmidt DE, Sugarman J: Dealing with the long-term social implications of research. Am J Bioeth. 2011, 11: 5-9.
Anderson JA, Sawatsky-Girling B, McDonald M, Pullman D, Saginur R, Sampson HA, Willison DJ: Research ethics broadly writ: Beyond REB review. Health Law Review. 2011, 19: 12-24.
Faden RR, Kass NE, Goodman SN, Pronovost P, Tunis S, Beauchamp TL: An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics. Hastings Cent Rep Special Report. 2013, 43 (1): S16-S27.
Emanuel EJ, Menikoff J: Reforming the regulations governing research with human subjects. N Engl J Med. 2011, 365 (12): 1145-1150. 10.1056/NEJMsb1106942.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6939/15/61/prepub
The PHO framework was developed with the input a broad cross-section of public health and ethics professionals and scholars. As well, we received comments from individuals at the Canadian Institutes of Health Research, the Public Health Agency of Canada, the Inter-Agency Panel on Research Ethics, the Registered Nurses Association of Ontario, and the U.S. Centres for Disease Control and Prevention. We wish to express our thanks to all those who offered feedback on the earlier draft of the framework.
This work was supported through internal funds from Public Health Ontario.
The authors declare that they have no competing interests.
DW conceptualized and led the development of the ethics framework. He oversaw the writing and revision of the framework report and wrote the first draft of this manuscript, along with subsequent revisions. NO was coordinator for this project and was responsible for writing and revising the drafts of the full framework report, published on the Public Health Ontario website. She was also integrally involved with reviewing and revising this manuscript. AD, CE, LF, RS, HS, and RU were all members of the working group that developed the ethics framework. They all contributed substantively to review and revision of both the full framework document and this manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Willison, D.J., Ondrusek, N., Dawson, A. et al. What makes public health studies ethical? Dissolving the boundary between research and practice. BMC Med Ethics 15, 61 (2014). https://doi.org/10.1186/1472-6939-15-61