Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Ethics review of studies during public health emergencies - the experience of the WHO ethics review committee during the Ebola virus disease epidemic

  • Emilie Alirol1,
  • Annette C. Kuesel2Email author,
  • Maria Magdalena Guraiib3,
  • Vânia de la Fuente-Núñez3,
  • Abha Saxena3 and
  • Melba F. Gomes4
BMC Medical EthicsBMC series – open, inclusive and trusted201718:43

DOI: 10.1186/s12910-017-0201-1

Received: 14 September 2016

Accepted: 8 June 2017

Published: 26 June 2017

The Erratum to this article has been published in BMC Medical Ethics 2017 18:45

Abstract

Background

Between 2013 and 2016, West Africa experienced the largest ever outbreak of Ebola Virus Disease. In the absence of registered treatments or vaccines to control this lethal disease, the World Health Organization coordinated and supported research to expedite identification of interventions that could control the outbreak and improve future control efforts. Consequently, the World Health Organization Research Ethics Review Committee (WHO-ERC) was heavily involved in reviews and ethics discussions. It reviewed 24 new and 22 amended protocols for research studies including interventional (drug, vaccine) and observational studies.

WHO-ERC reviews

WHO-ERC provided the reviews within on average 6 working days. The WHO-ERC often could not provide immediate approval of protocols for reasons which were not Ebola Virus Disease specific but related to protocol inconsistencies, missing information and complex informed consents. WHO-ERC considerations on Ebola Virus Disease specific issues (benefit-risk assessment, study design, exclusion of pregnant women and children from interventional studies, data and sample sharing, collaborative partnerships including international and local researchers and communities, community engagement and participant information) are presented.

Conclusions

To accelerate study approval in future public health emergencies, we recommend: (1) internally consistent and complete submissions with information documents in language participants are likely to understand, (2) close collaboration between local and international researchers from research inception, (3) generation of template agreements for data and sample sharing and use during the ongoing global consultations on bio-banks, (4) formation of Joint Scientific Advisory and Data Safety Review Committees for all studies linked to a particular intervention or group of interventions, (5) formation of a Joint Ethics Review Committee with representatives of the Ethics Committees of all institutions and countries involved to strengthen reviews through the different perspectives provided without the ‘opportunity costs’ for time to final approval of multiple, independent reviews, (6) direct information exchange between the chairs of advisory, safety review and ethics committees, (7) more Ethics Committee support for investigators than is standard and (8) a global consultation on criteria for inclusion of pregnant women and children in interventional studies for conditions which put them at particularly high risk of mortality or other irreversible adverse outcomes under standard-of-care.

Keywords

Ebola Research ethics WHO ethics review committee Pregnancy Children Clinical research Drugs Vaccines Observational studies

Background

The Ebola Virus Disease (EVD) epidemic in West Africa began in December 2013 and was declared a “public health emergency of international concern” on 8 August 2014. On 29 March 2016, the World Health Organization (WHO) declared that it no longer constituted such an emergency [1].

Before this epidemic, EVD research was limited to laboratory studies and experience gathered during previous outbreaks [29]. Clinical management of EVD cases relied on rehydration, electrolyte replacement, analgesia and treatment of co-infections, with mortality ranging from 40 to 100% depending on age and country [1012]; no proposed therapy had undergone clinical testing [2, 13, 14]. Vaccines were in very early development [1521]. A panel of experts convened by WHO in August 2014 concluded that use of unregistered interventions was acceptable provided that laboratory and animal data had yielded positive results [22]. The Panel advised that researchers had “a moral duty to also evaluate these interventions for treatment or prevention, in the best possible clinical trials in order to definitely prove their safety and efficacy or to provide evidence to stop their utilisation.” With the unprecedented scale of the epidemic and the high case-fatality rate, accelerated vaccine and drug development carried the hope that it could help control an epidemic spinning out of control [23, 24].

Clinical trials during emergencies are inherently difficult and raise a number of ethical issues [2531]. WHO played a prominent role in supporting research. WHO requires all research involving human participants which WHO supports financially or technically to be approved by the WHO Research Ethics Review Committee (WHO-ERC), which was consequently heavily involved in reviews and ethics discussions. This paper describes our experience and reflects lessons for future public health emergencies (PHE).

Application of WHO-ERC rules of procedure

The WHO-ERC is a 27 member independent committee nominated by the WHO Director-General. The membership is gender and WHO-region balanced, includes expertise in clinical research, drug development, social sciences, legal affairs etc. as well as a lay member. Between 6 and 8 members are from Geneva based universities or international organizations. The WHO-ERC Chair can request input from experts in disciplines not represented on the committee. WHO-ERC members are bound by the rules confidentiality.

The WHO-ERC applies the Council for International Organizations of Medical Sciences guidelines [32]. It normally meets monthly to review protocols meeting the criteria for ‘full committee review’ specified in the WHO-ERC Rules of Procedures (ROP). All submissions require the written assessment and approval of independent scientific reviewers (http://www.who.int/ethics/review-committee/en/).

The ROP provide for ‘accelerated review’ of PHE-related research. The EVD outbreak was the first time accelerated review was implemented. It was facilitated through several measures:
  1. (1)

    An information session was organized to inform all WHO-ERC members about WHO plans for EVD related studies, the drugs and vaccines likely to be evaluated and the context in which studies would be conducted. Documents from related WHO consultations were disseminated [22].

     
  2. (2)

    A WHO-ERC EVD sub-committee was created to accelerate review of EVD research without compromising other reviews. Members had experience in clinical trials, drug development, infectious diseases and disease surveillance, epidemiology and social sciences and volunteered to review submissions at short notice and attend ad-hoc meetings. No lay person was part of the sub-committee. Other WHO-ERC members were involved in the review to meet expertise or time pressure requirements.

     
  3. (3)

    Four EVD sub-committee meetings and numerous ad-hoc teleconferences were held in addition to the regular monthly meetings.

     
  4. (4)

    WHO-ERC members reviewed submissions as received and completed assessment after receipt of missing elements.

     

Protocols reviewed

From August 2014 to April 2016, WHO-ERC reviewed 24 new EVD-protocols and 22 amendments. Table 1 and Table 2 show the observational and interventional studies reviewed, including two protocols for ‘Monitored Emergency Use of Unregistered and Experimental Interventions’ (MEURI), a term coined by the WHO Ethics Working Group [33] to distinguish use of unregistered interventions in PHE from compassionate use or expanded access. Four of the five therapeutic intervention protocols did not involve WHO, but WHO-ERC provided its opinion at the request of the chair of the MSF Ethics Review Board [34].
Table 1

Observational studies reviewed by the WHO Ethics Review Committee

Study design

Country

Protocol title

Cohort

Sierra Leone

Persistence of Ebola virus in body fluids of Ebola virus disease survivors

Case series

Guinea, Liberia, Sierra Leone

Ebola virus disease due to transmission from survivors: a case series

Case-control

N/A

WHO emergency quality assessment mechanism protocol for laboratory evaluation of Ebola virus antigen-detection in vitro diagnostics

Cross-sectional

Guineaa

Etude observationnelle et rétrospective des patients atteints d’Ebola à Conakry, pour déterminer les facteurs de risque de décès

Guineab

Patients admitted to Ebola treatment centres in Conakry, Guinea: a retrospective observational study

N/A

Health care providers experiences, values and preferences regarding the selection and use of personal protective equipment in the context of Ebola virus disease outbreaks in Africa

N/A

A review of the risk factors that contribute to psychological well-being of GOARN and WHO experts involved in Ebola response operation in West Africa

N/A

Survey of EBOV Exposure and Infection Among Expatriate Aid Workers during the 2014–2015 Ebola Outbreak in West Africa

aThis study was not approved by the ERC. It was resubmitted as study band approved by the ERC.

Table 2

Interventional protocols reviewed by the WHO Ethics Review Committee

Intervention

Product

R&D Phase

Country

Protocol ID (design)

Vaccine

VSVΔG-ZEBOV

Phase I/II

Switzerland

NCT02287480

Kenya

NCT02296983

Gabon

PACTR201411000919191

Germany

NCT02283099

Phase II

Guinea (survivors and their contacts and contacts of contacts)

No registration number available.

Phase III

Guinea (general population)

PACTR201503001057193

Sierra Leone (general population)

Amendment of PACTR201503001057193

Guinea (healthcare workers)

Component of PACTR201503001057193

cAd3-EBOZ

Phase Ib

Mali

NCT002267109

The Gambia

Not registered, Not initiated.

Switzerland

NCT02289027

Treatment

Brincidofovir

Phase II

Liberia

NCT02271347

Favipiravir

Phase II

Guinea

NCT02329054

MEURI

Guinea

N/A

MIL 77

MEURI

Sierra Leone, Guinea

N/A

Convalescent plasma

Phase II/III

Guinea

NCT02342171

Review times

Table 3 provides summary statistics on review times. WHO-ERC provided the review outcomes within on average 6 working days.
Table 3

Review time for EVD-related new submissions

Review type

Daysa from complete submission to ERC initial decision

Mean, Median (range)

Daysa from initial ERC decision to response from WHO RO

Mean, Median (range)

Daysa from response by WHO RO to final ERC approval

Mean, Median (range)

Total Daysa from complete submission to final ERC approval

Mean, Median (range)

Full-Committee review

6.8, 6 (3–12)

6.8, 7 (0–14)

6.5, 4 (1–18)

18.8, 18 (4–32)

Expedited reviewb

5.4, 4 (0–15)

7.2, 6.5 (2–13)

4.3, 4 (1–9)

14, 17 (0–26)

All types of review

5.8, 5 (0–15)

6.9, 7 (0–14)

5.7, 4 (1–18)

15, 16.5 (0–32)

This table covers only protocols which required ERC review according to WHO-ERC Rules of Procedure (ROP), i.e. protocols of studies for which WHO provides technical support or funding. It does not include protocols reviewed by the ERC at the request of third parties. Only working days are counted, weekends and WHO official holidays are excluded.

Abbreviations: WHO RO, WHO Responsible Officer. As per WHO-ERC ROP, all submissions to WHO-ERC are done by the WHO staff responsible for the study and WHO-ERC feedback is provided to the WHO RO.

aWorking days

bAs per WHO-ERC ROP, a protocol is eligible for ‘Expedited Review’ (i.e. review by two WHO-ERC members, but not by the whole committee) if: (i) it will expose research participants to no more than minimal risk i.e. the level of risk to which it will expose participants is no greater than that encountered by people involved in their normal daily activities, such as working at home, in an office, or on a farm, attending school, or undergoing a routine health examination, (ii) minor changes are planned in research that has been previously approved by the ERC and where proposed changes do not create more than minimal risks; (iii) an additional research centre is added to a project previously approved on a multi-centre basis, such that ERC review is limited to ensuring that the necessary local review and approval has taken place.

We minimised time from protocol review to approval by discussion of issues with WHO responsible officers and researchers. The WHO-ERC Secretariat/chair provided hands-on advice for simplifying Participant Information Documents and discussed questions with Data safety monitoring bodies.

WHO-ERC considerations during protocol review

ECs must evaluate submissions in relation to the specific context of the study and consider how protocol provisions (e.g. interventions, study design, eligibility criteria, community engagement, approach to vulnerable populations) impact autonomy and benefit-risk ratio for participants, justice, scientific validity and social value, and their balance.

Observations that resulted most frequently in requests for justification, clarification or protocol amendment are listed in Table 4. Major challenges and the specific EVD outbreak context are presented below.
Table 4

Observations resulting in ERC requests for clarification or amendment of protocols and associated documents

Principle

 

Observations

Beneficence

Benefit, risk to study participants

• Inconsistencies in participant selection criteria and measures to minimize risk for study participants (duration/type of contraceptives, frequency of follow-up, type of follow up examinations, Data Safety Monitoring Board functioning) between studies examining the same intervention in the same phase of development.

• Different standards in the assessment of AEs and SAEs among trials testing the same vaccine.

• Unjustified collection of samples.

 

Risks to study team or EVD response

• Sub-optimal measures to reduce risk associated with handling of blood samples.

• Suboptimal measures to protect Ebola Treatment Units from effect of information about the study and/or the investigational compound.

 

Study design - comparator

• Insufficient information on measures to minimize bias in the use of historical controls

 

Study design - outcome measures

• Inconsistencies in parameters used to characterize intervention risks

• Poor differentiation between deaths due to potential toxicity vs. deaths due to lack of efficacy

 

Safety data from prior studies and dose justification

• Lack of information on safety data from previous studies

• Lack of documentation on assessment, or insufficient clarity of assessment of safety data by Data Safety Monitoring Board

• Lack of documentation of approval of dose by Data Safety Monitoring Board

• Insufficient dose justification

Justice

Equitable access

• Lack of justification for exclusion of children and pregnant women

• Lack of criteria for trial participant selection when experimental intervention was available in limited quantity

 

Impact of studies on routine patient care

• Lack of information on how the study could be conducted in the Ebola Treatment Centres without reducing staff capacity to provide best ‘standard-of-care’ to those not participating in the trial

 

Sample and data sharing

• Lack of information on rules and procedures for sample ownership

• Lack of information on how results would be shared with participants and their communities

 

Future use of remaining samples

• Lack of information on ownership, storage, and disposal of samples.

• Lack of information on procedures to determine future use of left-over samples

• Lack of information in the Information Documents on future use and shipment of samples.

 

Collaborative partnership

• Lack of information on the role of country researchers and health system in study design, planning and implementation

 

Accountability

• Lack of information on roles and responsibilities of different investigators

Respect for persons

Information documents

• Information documents provided in technical language with scientific and legal jargon

• Inconsistencies between protocol and information document

 

Plans for obtaining informed consent

• Study implementation plans with insufficient time planned between informing participants and consent/start of protocol planned procedures

• Lack of clarity of criteria to determine potential participants’ ability to provide consent.

 

Confidentiality

• Lack of sufficient information on how potential participants other than those in treatment centres or identified during contract tracing were to be approached, and on measures to keep their participation confidential

Beneficence: Benefits, risks and benefit-risk ratio

Concern for research participants’ welfare is paramount during ethics review. Known and potential risks and benefits of research participation are examined and the benefit-risk ratio assessed [32, 35, 36]. This assessment was complicated by the fact that during the EVD epidemic, conditions and information on Ebola mortality evolved over time and differed between Ebola Treatment Centres (ETC). Mortality figures ranged from 40% to 100% [1012].

It was important for WHO-ERC that experimental interventions and doses selected had been recommended by an independent scientific committee, a WHO coordinated expert panel (early phase studies) or approved by Data Safety Monitoring Boards (later phase studies). Experimental interventions were evaluated on whether they were likely to have benefit (improve the chances of survival or reduce the probability of infection) or increase risk (result in serious temporary or irreversible adverse reactions, including death). WHO-ERC also evaluated the likely relative benefit-risk ratio in the treatment arms proposed, whether participant selection and follow-up plans were suitable for minimizing risks, feasible within the planned setting, could increase inequities in service delivery in the ETC and whether risks to health care workers and response teams were minimized.

For all studies in the EVD-affected countries, WHO-ERC agreed with the benefit-risk ratio assumptions underlying the submitted protocols.

Beneficence - scientific validity: Study design

Research places participants at known or potential risk with uncertain benefit to the participants for the potential benefit of future patients, i.e. future social value. Studies that are not scientifically valid are inherently unethical, as they fail to meet the social value criterion. Requirements for scientific robustness and social value cannot, however, take precedence over the requirement to maximize benefit and minimize risk for study participants.

Design of interventional EVD trials was controversial and divided opinions between researchers, physicians, ethicists and regulators [26, 37]. At the heart of the controversy was whether randomised controlled trials (RCTs) could (acceptability) or should (moral justification, efficiency, social value) be used to evaluate therapeutics or vaccines for a life threatening disease for which no treatment is available [27, 28, 38, 39]. RCT advocates argued that scientific validity could not be ensured without a comparator arm (i.e. standard-of-care) [28, 30, 37]. Given limited doses of experimental therapeutics and vaccines, RCT advocates also considered that this design best ensured unbiased and fair intervention allocation [37]. On the other hand, many opposed RCTs because of the high case fatality rates under standard-of-care [40]. Adaptive designs were proposed to quickly determine the relative value of different interventions in reducing mortality rates [40]. RCT opponents also argued that the limited number of doses of investigational interventions could preclude adequate RCT sample size, making other designs better suited to provide scientifically valid conclusions [26, 27].

As per WHO-ERC ROP, all protocols had received independent scientific review approval. WHO-ERC considered study design in the context of the combination of the following factors distinguishing the EVD PHE:
  1. a)

    Uncertain epidemic evolution, and hence uncertainty that studies could be completed as planned;

     
  2. b)

    Limited and/or uncertain availability of investigational interventions;

     
  3. c)

    Uncertain benefit-risk ratio of investigational interventions and ‘standard-of-care’; the latter differed between ETC and evolved over time, impacting assessment of the relative benefit-risk ratio of the interventions;

     
  4. d)

    Limited and evolving knowledge about EVD, and uncertainty about effect modifiers/confounders;

     
  5. e)

    A target population ill-equipped to understand study design implications;

     
  6. f)

    Limited time for social mobilization and risk posed by communities’ negative perception of research for the EVD response efforts;

     
  7. g)

    Uncertainty about the requirements for marketing approval of experimental interventions showing favourable results and consequences of this uncertainty for future access to effective and safe interventions.

     

The therapeutic trials reviewed were single arm non-comparative studies with historical controls (NCT02329054 and NCT02271347) and a comparative, non-randomized study with a concurrent control group who received the standard-of-care when supply of the investigational intervention was insufficient (NCT02342171) (Table 2). WHO-ERC considered these designs appropriate for generating valid scientific knowledge without withholding the intervention from those who could potentially benefit.

For vaccine trials, the decision on whether a placebo is ethically acceptable depends on availability of an established therapy or vaccine, the risk of infection, the associated morbidity and mortality, the location of the study population, and the trial phase. The Phase I/II vaccine trials were dose-ranging placebo controlled, immunogenicity and safety studies in countries not affected by the epidemic (Switzerland, Kenya, Mali, The Gambia, Gabon), with participants randomized between different vaccine doses and placebo [41, 42]. Studies in Switzerland expected some volunteers from organizations which deployed staff to affected countries. WHO-ERC agreed that these studies could allocate volunteers who might be deployed only to vaccine arms to maximize potential for direct benefit.

The Phase III study of the VSVΔG ZEBOV vaccine (PACTR201503001057193) proposed a novel approach to a comparator arm: it randomized contacts of new EVD cases (rings, each constituting a cluster) to immediate or delayed vaccination 21 days after randomization, i.e. no vaccination within the estimated 10–21 days incubation period. The WHO-ERC agreed with the design from the perspective of distributive justice (see below), given immunogenicity data from healthy volunteer studies suggesting a potentially favourable benefit-risk ratio for all vaccinated individuals and considering that (a) participants were at risk of infection, but not infected and thus not at immediate risk of death; and (b) the ‘delayed vaccination arm’ would enhance the social value of the study by providing robust comparative data [43, 44]. WHO-ERC appreciated the additional value of the trial design in providing a ‘herd effect’ to those excluded from vaccination (children, pregnant women) and efficacy assessment under conditions in which the vaccine would be used if found to be safe and effective. There were two main concerns: whether ring members would fully understand the differences in risks between the immediate and delayed vaccination groups and the exclusion of children and pregnant women who were at highest risk of mortality (see below). WHO-ERC asked the team to ensure a strong community-engagement plan to maximize understanding of measures to reduce risk of infection and to facilitate acceptance of exclusion of children and pregnant women.

Observational studies (Table 1) were designed to research the natural history of EVD, specific vulnerabilities of different populations with suspected or confirmed EVD and virus persistence in survivors [45, 46]. WHO-ERC considered all suitable for yielding valid information for guidelines and prevention strategies in future Ebola epidemics. The most challenging issue for WHO-ERC was how and when negative test results ought to be communicated to participants in the virus persistence studies given uncertain diagnostic test performance. WHO-ERC favoured informing participants after each test with appropriate precautions, balancing this against the risk of loss of trust and potential spread of infection engendered by non-communication. To improve understanding of test limitations and lessen the risk of stigmatization for survivors with positive EVD-test results, WHO-ERC requested piloting the information documents with survivors and intensive training of counsellors providing the test results.

Justice - exclusion of children and pregnant women

The ethical principles of justice (fairness, equity and maximisation of benefit) are often undermined by exclusion of children and pregnant women from clinical research. A large proportion of medicines are used in children and pregnancy without sufficient evidence in these populations, including on the appropriate dose [4750].

EVD-related maternal mortality was around 90% in previous outbreaks, foetal and newborn loss approached 100%, and mortality rates were highest among children ≤4 years [10, 5154]. Consequently, exclusion of pregnant women and children from clinical trials denied the potential benefits of interventions to those most severely affected. Furthermore, lack of trial data would translate into their exclusion from registration and hinder future access to effective interventions.

WHO-ERC systematically requested protocol amendments to include pregnant women and children (including unaccompanied minors), unless their exclusion was justified by data demonstrating that the risk of treatment was likely to exceed risks with ‘standard of care’. Given the time pressure for study initiation and mindful that legal issues might be driving exclusion of these groups, the trade-off was between ‘delayed initiation with potential benefit for all’ versus ‘immediate initiation with potential benefit for the majority’ and WHO-ERC did not insist on protocol amendments when data-based justifications were not provided.

Justice - data and sample sharing

In 13/24 (54%) protocols the investigators proposed obtaining biological samples and in 33% (8/24) retaining unused samples for future use. Such samples provided an unique opportunity for creating a common good and contributing to development of future EVD diagnostics and interventions. Discussions on an international bio-bank with global governance structure started early during the epidemic but such a bio-bank was not in place when WHO-ERC reviewed protocols [55, 56].

WHO-ERC requested clarifications of sample and data ownership, data sharing policy, processes for decisions on future use of samples and appropriate participant information. In view of the urgency, WHO-ERC approved studies based on researcher commitment to put appropriate agreements/processes in place.

Respect for persons - informed consent, collaborative partnership, community engagement and monitoring of study implementation

Therapeutic trials took place in ETCs where potential participants were likely to be extremely sick, isolated, and informed about the research by staff wearing protective equipment with limited time for presenting and discussing each study. Patients were probably aware of their risk of death and likely to perceive study participation as their only chance for survival. WHO-ERC was mindful of the limitations of obtaining informed voluntary consent in this context and suggested ways of easing information and consent procedures. Simplifying language and reducing information document elements, encouraging dialogue while EVD diagnosis was being confirmed and before isolation in ETCs were approaches proposed to increase understanding and reduce the risk of ‘situational coercion’.

For two protocols, consent to retrieve anonymized information from patient records was waived because data would improve understanding of the disease (high social value) and seeking consent from previous, sometimes deceased patients, would have been impractical.

The social environment was characterized by distrust of large fractions of the populations towards many involved in responding to the epidemic, especially those from the international communities. Consequently, WHO-ERC considered involvement of local scientists familiar with culture, attitudes, language and socio-economic context even more important than for other studies and indispensable despite the strain of the outbreak on local resources. In at least 8/24 protocols reviewed, the role of local stakeholders was insufficiently specified and WHO-ERC sought to obtain clarification of their involvement.

Good Clinical Practice Guidelines require sponsors to verify study implementation per protocol through monitoring [57, 58]. WHO-ERC reviewed monitoring plans of all prospective studies, realizing that standard monitoring approaches were not feasible for studies in ETCs. In view of the enrolment of individuals at risk of, or survivors of, EVD, WHO-ERC reviewed monitoring reports with particular attention to implementation of measures to improve understanding of procedures, risks and test results (see above). In one instance WHO-ERC requested an additional independent monitoring visit.

Recommendations for future outbreaks/PHEs

The 2013–2016 Ebola outbreak, the largest ever, was marked by high mortality and high levels of uncertainty. Information normally well-defined in research protocols – standards of care, levels of risks, age and gender-specific morbidity and mortality rates – was uncertain, changing and different between ETCs. Everyone, including front-line workers, researchers and Ethics Committees (ECs) worked with imperfect and uncertain data under pressure [10, 11, 34, 40, 45, 59].

Other outbreaks/PHE will have different epidemiology, treatment options and level of uncertainty and will occur in different health care, economic and socio-psychological settings. Because ECs must always evaluate submissions in relation to the specific context, our recommendations can only address the common characteristics of outbreaks/PHEs.

The hallmark of a PHE is the urgency to control and to conduct research in the face of uncertainty, suboptimal conditions and pressure. The tension between obtaining knowledge for the benefit of future patients and the interests of participants is heightened during outbreaks/PHEs, in particular when the risk of irreversible morbidity and/or mortality is high, there are many unknowns and research to identify interventions is urgent.

EC approval is the last step before research implementation and the prospect of achieving some good. Our experience leads us to propose measures to facilitate EC approval that we consider applicable to any outbreak/PHE (as well as outside PHEs). The Ethics Review Board of Médecins Sans Frontières and a ‘Committee on Clinical Trials During the 2014–2015 Ebola Outbreak’ constituted by the US National Academy of Science to analyse the EVD clinical trials make some similar and complementary recommendations [34, 60].

Preparation of submissions

Most issues that prevented immediate approval (Table 4) were avoidable and not EVD-specific: (i) insufficient or inconsistent information on key elements (e.g. sample size, inclusion-exclusion criteria, safety follow-up, community sensitization, role of local researchers); (ii) lengthy, technical participant information documents inappropriate for the target population; (iii) missing information on provisions for sharing and use of data, governance and jurisdiction over leftover samples, study coordination and governance.

We recommend that investigators invest time in ensuring submissions are internally consistent and complete, with information documents participants can understand (e.g. through pre-submission quality control by somebody not involved in document preparation but familiar with ethics guidelines and templates/check-lists many Ethics Committees provide and by testing information document comprehension with representatives of the target population).

Improved collaboration between local and international researchers

Given the resource-limited settings in the EVD-affected countries, research studies were often led by international staff and the roles of local researchers frequently unclear (see above, Table 4). Research participants were invariably seriously ill, at risk of infection, or facing stigmatization and its consequences, afraid, vulnerable, and unclear about the objectives, benefits and risks of study participation and the distinction between research and medical practice. Many of these characteristics will be encountered in other PHEs. For community and participant engagement before, during and after a study based on understanding of the local culture, attitudes, and socio-psychological situation, and appropriate study implementation plans, close collaboration of local and international researchers is essential.

Template agreements for data and bio specimen ownership and use

Information on sample and data ownership, data sharing policy, processes for determining future use of samples was frequently insufficient (see above, Table 4). Related agreements are critical for ensuring study participants and communities (in the widest sense) benefit from study results. Negotiating agreements is complex and consumes time not available in outbreaks/PHE. Template agreements emerging from international consultations, e.g. the discussions about an international Ebola bio-bank [55, 56] could accelerate study-specific agreements on data and bio-specimen ownership, governance of bio-specimen use and affordable access to any resulting licensed interventions or diagnostics.

Scientific, data and safety monitoring, and ethical review

In some cases, scientific review and data safety monitoring committee reports did not reassure WHO-ERC that all relevant data had been considered and WHO-ERC required confirmation or access to these data which delayed feedback.

We recommend creation of a Joint Scientific Advisory Committee and a Joint Data Safety Monitoring Committee for studies linked to a particular intervention, or group of interventions (e.g. the same vaccine) to ensure (and reassure ECs) that recommendations for one study (e.g. dose selection) are made with detailed knowledge of the results of all other relevant studies. The ethical value of cross-trial data sharing between sponsors and Data Safety Review Committees has previously been suggested previously [61].

Many trials required approval from several ECs. Although many EC reviews were consistent, some were discordant [34, 62]. Consolidating reviews was explored but proved largely unfeasible. We recommend the constitution of a Joint Ethics Review Committee (J-ERC) with representatives of the ECs of all relevant countries/institutions [63]. Their secretariats would decide on distribution of secretarial functions. A J-ERC might face practical and legal issues, but the advantages should motivate efforts to overcome these: A J-ERC could strengthen reviews because members would represent the range of perspectives without the ‘opportunity cost’ of multiple reviews delaying final approval. Furthermore, a J-ERC would be more aware of potentially ‘competing’ studies planned in the same country or centre and could address resulting ethical issues (e.g. implications for potential participants of simultaneous studies at the same site with the same or very similar eligibility criteria). A J-ERC might feel more comfortable to modify/waive informed consent requirements when truly informed voluntary consent is unlikely. J-ERC members might be authorised to engage closer with researchers than is standard to minimize time to approval of study plans/information documents (e.g. discussion of revised information documents before re-submission). Direct communication between the Chairs of the J-ERC, the Joint Scientific Advisory and the Joint Data Safety Monitoring Committees could further reduce time to approvals.

Review of criteria for inclusion of pregnant women and children

Inclusion of women in clinical research was achieved in the 1990ies [6466] but pregnant women continue to be excluded, even from Phase IV studies on conditions affecting them [67]. In the US, all medicines for non-obstetrical conditions in pregnant women have to be used ‘off-label’ [65, 68]. Pregnant women and treating physicians thus face the choice between the risks of no treatment and the risks of ‘de-facto clinical research’ without the rigour and safeguards of prospective clinical trials. Pregnancy registries collecting outcomes from such ‘de-facto clinical research’ are currently the primary source of information on the effects of drugs taken by women during pregnancy and lactation [69]. Lack of clinical trial data to inform treatment of children has motivated regulatory requirements and incentives for such trials [4750, 70].

Despite the high EVD-related mortality among children, pregnant women/foetuses and neonates [10, 5154], exclusion of pregnant women and children in EVD research protocols was a consistent and intractable problem. Denial of the potential benefits of trial participation to pregnant women, foetuses and children resulted in individual injustice. Their exclusion as groups resulted in social injustice and reduced social value. This will translate into less, if any, availability of the interventions for pregnant women and children during the next epidemic, further reducing social justice and value of the trials. The EVD epidemic thus exposed standard clinical trial approaches in drug and vaccine development that missed the opportunity of including these groups in clinical research.

Among the challenges faced, we consider this the most difficult to address since it involves scientific, ethical, and also legal liability issues. A global consultation on inclusion of children and pregnant women in trials for conditions putting them and the foetus/new born at high risk of mortality or other irreversible adverse outcomes should be convened to increase individual and social justice of future trials and increase potential for changes to guidelines, regulations and future practice.

Conclusions

Despite time and psychological pressure, we did not identify shortcuts to fulfilling our mandate conscientiously; the moral and ethical imperative was to examine the submissions as thoroughly and with the same type of considerations the WHO-ERC applies to studies outside PHE. Future outbreaks/PHEs will differ from the EVD outbreak in epidemiology, morbidity and mortality, treatment options, health care system capacity and psycho-socio-economic context which affects the ethical acceptability of protocols. Our experience suggests that advance agreements on the principles governing bio-specimen and data use, prior consultations on inclusion/exclusion of pregnant women and children, and exploration of joint scientific, data safety monitoring and ethical reviews early in the next PHE could accelerate finalization of study plans and ethics approval; in other respects there is no substitute for good research protocols and thorough EC review, even under pressure.

Notes

Abbreviations

EC: 

Ethics Committee

ETC: 

Ebola Treatment Centres

EVD: 

Ebola Virus Disease

J-ERC: 

Joint Ethics Review Committee

MEURI: 

Monitored Emergency Use of Unregistered and Experimental Interventions

PHE: 

Public health emergencies

RCT: 

Randomized controlled trial

ROP: 

Rules of Procedures

WHO: 

World Health Organization

WHO-ERC ERC: 

World Health Organization Ethics Review Committee

Declarations

Acknowledgements

We gratefully acknowledge the contribution to the WHO-ERC Ebola-research review of M.R. Balakrishnan, A. Baller, P. Bouvier, K. Fernandez, K. Kennedy, O. Mach, N. Magrini, C. Maure, E. Mumford, B. Ramirez, N. Rollins, M. Senga, J.U. Sommerfeld, S. Suri, and J. Wang-Cavallanti.

Fundings

Not applicable.

Availability of data and materials

Not applicable.

Authors’ contributions

All authors contributed to WHO-ERC reviews of Ebola related research as members of the WHO-ERC secretariat (MMG, VF-N, AS) or the WHO-ERC (EA, ACK) and WHO-ERC chair (MFG). All authors were involved in drafting or critically reviewing and revising the manuscript. All authors read and approved the final version of the manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

licensee BioMed Central. This is an open access article distributed under the terms of the Creative Commons Attribution IGO License (http://creativecommons.org/licenses/by/3.0/igo/legalcode), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. In any reproduction of this article there should not be any suggestion that WHO or this article endorse any specific organisation or products. The use of the WHO logo is not permitted. This notice should be preserved along with the article's original URL.

Authors’ Affiliations

(1)
Global Antibiotics Research and Development Partnership (GARDP), Drugs for Neglected Diseases initiative (DNDi)
(2)
World Health Organization, UNICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases
(3)
World Health Organization, Department for Information Evidence and Research
(4)
World Health Organization

References

  1. World Health Organization: Statement on the 9th meeting of the IHR Emergency Committee regarding the Ebola outbreak in West Africa. http://who.int/mediacentre/news/statements/2016/end-of-ebola-pheic/en/ (2016). Accessed 08 Aug 2016.
  2. World Health Organization: Meeting summary of the WHO consultation on potential Ebola therapies and vaccines. http://apps.who.int/iris/handle/10665/136103 (2014). Accessed 14 Aug 2016.
  3. Borchert M, Mutyaba I, Van Kerkhove MD, Lutwama J, Luwaga H, Bisoborwa G, et al. Ebola haemorrhagic fever outbreak in Masindi District, Uganda: outbreak description and lessons learned. BMC Infect Dis. 2011;11:357.View ArticleGoogle Scholar
  4. Bitekyerezo M, Kyobutungi C, Kizza R, Mugeni J, Munyarugero E, Tirwomwe F, et al. The outbreak and control of Ebola viral haemorrhagic fever in a Ugandan medical school. Trop Dr. 2002;32:10–5.Google Scholar
  5. Khan AS, Tshioko FK, Heymann DL, Le GB, Nabeth P, Kerstiens B, et al. The reemergence of Ebola hemorrhagic fever, Democratic Republic of the Congo, 1995. Commission de Lutte contre les Epidemies a Kikwit. J Infect Dis. 1999;179(Suppl 1):S76–86.View ArticleGoogle Scholar
  6. Muyembe-Tamfum JJ, Kipasa M, Kiyungu C, Colebunders R. Ebola outbreak in Kikwit, Democratic Republic of the Congo: discovery and control measures. J Infect Dis. 1999;179(Suppl 1):S259–62.View ArticleGoogle Scholar
  7. Outbreak of Ebola hemorrhagic fever Uganda, August 2000–January 2001. MMWR Morb Mortal Wkly Rep 2001; 50: 73-77.Google Scholar
  8. Bwaka MA, Bonnet MJ, Calain P, Colebunders R, De RA, Guimard Y, et al. Ebola hemorrhagic fever in Kikwit, Democratic Republic of the Congo: clinical observations in 103 patients. J Infect Dis. 1999;179(Suppl 1):S1–7.View ArticleGoogle Scholar
  9. Mupapa K, Massamba M, Kibadi K, Kuvula K, Bwaka A, Kipasa M, et al. Treatment of Ebola hemorrhagic fever with blood transfusions from convalescent patients. International scientific and technical committee. J Infect Dis. 1999;179(Suppl 1):S18–23.View ArticleGoogle Scholar
  10. Agua-Agum J, Ariyarajah A, Blake IM, Cori A, Donnelly CA, Dorigatti I, et al. Ebola virus disease among children in West Africa. N Engl J Med. 2015;372:1274–7.View ArticleGoogle Scholar
  11. Aylward B, Barboza P, Bawo L, Bertherat E, Bilivogui P, Blake I, et al. Ebola virus disease in West Africa--the first 9 months of the epidemic and forward projections. N Engl J Med. 2014;371:1481–95.View ArticleGoogle Scholar
  12. Hsieh YH. Temporal course of 2014 Ebola virus disease (EVD) outbreak in West Africa elucidated through morbidity and mortality data: a tale of three countries. PLoS One. 2015;10:e0140810.View ArticleGoogle Scholar
  13. World Health Organization: Potential Ebola therapies and vaccines: interim guidance. http://apps.who.int/iris/handle/10665/137590 (2014). Accessed 14 Aug 2016.
  14. Bausch DG, Sprecher AG, Jeffs B, Boumandouki P. Treatment of Marburg and Ebola hemorrhagic fevers: a strategy for testing new drugs and vaccines under outbreak conditions. Antivir Res. 2008;78:150–61.View ArticleGoogle Scholar
  15. Jones SM, Feldmann H, Stroher U, Geisbert JB, Fernando L, Grolla A, et al. Live attenuated recombinant vaccine protects nonhuman primates against Ebola and Marburg viruses. Nat Med. 2005;11:786–90.View ArticleGoogle Scholar
  16. Qiu X, Fernando L, Alimonti JB, Melito PL, Feldmann F, Dick D, et al. Mucosal immunization of cynomolgus macaques with the VSVDeltaG/ZEBOVGP vaccine stimulates strong ebola GP-specific immune responses. PLoS One. 2009;4:e5547.View ArticleGoogle Scholar
  17. Geisbert TW, Daddario-DiCaprio KM, Lewis MG, Geisbert JB, Grolla A, Leung A, et al. Vesicular stomatitis virus-based ebola vaccine is well-tolerated and protects immunocompromised nonhuman primates. PLoS Pathog. 2008;4:e1000225.View ArticleGoogle Scholar
  18. Geisbert TW, Geisbert JB, Leung A, Daddario-DiCaprio KM, Hensley LE, Grolla A, et al. Single-injection vaccine protects nonhuman primates against infection with marburg virus and three species of ebola virus. J Virol. 2009;83:7296–304.View ArticleGoogle Scholar
  19. Geisbert TW, Bailey M, Hensley L, Asiedu C, Geisbert J, Stanley D, et al. Recombinant adenovirus serotype 26 (Ad26) and Ad35 vaccine vectors bypass immunity to Ad5 and protect nonhuman primates against ebolavirus challenge. J Virol. 2011;85:4222–33.View ArticleGoogle Scholar
  20. Kobinger GP, Feldmann H, Zhi Y, Schumer G, Gao G, Feldmann F, et al. Chimpanzee adenovirus vaccine protects against Zaire Ebola virus. Virology. 2006;346:394–401.View ArticleGoogle Scholar
  21. Martin JE, Sullivan NJ, Enama ME, Gordon IJ, Roederer M, Koup RA, et al. A DNA vaccine for Ebola virus is safe and immunogenic in a phase I clinical trial. Clin Vaccine Immunol. 2006;13:1267–77.View ArticleGoogle Scholar
  22. WHO Advisory Panel: Ethical considerations for use of unregistered interventions for Ebola virus disease. Report of an advisory panel to WHO. http://apps.who.int/iris/handle/10665/130997; http://apps.who.int/iris/handle/10665/137370 (2014). Accessed 14 Aug 2016.
  23. Arie S. Ebola: an opportunity for a clinical trial? BMJ. 2014;349:g4997.View ArticleGoogle Scholar
  24. Enserink M. Infectious diseases. Debate erupts on ‘repurposed’ drugs for Ebola. Science. 2014;345:718–9.View ArticleGoogle Scholar
  25. Calain P, Fiore N, Poncin M, Hurst SA. Research ethics and international epidemic response: the case of Ebola and Marburg hemorrhagic fevers. Public Health Ethics. 2009;2:7–29.View ArticleGoogle Scholar
  26. Adebamowo C, Bah-Sow O, Binka F, Bruzzone R, Caplan A, Delfraissy JF, et al. Randomised controlled trials for Ebola: practical and ethical issues. Lancet. 2014;384:1423–4.View ArticleGoogle Scholar
  27. Joffe S. Evaluating novel therapies during the Ebola epidemic. JAMA. 2014;312:1299–300.View ArticleGoogle Scholar
  28. Folayan MO, Haire B, Peterson K. Ethical testing of experimental Ebola treatments. JAMA. 2015;313:421.View ArticleGoogle Scholar
  29. Kanters S, Thorlund K, Mills EJ. Ethical testing of experimental Ebola treatments. JAMA. 2015;313:421–2.View ArticleGoogle Scholar
  30. Rid A, Emanuel EJ. Ethical considerations of experimental interventions in the Ebola outbreak. Lancet. 2014;384:1896–9.View ArticleGoogle Scholar
  31. Briand S, Bertherat E, Cox P, Formenty P, Kieny MP, Myhre JK, et al. The international Ebola emergency. N Engl J Med. 2014;371:1180–3.View ArticleGoogle Scholar
  32. Council for International Organizations of Medical Sciences (CIOMS): International Ethical Guidelines for Biomedical Research Involving Human Subjects. http://cioms.ch/shop/wp-content/uploads/2016/08/International_Ethical_Guidelines_for_Biomedical_Research_Involving_Human_Subjects.pdf (2002). Accessed 14 Aug 2016.
  33. WHO Ethics Working Group: Ethical issues related to study design for trials on therapeutics for Ebola Virus Disease: WHO Ethics Working Group Meeting 20–21 October, Summary of Discussion. http://apps.who.int/iris/handle/10665/137509 (2014). Accessed 14 Aug 2016.
  34. Schopper D, Ravinetto R, Schwartz L, Kamaara E, Sheel S, Segelid MJ, et al. Research ethics governance in times of Ebola. Public Health Ethics. 2017;10:49–61.Google Scholar
  35. Rid A, Wendler D. Risk-benefit assessment in medical research - critical review and open questions. Law Probability Risk. 2010;9:151–77.View ArticleGoogle Scholar
  36. Kimmelman J, Henderson V. Assessing risk/benefit for trials using preclinical evidence: a proposal. J Med Ethics. 2016;42:50–3.View ArticleGoogle Scholar
  37. Shaw D. Randomisation is essential in Ebola drug trials. Lancet. 2014;384:1667.View ArticleGoogle Scholar
  38. Bellan SE, Pulliam JR, Dushoff J, Meyers LA. Ebola virus vaccine trials: the ethical mandate for a therapeutic safety net. BMJ. 2014;349:g7518.View ArticleGoogle Scholar
  39. Lanini S, Zumla A, Ioannidis JP, Di CA, Krishna S, Gostin L, et al. Are adaptive randomised trials or non-randomised studies the best way to address the Ebola outbreak in west Africa? Lancet Infect Dis. 2015;15:738–45.View ArticleGoogle Scholar
  40. Beavogui AH, Delamou A, Yansane ML, Konde MK, Diallo AA, Aboulhab J, et al. Clinical research during the Ebola virus disease outbreak in Guinea: lessons learned and ways forward. Clin Trials. 2016;13:73–8.View ArticleGoogle Scholar
  41. Huttner A, Dayer JA, Yerly S, Combescure C, Auderset F, Desmeules J, et al. The effect of dose on the safety and immunogenicity of the VSV Ebola candidate vaccine: a randomised double-blind, placebo-controlled phase 1/2 trial. Lancet Infect Dis. 2015;15:1156–66.View ArticleGoogle Scholar
  42. Agnandji ST, Huttner A, Zinser ME, Njuguna P, Dahlke C, Fernandes JF, et al. Phase 1 trials of rVSV Ebola vaccine in Africa and Europe - preliminary report. N Engl J Med. 2015;Google Scholar
  43. Rid A, Miller FG. Ethical rationale for the Ebola “ring vaccination” trial design. Am J Public Health. 2016;106:432–5.View ArticleGoogle Scholar
  44. Henao-Restrepo AM, Camacho A, Longini IM, Watson CH, Edmunds WJ, Egger M, et al. Efficacy and effectiveness of an rVSV-vectored vaccine in preventing Ebola virus disease: final results from the Guinea ring vaccination, open-label, cluster-randomised trial (Ebola Ca Suffit!). Lancet. 2017;389:505–18.View ArticleGoogle Scholar
  45. Bah EI, Lamah MC, Fletcher T, Jacob ST, Brett-Major DM, Sall AA, et al. Clinical presentation of patients with Ebola virus disease in Conakry, Guinea. N Engl J Med. 2015;372:40–7.View ArticleGoogle Scholar
  46. Deen GF, Knust B, Broutet N, Sesay FR, Formenty P, Ross C, et al. Ebola RNA persistence in semen of Ebola virus disease survivors - preliminary report. N Engl J Med. 2015;Google Scholar
  47. Conroy S, Choonara I, Impicciatore P, Mohn A, Arnell H, Rane A, et al. Survey of unlicensed and off label drug use in paediatric wards in European countries. European network for drug investigation in children. BMJ. 2000;320:79–82.View ArticleGoogle Scholar
  48. U.S: Food and Drug Administration: The Paediatric Exclusivity Provision: January 2001 Status Report to Congress. http://www.fda.gov/downloads/Drugs/DevelopmentApprovalProcess/DevelopmentResources/UCM049915.pdf. (2001). Accessed 12 Aug 2016.
  49. Woodcock, J.: Implementation of the Pediatric Exclusivity Provisions, Statement of Janet Woodcock, Director CDER, FDA, DHHS before Senate Committee on Health, Education, Labor and Pensions 2001. http://www.fda.gov/NewsEvents/Testimony/ucm115220.htm (2001). Accessed 13 Aug 2016.
  50. Tan E, Cranswick NE, Rayner CR, Chapman CB. Dosing information for paediatric patients: are they really “therapeutic orphans”? Med J Aust. 2003;179:195–8.Google Scholar
  51. Anonymous. Ebola haemorrhagic fever in Zaire, 1976. Bull World Health Organ. 1978;56:271–93.Google Scholar
  52. Mupapa K, Mukundu W, Bwaka MA, Kipasa M, De RA, Kuvula K, et al. Ebola hemorrhagic fever and pregnancy. J Infect Dis. 1999;179(Suppl 1):S11–2.View ArticleGoogle Scholar
  53. Black BO, Caluwaerts S, Achar J. Ebola viral disease and pregnancy. Obstet Med. 2015;8:108–13.View ArticleGoogle Scholar
  54. Bebell LM, Riley LE. Ebola virus disease and Marburg disease in pregnancy: a review and management considerations for filovirus infection. Obstet Gynecol. 2015;125:1293–8.View ArticleGoogle Scholar
  55. World Health Organization: WHO First Consultation on Ebola Biobanking. http://www.who.int/medicines/ebola-treatment/1st_consult_ebola_biobank/en/; (2015). Accessed 14 Aug 2016.
  56. World Health Organization: Report on the 2nd WHO COnsultation on Biobanking: Focus on West Africa. http://www.who.int/medicines/ebola-treatment/meetings/2nd_who_biobaking-consultation/en/ (2015). Accessed 14 Aug 2016.
  57. Acosta CJ, Galindo CM, Ochiai RL, Danovaro-Holliday MC, Laure-Page A, Thiem VD, et al. Implementation of good clinical practice guidelines in vaccine trials in developing countries. Vaccine. 2007;25:2852–7.View ArticleGoogle Scholar
  58. ICH (International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use): Guideline for Good Clinical Practice, E6, R1, 1996. http://www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E6/E6_R1_Guideline.pdf (1996). Accessed 12 Apr 2017.
  59. Ansumana R, Jacobsen KH, Sahr F, Idris M, Bangura H, Boie-Jalloh M, et al. Ebola in Freetown area, Sierra Leone--a case study of 581 patients. N Engl J Med. 2015;372:587–8.View ArticleGoogle Scholar
  60. Keusch GT, Adam K, Cuff P, Mancher M, Busta ER. Integrating clinical research into epidemic Respons. Washington, DC: The National Academies Press; 2017.View ArticleGoogle Scholar
  61. Shah SK, Dawson L, Dixon DO, Lie RK. Should sponsors and DSMBs share interim results across trials? J Acquir Immune Defic Syndr. 2011;58:433–5.View ArticleGoogle Scholar
  62. De Crop M, Delamou A, Griensven JV, Ravinetto R. Multiple ethical review in north-south collaborative research: the experience of the Ebola-Tx trial in Guinea. Indian J Med Ethics. 2016;1:76–82.Google Scholar
  63. Nordic Trial Alliance Working Group on Ethics: Report on the Ethical Review Process for Clinical Trials in the Nordic Countries. The Challenges and Opportunities of the New Clinical Trials Regulation. http://nta.nordforsk.org/news/report-on-the-ethical-review-process-for-clinical-trials-in-the-nordic-countries (2016). Accessed 12 Apr 2017.
  64. Alexander, D.: Global Health Issues and US Regulation 45CFR46, Subpart B. In: Enrolling pregnant women. Issues in Clinical Research. US Department of Health and Human Services. https://orwh.od.nih.gov/resources/pdf/ORWH-EPW-Report-2010.pdf (2011). Accessed 14 Aug 2016.
  65. U.S.Department of Health and Human Services. Enrolling pregnant women: issues in clinical research. Bethesda: National Institutes of Health; 2011.Google Scholar
  66. Lyerly, A. D.: Direct Benefit to Pregnant Women. In: Enrolling pregnant women. Issues in Clinical Research. US Department of Health and Human Services. https://orwh.od.nih.gov/resources/pdf/ORWH-EPW-Report-2010.pdf (2011). Accessed 14 Aug 2016.
  67. Shields KE, Lyerly AD. Exclusion of pregnant women from industry-sponsored clinical trials. Obstet Gynecol. 2013;122:1077–81.View ArticleGoogle Scholar
  68. Little, M. O.: Treating Important Medical Conditions during Pregnancy. In: Enrolling pregnant women. Issues in Clinical Research. US Department of Health and Human Services. https://orwh.od.nih.gov/resources/pdf/ORWH-EPW-Report-2010.pdf (2011). Accessed 14 Aug 2016.
  69. Holmes LB, Wyszynski DF, Lieberman E. The AED (antiepileptic drug) pregnancy registry: a 6-year experience. Arch Neurol. 2004;61:673–8.View ArticleGoogle Scholar
  70. Addy, R. The state of pediatric research in the United States: Successes under BCPA & PREA. Presentation at DIA 2015. www.fda.gov/downloads/drugs/developmentapprovalprocess/developmentresources/ucm452231.pdf (2015). Accessed 14 Aug 2016.

Copyright

© World Health Organization; 2017