Evaluation of the quality of informed consent in a vaccine field trial in a developing country setting
© Minnies et al; licensee BioMed Central Ltd. 2008
Received: 03 June 2008
Accepted: 30 September 2008
Published: 30 September 2008
Informed consent is an ethical and legal requirement for research involving human participants. However, few studies have evaluated the process, particularly in Africa.
Participants in a case control study designed to identify correlates of immune protection against tuberculosis (TB) in South Africa. This study was in turn nested in a large TB vaccine efficacy trial.
The aim of the study was to evaluate the quality of consent in the case control study, and to identify factors that may influence the quality of consent.
Cross-sectional study conducted over a 4 month period.
Consent was obtained from parents of trial participants. These parents were asked to complete a questionnaire that contained questions about the key elements of informed consent (voluntary participation, confidentiality, the main risks and benefits, etc.). The recall (success in selecting the correct answers) and understanding (correctness of interpretation of statements presented) were measured.
The majority of the 192 subjects interviewed obtained scores greater than 75% for both the recall and understanding sections. The median score for recall was 66%; interquartile range (IQR) = 55%–77% and for understanding 75% (IQR = 50%–87%). Most (79%) were aware of the risks and 64% knew that they participated voluntarily. Participants who had completed Grade 7 at school and higher were more likely (OR = 4.94; 95% CI = 1.57 – 15.55) to obtain scores greater than 75% for recall than those who did not. Participants who were consented by professional nurses who had worked for more than two years in research were also more likely (OR = 2.62; 95% CI = 1.35–5.07) to obtain such scores for recall than those who were not.
Notwithstanding the constraints in a developing country, in a population with low levels of literacy and education, the quality of informed consent found in this study could be considered as building blocks for establishing acceptable standards for public health research. Education level of respondents and experience of research staff taking the consent were associated with good quality informed consent.
Informed consent is an ethical and legal requirement for research involving human participants . Guidelines as contained in the Declaration of Helsinki, the Nuremburg Code and the Belmont Report , and the Council for the International Organizations of Medical Research  have become accepted tools used by Institutional Review Boards (IRBs), the bodies responsible for ethical review of research proposals, in approving such research. The International Convention for Harmonization's initiative on Good Clinical Practice (GCP)  is considered to be the quality standard for the conduct of clinical trials in humans. Accredited courses for investigators of clinical trials are based on these GCP guidelines. Medical doctors, professional nurses, and other health professionals who conduct research on behalf of principal investigators frequently do these courses as part of their training.
In most countries research ethics are regulated by statutory bodies [5, 6]. IRBs of sponsor organizations and Research Ethics Committees (RECs) of academic institutions are mandated by their stakeholders to protect participants.
However, unethical research practices occur not uncommonly and appear to have been accepted and even perpetuated by IRBs [7–9]. Some authors have reservations about the capabilities of IRBs in developing countries, suggesting that they may be made up by inadequately skilled members . London  proposed ways to improve the regulation of ethics practices in developing countries, which included proper research ethics training of IRB members and independent monitoring of research activities.
Studies of the quality of informed consent in medical practice have found this to be poor [12–14]. Similar shortcomings in consent quality in research have been found [15–17], particularly in developing countries, where concepts such as "voluntary participation [18, 20]", "randomization " and "benefits and risks " may have variable interpretations. Large scale research projects are increasingly being conducted in these settings. The informed consent process poses several challenges, logistic as well as ethical, since failures of informed consent may result in the violations of participants' human rights. In South Africa, where the rights of the research participant are explicitly protected in the Constitution , it is essential that this understanding of participants' rights be tested in the appropriate research environment. Poverty, disease, lack of education, hardship, submissiveness, the effects of war, famine, pandemics, and social insecurity prevalent in developing countries all make participants more vulnerable to research exploitation.
Purpose & objectives
This secondary study, the "consent study", aimed to evaluate the quality of informed consent in a primary case control study (the Immunology Study) of immune correlates of protection against severe childhood TB nested inside a randomized controlled trial vaccine trial [Bacille Calmette-Guerrin (BCG) Study]. A total of 5467 children were enrolled into the Immunology Study from 2001 to 2004. These studies were implemented in Worcester, a rural setting in the Western Cape Province of South Africa. Participants in the primary immunology case control study underwent collection of blood between 8 and 14 weeks of age, after written consent had been obtained from their parents. The consent procedure was concluded by means of signing a consent form.
The objectives of this consent study were:
a. To determine study participants' recall and understanding of items discussed during the consent procedure for the immunology study;
b. To establish whether certain participant and study-related factors were associated with the quality of informed consent; and
c. To describe the association between the quality of informed consent and participants' knowledge of their health rights.
The study was a cross-sectional study conducted over four months
Population and sampling
The population for the consent study was drawn from mothers who gave informed consent for the participation of their children in the Immunology Study. Recruitment for the Immunology Study took place from March to June 2004 in the form of a team visiting district health facilities according to a fixed schedule. Enrolment and phlebotomy were preceded by a booking session at which an information pamphlet about the Immunology study was handed out. Informed consent was conducted in the first language of the mother (either Afrikaans or Xhosa) by trained interviewers.
For the consent study, all mothers attending clinics where the language of communication was predominantly Xhosa, and every fourth mother attending Afrikaans-language clinics were approached to participate in the consent study.
Dedicated nursing staff conducted the interview within one hour of mothers' consent to their infant's participation in the Immunology Study.
Measurement and data collection
The quality of informed consent was determined by measuring the recall and understanding of informed consent using a questionnaire specifically designed for this study (see additional file 1). The questionnaire contained nine questions dealing with the basic facts of the Immunology Study. Participants were expected to select the correct answer from a choice of three possible answers for each of the questions. One of the answers was an exact reflection of the information in the consent document, which, if selected, was taken as an indicator of correct recall. For the understanding assessment, participants were expected to select the appropriate interpretations for a total of eight statements offered. This was taken as an indication of the extent to which participants' decisions were based on understanding. Although there is some inevitable overlap between recall and understanding, the type of questions allowed broad categorization into two separate scales for recall and understanding. Participants were requested to complete the questionnaire in writing while consent study staff provided assistance with the interpretation of the questions.
The results on the data form were captured, processed and analysed using Stata version 6 . Correct scores for recall and understanding were totaled for individual participants and summary statistics were calculated. Total scores for individual recall and health rights questions were also calculated. Logistic regression analyses were performed to model the effect of maternal age, education, access to telephones, language preference and research experience of the professional nurse on the recall and understanding scores.
The Research Ethics Committee of the University of Cape Town Health Sciences faculty approved both the Immunology and Consent Studies. Mothers who had consented to participation into the Immunology Study were referred to the nurse for the Consent Study in a separate room. As part of the consent procedure, the nurse handed the mother an information sheet written in simple language explaining the Consent Study, and asked the mother to read it. After verifying that the mother understood the contents of the consent letter, she was then asked to participate. If she accepted, the nurse asked the mother to acknowledge by signing and dating a copy of the letter. This copy was kept for record purposes.
Demographic characteristics (n = 192)
Level of education:
(% Grade 6 or less)
(% Grade 7 to 11)
(% Grade 12 or higher)
Access to a telephone:
Attendance per clinic:
Relationship between recall and understanding score (n = 192)
Understanding n (%)
Recall n (%)
Results of quality of informed consent assessment: Recall section
1. I have been asked to attend the clinic today so that (n = 192):
My baby can participate in a research study
My baby can receive expert treatment.
My baby can receive routine health care
2. The purpose of the research study is to (n = 191):
Test for protection against tuberculosis in my baby's blood.
Test for tuberculosis in my baby's blood
Test for HIV in my baby's blood
3. Research staff wants to enroll my baby into the research study so that (n = 189):
They can collect blood from my baby
They can inject my baby with BCG
They can test my baby for TB or HIV
4. The total amount of time my baby will be expected to participate in the study is (n = 190):
2 to 3 years
8 to 14 weeks
5. The most common risk involved when blood had been collected from my baby is (n = 192):
My baby may suffer very slight scarring and some oozing
My baby can become infected with TB or HIV
My baby can loose too much blood
6. The benefits available to me and my baby for participating in the study are (n = 191):
My baby will be protected against TB
There are no immediate benefits
My baby and I will get better treatment at clinics
7. If I didn't want to participate in this study, I could withdraw and (n = 189)
My baby and I would suffer no loss at all
My baby and I will be treated differently by research and clinic staff
My baby and I would be denied access to health services at this clinic
8. My baby's personal details will never be linked with her blood because (n = 191)
Numbers with barcodes will be used to keep bloods anonymous
Highly trained research staff will keep information secret
Clinic staff will be sure not to give information to the research staff
9. The blood of my baby that will be frozen and stored will be used (n = 187)
For other tests concerning protection against TB
For all kinds of research in other countries
For HIV testing
The final logistic regression model obtained for recall scores of 75% or greater included experience of research nurse and education level of the participant. Participants who had completed Grade 7 and higher at school were more likely (OR = 4.94, 95% CI = 1.57–15.55) to obtain a minimum of 75% in the recall test compared to participants who did not progress that far in education. Also, consent obtained by nurses with more than two years research experience resulted in an almost three times (OR = 2.62, 95% CI = 1.35 – 5.07) the odds of scoring at least 75% compared to nurses with less than two years of experience.
Results of quality of informed consent assessment: Understanding section
I agreed to enrol my child in this study because
My child might get better treatment
I want doctors to help learn more about TB
I've decided to enrol my baby in the study
Even though my baby will receive no extra treatment
Because I knew I would receive a toiletries hamper
If my baby gets a bruise from the blood test, I should
Contact the police
Speak to the nurse at the clinic
Go to the doctor at his private surgery
If I was given the choice to participate again, I would
The finding that most participants obtained scores in excess of 75% for understanding and 66% for recall indicates that the general quality of informed consent was encouraging. Almost all participants felt that they would participate again in a similar study if they were given the choice. These results are similar to both qualitative and quantitative findings in previous studies conducted in developing countries [18, 20, 22].
The proportion of participants with low scores for quality of informed consent was small and lower even than that found in some studies in industrialized countries [16, 23]. However, due to differences in methodologies, no specific comparison is attempted. The understanding assessment result supports earlier suggestions  that low levels of education need not hinder participants' ability to understand consent concepts.
It is reassuring that the two language groups had similar results, as there had been concerns in the trial that consent quality would be different between the language groups. The two languages broadly represent two different race groups in South Africa, which could be associated with differences in perception of social services such as health care. Barsdorf & Wassenaar  have shown that Black participants, known to have suffered most from the injustices of the apartheid regime, had poorer perception of voluntariness than their White and Indian counterparts. These differences in perceptions of research between race groups were not demonstrated in this study.
Some limitations in the measurement method are evident. The study did not assess the ability of participants to retain information for longer periods of time (i.e. days, weeks or months) after their enrolment into the Immunology Study. Moreover, the questions posed for understanding could not cover all the emotional and intellectual aspects involved when giving consent. Access to a telephone or cell-phone may not be the best proxy for socioeconomic status as it may be too indirect and focuses only on the "economic" part of status. There is also an unquantifiable overlap between recall and understanding. Nonetheless, despite the recognized difficulties of measuring understanding with informed consent procedures, the findings of this study pointed to the need to employ methods to enhance informed consent quality in less educated participants, such as the use of audiovisual aids.
The following are required for a good consent quality: a much greater focus on the consent process, the assurance that participants possess the required level of education (in South Africa Grade 7 is considered minimum), that voluntary participation is encouraged and that confidentiality is secured. In addition, an abridged form of self-assessment by participants, such as the type described in this study, could improve the general understanding of research concepts, such as voluntary participation and confidentiality by prospective research participants. A second and third attempt at explaining some of the more difficult concepts might help to ensure better recall and understanding of information.
We suggest that research ethics committees should insist on periodic reports on consent quality and efforts to improve quality where appropriate as part of their responsibility to protect the public against unethical research practices. The Consent Study focused on the evaluation of the quality of informed consent by using a self-administered questionnaire. Although level of education and experience of the research staff were predictors of good quality of consent in this study, researchers would need to identify the predictors of good quality consent in their studies. Although this study chose to weight recall and understanding equally, consideration could be given to whether specific questions, such as those pertaining to perceived benefits or ability to withdraw, should have higher weight in deciding whether participant consent is adequate.
The Immunology Study was conducted in a rural district known for its low socio-economic status, high unemployment and high prevalence of diseases of poverty. Our experience is that participants are generally research naïve, and because of problems of staff shortage and scarce resources in the health services, frequently confuse research activities with health care delivery, and therefore welcome the attention of better resourced research initiatives. This renders them a particularly vulnerable research population. Given this context, the findings of the Consent Study can be considered encouraging, in particular because it appears as if most participants had made informed choices about their participation in the Immunology Study. Most participants had medium to high understanding of the study. Misunderstanding about perceived benefits is understandable, but it could also mean that participants made the decision to participate in the Immunology Study because of a belief that the benefits were greater than they actually were.
This study should add to the sparse literature dealing with the quantitative evaluation of informed consent in a developing country situation, and encourage commentary and further research in this important area of research ethics, including further exploration into the question of acceptable standards for quality of informed consent.
While developed country-based sponsors are likely to be centrally concerned with the scientific question, and research ethics committees about the general ethical conduct of proposed research, principal investigators in developing countries should consciously consider attaining good quality informed consent as a key component of their research proposals.
In this study, good quality informed consent was associated with higher levels education of respondents and experience of staff obtaining the consent. Many research studies are conducted in developing countries in similar settings, i.e. where there are language and cultural differences between researchers and participants, low education and socio-economic status and limited resources. There is therefore no reason that the same quality of informed consent should not be achieved in other parts of Southern Africa and abroad.
The authors are grateful for E Simon, N Bushwana and S Mawu for conducting the interviews and T Zabow and the UCT REC for their contributions to the questionnaire, and the participating children and their parents. Thanks also to Francesca Little for her contribution to the statistical analysis, and to Mark Hatherill for his support and encouragement. and in particular to L Geiter for his. support and interest in the project. D Minnies, G Hussey, W Hanekom and T Hawkridge are funded by a grant from the Aeras Global TB Foundation, W Hanekom is supported by the Aeras Global Tuberculosis Vaccine Foundation, the NIH (RO1-AI065653 and NO1-AI70022), the Dana Foundation, the Bill and Melinda Gates Foundation (GC6-74 and GC12-82), and the European and Developing Countries Trials Partnership.
- Joffe S, Cook EF, Cleary PD, Clark JW, Weeks JC: Quality of informed consent: a new measure of understanding among Research subjects. Journal of the National Cancer Institute. 2001, 93 (2): 139-47. 10.1093/jnci/93.2.139.View ArticleGoogle Scholar
- Medical Research Council (S.A.): Guidelines on Ethics for Medical Research: General Principles. 2000, 4Google Scholar
- Council for International Organizations of Medical Sciences: International Guidelines for ethical review of epidemiological studies. 1991, Geneva: CIOMSGoogle Scholar
- The ICH Guideline for Good Clinical Practice and the ICH Guideline for Clinical Safety Data Management: Definitions andStandards for Expedited Reporting. European Agency for the Evaluation of Expedited Reporting. 1995, –2001
- National Institutes of Health: Regulation and ethical guidelines. 2004, United States Department of Health and Human ServicesGoogle Scholar
- South African Constitution Act, No 108 of 1996. Chapter 2: Bill of Rights. Department of Justice, Republic of South Africa
- Goodyear-Smith F, Lobb B, Davies G, Nachson I, Seelau SM: International variation in ethics committee requirements: comparisons across five Westernised nations. BMC Medical Ethics. 2002, 3: 2-10.1186/1472-6939-3-2.View ArticleGoogle Scholar
- Epstein E, Sloat B: Informed consent is not always obtained in United States. British Medical Journal. 1997, 315: 247-View ArticleGoogle Scholar
- Gost J, Silvestre C, Ezpeleta P, Astier P, Diaz de Rada O, Artazcoz MT: Evaluation of the clinical practice of informed consent in clinical trials. Anales Sist Sanit Navar. 2003, 26: 35-42.Google Scholar
- Squire SB, Hawley R, Macfarlane S, Agbaje S, Beeching NJ, Wyatt GB, De Koning K, Gray N, Hayward C, Ali A, Bianco AE, Taylor M, Brabin B, Coulter JBS: British institutions collaborating in projects overseas may face dilemma. BMJ. 1997, 315 (7102): 248-Google Scholar
- London L: Ethical oversight of public healthresearch: can rules and IRBs make a difference in developing countries?. American Journal of Public Health. 2002, 92: 1079-1084.View ArticleGoogle Scholar
- O'Flynn N, Rymer J: Consent for teaching: the experience of women attending a gynaecology clinic . Medical Education. 2003, 37 (12): 1109-10.1046/j.1365-2923.2003.01715.x.View ArticleGoogle Scholar
- Fleischman M, Garcia C: Informed consent in dermatologic surgery . Dermatologic Surgery. 2003, 29 (9): 952-10.1046/j.1524-4725.2003.29251.x.Google Scholar
- Saravanappah N, Balfour A, Bowdler D: Informed consent for middle ear operations: A United Kingdom Survey . Clinical Otolaryngology & Allied Sciences. 2003, 28 (2): 91-99. 10.1046/j.1365-2273.2003.00671.x.View ArticleGoogle Scholar
- Joffe S, Cook EF, Cleary PD, Clark JW, Weeks JC: Quality of informed consent in cancer clinical trials: a cross-sectional survey. Lancet. 2001, 358: 1772-77. 10.1016/S0140-6736(01)06805-2.View ArticleGoogle Scholar
- Yuval R, Halon DA, Merdler A, Khader N, Karkabi B, Uziel K, Lewis BS: Patient comprehension and reaction to participatingin a double blind randomized clinical trial (ISIS-4) in Acute Myocardial Infarction. Archives of Internal Medicine. 2000, 160: 1142-1146. 10.1001/archinte.160.8.1142.View ArticleGoogle Scholar
- Lynöe N, Sandlund M, Dahlqvist G, Jacobsson L: Informed consent: study of quality of information given to participants in a clinical trial . BMJ. 1991, 303 (6803): 610-613.View ArticleGoogle Scholar
- Lynöe N, Chowdhury M, Ekström L: Obtaining informed consent in Bangladesh. New England Journal of Medicine. 2002, 344: 460-461. 10.1056/NEJM200102083440617.View ArticleGoogle Scholar
- Elbourne D, Snowdon C, Garcia : Subjects may notunderstand concept of clinical trials . British Medical Journal. 1997, 315: 247-View ArticleGoogle Scholar
- Upvall M, Hashwani S: Negotiating the informed consent process in developing countries: a comparison of Swaziland and Pakistan . International Nursing Review. 2001, 48 (3): 188-10.1046/j.1466-7657.2001.00063.x.View ArticleGoogle Scholar
- Stata Corporation: 702 University Drive East, College Station, Texas. 77840, , USAGoogle Scholar
- Sanchez S, Salazar G, Tijero M, Diaz S: Informed consent procedures: responsibilities of researchers in developing countries. Bioethics. 2001, 15 (5–6): 398-412. 10.1111/1467-8519.00250.View ArticleGoogle Scholar
- Ramjee G, Morar NS, Alary M, Mukenge-Tshibaka L, Vuylsteke B, Ettiegne-Traore V, Chandeying V, Karim SA, Van Damme L: Challenges in the conduct of vaginal microbicide effectiveness trials in the developing world. AIDS. 2000, 14: 2553-7. 10.1097/00002030-200011100-00018.View ArticleGoogle Scholar
- Colletti AS, Heagerty P, Sheon AR, Gross M, Koblin BA, Metzger DS, Seage GR: Randomized controlled evaluation of aprototype informed consent process for HIV vaccine efficacy trials. J Acquir Immune Defic Syndr. 2003, 32 (2): 161-169.View ArticleGoogle Scholar
- Barsdorf NW, Wassenaar DR: Racial differences in publicperceptions of voluntariness of medical research participants in South Africa. Social Sciences & Medicine.
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6939/9/15/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.