This article has Open Peer Review reports available.
The development of a brief and objective method for evaluating moral sensitivity and reasoning in medical students
https://doi.org/10.1186/1472-6939-5-1
© Akabayashi et al; licensee BioMed Central Ltd. 2004
Received: 26 November 2003
Accepted: 29 January 2004
Published: 29 January 2004
Abstract
Background
Most medical schools in Japan have incorporated mandatory courses on medical ethics. To this date, however, there is no established means of evaluating medical ethics education in Japan. This study looks 1) To develop a brief, objective method of evaluation for moral sensitivity and reasoning; 2) To conduct a test battery for the PIT and the DIT on medical students who are either currently in school or who have recently graduated (residents); 3) To investigate changes in moral sensitivity and reasoning between school years among medical students and residents.
Methods
Questionnaire survey: Two questionnaires were employed, the Problem Identification Test (PIT) for evaluation of moral sensitivity and a portion of the Defining Issues Test (DIT) for moral reasoning. Subjects consisted of 559 medical school students and 272 residents who recently graduated from the same medical school located in an urban area of Japan.
Results
PIT results showed an increase in moral sensitivity in 4th and 5th year students followed by a decrease in 6th year students and in residents. No change in moral development stage was observed. However, DIT results described a gradual rising shift in moral decision-making concerning euthanasia between school years. No valid correlation was observed between PIT and DIT questionnaires.
Conclusion
This study's questionnaire survey, which incorporates both PIT and DIT, could be used as a brief and objective means of evaluating medical students' moral sensitivity and reasoning in Japan.
Keywords
Background
Most medical schools in Japan have incorporated mandatory courses on medical ethics [1]. Course objectives typically include increasing students' understanding of ethical norms and resolving ethical dilemmas in clinical settings. To this date, however, there is no established means of evaluating medical ethics education in Japan.
Concurrent to the "coming of age" of medical ethics [2], a variety of measures have been developed to evaluate pedagogical methodology, including standardized tests, subjective reports and clinical vignettes [3–5]. Some studies have found that structure, design and curriculum influence the degree to which students' ethical reasoning skills change during courses. In particular, a great deal of attention has focused on how to evaluate a student's ability to recognize and assess the ethical problems encountered in their clinical practice and research.
Rest and colleagues constructed the four-component model in order to develop an approach to evaluating moral development [6]. This model describes the psychological process of moral behavior in four steps: moral sensitivity, moral reasoning, moral commitment (decision) and moral action. Based on this four-component model and Kohlberg's theory, Rest and colleagues developed the Defining Issues Test (DIT) as an instrument to evaluate the relative degree of moral reasoning. The DIT is a multiple choice, group-administered computer-scored measure [6, 7]. Yamagishi has translated and adapted the DIT to the Japanese context [8].
The DIT has been acclaimed to be the best tool available to measure moral reasoning in the ethics field; it is a reliable and valid instrument for measuring moral development [9–11]. Despite its prolific use, the DIT was not specifically designed for medical ethics. Accordingly, the original DIT as it stands may not be apt to medical ethics education.
In light of this, Hebert and colleagues developed a questionnaire to measure medical students' and professionals' ethical sensitivity [12, 13]. Nishimura and colleagues later translated and adapted this questionnaire to the Japanese clinical setting, currently referred to as the Problem Identification Test (PIT) [14].
With the aim of developing a fitting evaluation measure for moral sensitivity and reasoning, we designed a test battery that incorporates the Japanese version of the ethical sensitivity test (PIT) and the two most relevant vignettes to medical ethics from the DIT. It aims to measure the first two steps of the four-component model, moral sensitivity and moral reasoning [6].
This research is the first attempt in developing a systematic evaluative survey for medical ethics education among medical school students and residents in Japan. This multi-step research project was designed with the following objectives:
1. To develop a brief, objective method of evaluation for moral sensitivity and reasoning,
2. To conduct a test battery for the PIT and the DIT on medical students who are either currently in school or who have recently graduated (residents),
3. To investigate changes in moral sensitivity and reasoning between school years among medical students and residents.
Methods
Subjects consisted of 559 medical school students from one urban medical school (86 first year students, 67 second year students, 100 third year students, 102 fourth year students, 95 fifth year students, and 109 sixth year students) and 272 residents who recently graduated from the same medical school (within three years) totaling 831 subjects altogether. Medical schools in Japan are six years in length and the vast majority of students enter after high school. This medical school's second year curriculum includes a short course on the "introduction to medicine", which consists of discussion and lectures on medical ethics. Bedside learning starts during one's fourth year.
We used two self-administered questionnaire tests, the Problem Identification Test (PIT) [Appendix 1, See Additional File 1] and the first two vignettes of Japanese version of the DIT [Appendix 2, See Additional File 1]. The reliability and validity of both questionnaires have been previously examined [8, 14]. The questionnaires were sent to subjects by mail with a cover letter stating that this survey is research and that participation is voluntary. The subjects were asked to fill out two questionnaires within 25 minutes. Responses were mailed back anonymously. This survey was conducted in February of 1996.
Statistical analysis was performed using SPSS 10.0J. We employed Pearson's correlation coefficients, chi-square tests and one-way ANOVA followed by Tukey's test; all with a level of significance of 0.05.
PIT
The PIT is originally based on Hebert and colleagues' approach [12, 13]. The Japanese version was adapted to the context of Japanese clinical settings; the original four vignettes were condensed to three consisting of 1) a Jehovah's witness who denies blood transfusion, 2) treatment of a premature infant, and 3) treatment of a terminal patient. The PIT submits these vignettes to subjects and asks them to list all ethical issues related to each case. Instructions emphasize that subjects only list ethical issues relevant to each vignette and not explain how to deal with each case. Each vignette is scored according to the number of issues identified; this number is evaluated as an indication of problem identification ability. Each vignette encompasses three domains: A) autonomy and patient's right; B) beneficence and nonmaleficence; and C) justice and contextual features. Key phrases comprising each domain's scoring standards are stated in the appendix. The maximum number of points for each vignette is three for domain A and B, four for domain C; and 10 for the questionnaire in total.
DIT
The Japanese version of the DIT consists of six vignettes. Each vignette has 11–12 domains considered to be necessary to solve an ethical dilemma. In this survey, we implemented the first two vignettes. These two are considered to be the most relevant to medical ethics: 1) whether or not to steal medicine in order to save one's wife's life, and 2) euthanasia on a terminal patient who is experiencing great pain. The DIT is filled out by the subject as follows: 1) firstly, the subject chooses the most suitable action (decision); 2) upon doing so, he or she then lists reasons for that action by degree of significance; and 3) lastly, the subject lists the four most significant reasons in order. The DIT was scored according to instructions as stated in Appendix 2 (See Additional File 1). DIT scores provided two values: moral development stage and DP values. DP values (DP2, DP3, DP4, DP4.5, DP5) correspond to each moral development stage (i.e. stage 3 = DP 3). As described in Appendix 2 (See Additional File 1), calculated DP values reflect the percentage of respondents in each stage of moral development within their own particular school year. Accordingly, the sum of DP values for each school year of medical student or among residents is 100%. Calculated DP values provide a lens to better distinguish trends between moral development stage and school years. DIT analysis produced results concerning 1) the change in decision-making between enrolled medical students and residents, 2) the moral development stage (moral reasoning), and 3) DP values; refer to Appendix 2 (See Additional File 1).
Results
Response rates were as follows: 303 (54.2%) from current medical students: 50 (58.1%) first year students, 44 (65.7%) second year students, 51 (51.0%) third year students, 56 (54.9%) fourth year students, 49 (51.6%) fifth year students, and 53 (48.6%) sixth year students; and 74 (27.2%) from residents. Overall percentage was 51.4%, totaling 358 responses.
The average age (± SD) of each group was as follows: first year students (20.2 ± 2.6), second year students (20.1 ± 2.6), third year students (22.4 ± 2.6), fourth year students (22.6 ± 2.6), fifth year students (23.4 ± 2.6), sixth year students (24.9 ± 2.6) and residents (27.3 ± 2.6). The percentage of females within each group was as follows: first year students (14.2%), second year students (11.4%), third year students (19.6%), fourth year students (12.5%), fifth year students (16.3%), sixth year students (11.3%) and residents (6.8%); overall percentage was 12.7%.
PIT Scores: School years. Total: F (6, 370) = 1.87, p < 0.1; B: F (6, 370) = 2.21, p < 0.05. *p < 0.05 vs. 1st year, 2nd year, 3rd year, 6th year and residents by Tukey's test.
DIT Scores: Vignette 1. χ2 = 27.3, p < 0.01
DIT Scores: Vignette 2. χ2 = 21.6, p < 0.05
Stages of moral development across school years
Vignette1 | Vignette 2 | Total | |
|---|---|---|---|
1st year (n = 50) | 4.02 (0.49) | 4.40 (0.40) | 4.21 (0.36) |
2nd year (n = 43) | 4.16 (0.50) | 4.44 (0.39) | 4.30 (0.33) |
3rd year (n = 49) | 4.21 (0.41) | 4.39 (0.36) | 4.30 (0.31) |
4th year (n = 52) | 4.11 (0.56) | 4.42 (0.30) | 4.27 (0.38) |
5th year (n = 47) | 4.11 (0.50) | 4.44 (0.31) | 4.27 (0.33) |
6th year (n = 51) | 3.97 (0.53) | 4.43 (0.35) | 4.20 (0.31) |
residents (n = 66) | 4.23 (0.54) | 4.43 (0.38) | 4.33 (0.39) |
[NS] | [NS] | [NS] |
DP values across school years
DP2 | DP3 | DP4 | DP4.5 | DP5 | |
|---|---|---|---|---|---|
1st year (n = 50) | 3.4 (5.4) | 23.0 (17.9)* | 20.8 (12.6)* | 3.5 (6.0) | 49.3 (18.2) |
2nd year (n = 43) | 3.0 (7.3) | 17.4 (13.7) | 15.6 (13.6) | 5.1 (7.1) | 51.2 (16.3) |
3rd year (n = 49) | 3.1 (6.0) | 15.6 (13.6) | 26.5 (15.9) | 5.7 (7.9) | 49.1 (16.3) |
4th year (n = 52) | 3.8 (6.7) | 20.7 (15.3) | 19.0 (10.4) | 3.4 (6.3) | 53.2 (17.0) |
5th year (n = 47) | 4.3 (6.5) | 15.2 (13.5) | 27.1 (12.5) | 4.8 (8.1) | 48.6 (15.2) |
6th year (n = 51) | 5.1 (7.0) | 19.0 (13.2) | 24.5 (14.1) | 4.5 (7.1) | 46.9 (16.9) |
residents (n = 66) | 2.3 (6.5) | 14.8 (13.6) | 27.0 (14.9) | 6.2 (8.8) | 49.7 (19.8) |
[NS] | [p < 0.05] | [p < 0.01 ] | [NS] | [NS] |
Correlations coefficients between PIT and DIT scores
Vignette1 | Vignette 2 | Total | |
|---|---|---|---|
Domain A | 0.09 | 0.04 | 0.09 |
Domain B | -0.06 | -0.01 | -0.06 |
Domain C | 0.04 | -0.02 | 0.03 |
Total | 0.04 | 0.00 | 0.03 |
Discussion
The present study serves as the first exploratory trial for a systematic evaluation of medical ethics education in Japan. This study's test battery for the PIT and the DIT, which measures the first two steps of the four-component model of problem identification and moral reasoning, could serve as an objective and brief method for assessing courses' varying designs, methods, and curriculums.
Concerning the significance of combining the PIT and DIT
As indicated in the Background, the combination of the two tests is conceptually valid since they are theoretically measuring different aspects of Rest's four-component model. Calculations of correlation coefficients between PIT and DIT scores found no items to be significantly correlated. Our finding of no significant correlation may lend additional support to the hypothesis that the DIT and PIT each measure different variables. Nonetheless, this lack of correlation is possibly related to the fact that the PIT was designed for medical settings while the DIT was originally created without such specificity. Further validation studies may be needed.
Concerning the results of the PIT
The PIT results described a significant increase in fourth and fifth year medical students for Domain B and a decrease among sixth year students and residents. This trend of decreasing values amongst graduates is consistent with research previously conducted [12, 15]. The decrease in moral sensitivity is likely to arise from residents being too busy to think about ethics and sixth year students being too busy preparing for the national exam. While these findings may be similar to previous studies, we propose that a positive interpretation may be possible. For example, as subjects accumulate clinical experience, they begin to sense and intuitively resolve ethical problems without identifying them as, per se, ethical dilemmas. That is, students begin to react to so-called ethical problems in an ethically correct manner without having to second-guess. An exemplary case is that of informed consent; residents may no longer consider it an ethical dilemma.
The increase in PIT scores among fourth and fifth year students suggests that the onset of bedside learning during one's fourth year has an effect on students' ethical awareness. Although students enroll in a medical ethics course at the end of their second year, we surmise that the course's teachings may be better understood once students begin to attend to patients. Further research is needed concerning possible factors to this increase in moral sensitivity among mid-year medical students.
Concerning the results of the DIT
Vignette 2 decision making exemplified a significant change in choice between school years. This change may reflect a more passive attitude regarding euthanasia as a result of students' and residents' practical experience with clinical medicine. Vignette 1 decision-making also showed a significant gradual change between school years (age groups). Overall, our results showed that moral development stage was consistent regardless of age group; these findings correlate with those of previous studies [16–19].
A significant difference in DP3 and DP4 values was recognized throughout school years. Kohlberg's theory, which contends that moral development increases with age, may be able to explain this divergence in DP3 and DP4 values among respondents. Kohlberg's work and thus the theories upon which the DIT is based have been widely criticized and discussed [20]. Kohlberg's equation of moral reasoning is largely based on justice reasoning. The works of Noddings and Gilligan indirectly draw attention to this distinction by emphasizing an ethics of care in contrast to an ethics of justice in accounting for morality [21, 22]. In short, while moral reasoning is applicable to the milieu of medical ethics, that of justice reasoning may not.
Several researchers have criticized Kohlberg's notions in that their justice-laden framework is inapt to the Japanese cultural background where interpersonal relationships are highly valued [8]. Accordingly, an environment where interpersonal relationships and consideration of peripheral circumstances are prioritized over reasons of justice weighs Kohlberg's 3rd and 4th stages of moral development with greater significance than the 5th and 6th stages.
In light of the above, we surmise that DIT results regarding decision-making carry more significance than those results pertaining to simple moral development stage and DP values. While the original DIT may be able to assess moral reasoning in the context of medical ethics to some degree, we contend that changes in subjects' moral thoughts (decision-making) can be evaluated by using the two most relevant vignettes.
Limitations of the present study
Interpretation of results is to some extent limited by the hypothetical character of the scenarios and by the sampling of students and residents affiliated with only one medical school located in an urban area of Japan. Additionally, the response rate for residents was low. This may be in association with respondents' level of interest regarding ethical issues. Further comparative studies are needed between residents in order to investigate this possible factor.
As recognized by Hebert and colleagues, the PIT survey may be incapable of evaluating other aspects of morality including attitudes, skills, facts and formal knowledge [13]. This test battery examines only the first two steps of the four component model. Further research to develop the other two components is necessary. Lastly, this study is limited by a quantitative approach [23, 24], and is cross-sectional and not longitudinal in design [19, 25].
Conclusion
This study has utilized both the PIT and DIT in aims of developing an objective and brief method for evaluating medical students' moral sensitivity and reasoning. No significant correlation was found between PIT scores and DIT stages. PIT results demonstrated that values of Domain B (beneficence and nonmaleficence) significantly increased in fourth and fifth year students, yet once again dropped in sixth year students and in residents. Although changes in moral development stage were statistically insignificant, DIT results highlighted substantial differences in decision-making (i.e. euthanasia, theft of medications) between school years.
List of abbreviations
- Problem Identification Test (PIT):
-
Defining Issues Test (DIT)
Declarations
Acknowledgements
This study was made possible in part by a Grant-In-Aid for Scientific Research (KAKENHI) no. 07672437 by the Ministry of Education, Culture, Sports, Science and Technology, Japan.
Authors’ Affiliations
References
- Akabayashi A, Miyasaka M, Kai I, Ohi G: Survey of Medical Ethics Education in Japanese Medical Schools. Medical Education (Japan). 1999, 30 (1): 47-53.Google Scholar
- Miles SH, Lane LW, Bickel J, Walker RM, Cassel CK: Medical ethics education: coming of age. Academic Medicine. 1989, 64 (12): 705-14.View ArticleGoogle Scholar
- Savulescu J, Crisp R, Fulford KWM, Hope T: Evaluating ethics competence in medical education. Journal of Medical Ethics. 1999, 25: 367-374.View ArticleGoogle Scholar
- Goldie J: Review of ethics curricula in undergraduate medical education. Medical Education. 2000, 34: 108-119. 10.1046/j.1365-2923.2000.00607.x.View ArticleGoogle Scholar
- McKneally M, Singer P: Bioethics for clinicians: 25. Teaching bioethics in the clinical setting. CMAJ. 2001, 164 (8): 1163-1167.Google Scholar
- Rest JR: Moral Development: Advances in Research and Theory. 1986, New York: PraegerGoogle Scholar
- Rest JR, Narváez D: Moral Development in the Professions. 1994, Hillsdale, NJ: Lawrence Erlbaum AssociatesGoogle Scholar
- Yamagishi A: The development of moral judgment. in Moral Development and Education: Evolution of Kohlberg's theory. Edited by: Nagano. 1985, Shinyo-sha: Tokyo, 244-267. (In Japanese)Google Scholar
- Callahan D, Bok S: Hastings Center project on the teaching of ethics. In: Ethics teaching in higher education. Edited by: Callahan D, Bok S. 1980, New York: Plenum PressView ArticleGoogle Scholar
- Rest JR, Thoma SJ, Edwards L: Designing and validating a measure of moral judgment: stage preference and stage consistency approaches. Journal of Educational Psychology. 1997, 89 (1): 5-28. 10.1037//0022-0663.89.1.5.View ArticleGoogle Scholar
- Rest JR, Narváez D, Thoma SJ, Bebeau MJ: Devising and testing a revised instrument of moral judgment. 1998, Center for the Study of Ethical Development, University of MinnesotaGoogle Scholar
- Hebert PC, Meslin EM, Dunn EV: Measuring the ethical sensitivity of medical students. Journal of Medical Ethics. 1992, 18: 142-147.View ArticleGoogle Scholar
- Hebert PC, Meslin EM, Dunn EV, Byrne N, Reid R: Evaluating ethical sensitivity in medical students. Journal of Medical Ethics. 1990, 16: 141-145.View ArticleGoogle Scholar
- Nishimura T, Miyasaka M, Akabayashi A, Kai I, Ohi G: The Development of Evaluation Method for Bioethics Education in Japan: a questionnaire for measuring the ethical problem identification ability. Journal of Japan Association for Bioethics. 1995, 5 (1): 73-77. (In Japanese)Google Scholar
- Sulmasy DP, Geller G, Levine DM, Faden R: Medical house officers' knowledge, attitudes, and confidence regarding medical ethics. Arc Intern Med. 1990, 150: 2509-2513. 10.1001/archinte.150.12.2509.View ArticleGoogle Scholar
- Self DJ, Wolinsky FD, Baldwin C: The effect of teaching medical ethics on medical students' moral reasoning. Academic Medicine. 1989, 64: 755-759.View ArticleGoogle Scholar
- Self DJ, Schrader DE, Baldwin DC, Wolinsky FD: The moral development of medical students: a pilot study of the possible influence of medical education. Medical Education. 1993, 27: 26-34.View ArticleGoogle Scholar
- Self DJ, Baldwin C: Does medical education inhibit the development of moral reasoning in medical students? A cross-sectional study. Academic Medicine. 1998, 73: 91-93.View ArticleGoogle Scholar
- Patenaude J, Niyonsenga T, Fafard D: Change in students' moral development during medical school: a cohort study. Canadian Medical Association Journal. 2003, 168: 840-844.Google Scholar
- Sharpe VA: Justice and care: the implications of the Kohlberg-Gilligan debate for medical ethics. Theoretical Medicine. 1992, 27: 26-34.Google Scholar
- Noddings N: Caring: A Feminine Approach to Ethics and Moral Education. 1984, Los Angeles, Cal.: University of California PressGoogle Scholar
- Gilligan C: In a Different Voice: Psychological Theory and Women's Development. 1982, Cambridge, Mass.: Harvard University PressGoogle Scholar
- Misch DA: Evaluating physicians' professionalism and humanism: the case of humanism "connoisseurs.". Academic Medicine. 2002, 77 (6): 489-95.View ArticleGoogle Scholar
- Nilstun T, Westrin CG: The use of numbers in ethical analysis. Health Care Analysis. 1994, 2: 43-46.View ArticleGoogle Scholar
- Goldie J, Schwartz L, McConnachie A, Morrison J: The impact of three years' ethics teaching, in an integrated medical curriculum, on students' proposed behavior on meeting ethical dilemmas. Medical Education. 2002, 36: 489-497. 10.1046/j.1365-2923.2002.01176.x.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6939/5/1/prepub
Pre-publication history
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.
