Special Theme: Faculty Development: SPECIAL THEME ARTICLES
Shifting Paradigms: From Flexner to Competencies
Carraccio, Carol MD; Wolfsthal, Susan D. MD; Englander, Robert MD, MPH; Ferentz, Kevin MD; Martin, Christine PhD
Dr. Carraccio is professor and associate chair for education, Department of Pediatrics, Dr. Wolfsthal is associate professor and associate chair for education, Department of Medicine, and Dr. Ferentz is associate professor of family medicine and residency program director, Department of Family Medicine, all at the University of Maryland, Baltimore. Dr. Englander is assistant professor and associate program director, Department of Pediatrics, University of Connecticut, Hartford (held same titles at the University of Maryland, Baltimore, at the time the work was done). Dr. Martin is assistant professor and medical educator, Department of Medicine, University of Maryland (was professor of biology, Ursuline College, Pepper Pike, Ohio, at the time the work was done).
Correspondence should be addressed to Dr. Carraccio, Department of Pediatrics, Rm. N5W56, 22 South Greene Street, Baltimore, MD 21201; telephone: 410-328-5213; fax: 410-328-0646; e-mail: 〈firstname.lastname@example.org〉. Reprints are not available.
The authors thank Mary Alice Parsons, executive director, Residency Review Committee for Pediatrics and Family Medicine, for her critical review of the manuscript. This work was funded in part through a grant from the Health Resources and Services Administration, Bureau of Health Professions.
Realizing medical education is on the brink of a major paradigm shift from structure- and process-based to competency-based education and measurement of outcomes, the authors reviewed the existing medical literature to provide practical insight into how to accomplish full implementation and evaluation of this new paradigm. They searched Medline and the Educational Resource Information Clearinghouse from the 1960s until the present, reviewed the titles and abstracts of the 469 articles the search produced, and chose 68 relevant articles for full review.
The authors found that in the 1970s and 1980s much attention was given to the need for and the development of professional competencies for many medical disciplines. Little attention, however, was devoted to defining the benchmarks of specific competencies, how to attain them, or the evaluation of competence. Lack of evaluation strategies was likely one of the forces responsible for the three-decade lag between initiation of the movement and wide-spread adoption. Lessons learned from past experiences include the importance of strategic planning and faculty and learner buy-in for defining competencies. In addition, the benchmarks for defining competency and the thresholds for attaining competence must be clearly delineated. The development of appropriate assessment tools to measure competence remains the challenge of this decade, and educators must be responsible for studying the impact of this paradigm shift to determine whether its ultimate effect is the production of more competent physicians.
The challenge to medical education at the turn of the 20th century took the form of the Flexnerian revolution.1 Exposure of poor educational content and processes in the early 1900s captured public attention and concern, precipitating a chain of events that led to drastic reform. In the early 21st century, accountability and responsibility to the public for the competency of practicing physicians have become a driving force behind an initiative of the American Board of Medical Specialties (ABMS) and the Accreditation Council for Graduate Medical Education (ACGME) to establish competency-based training for all physicians. The current structure- and process-based system defines the training experience by exposure to specific contents for specified periods of time (e.g., one month of adolescent medicine), while a competency-based system defines the desired outcome of training, the outcome driving the educational process (e.g., competence in the care of adolescent patients). The paradigm shift from the current structure- and process-based curriculum to a competency-based curriculum and evaluation of outcomes is the Flexnerian revolution of the 21st century.
We reviewed the literature on competency-based education in medicine to (1) understand the evolution of this educational paradigm, (2) assess the evidence to date of the efficacy of competency-based education, and (3) provide practical insight into how to accomplish full implementation and evaluation of the paradigm shift.
With the aid of a reference librarian, we searched Medline from 1966 to the present and the Educational Resource Information Clearinghouse (ERIC) from 1967 to the present using “competency-based” as a medical subject heading. Limiting the search to English-language original articles produced 340 references in Medline and almost 10,000 in ERIC. Further modification of the ERIC search by including “competency-based” in the title (9,887) and “medical” or “medicine” (68) as subject heading resulted in 129 articles. We reviewed the titles and abstracts of the 469 references and chose 68 relevant articles for full review.
What Does It Mean to Be Competent?
Many definitions of competency emerged in the medical literature beginning in the 1970s.2–8 Essentially, however, synthesis and simplification of these definitions led us to describe “competency” as a complex set of behaviors built on the components of knowledge, skills, attitudes, and “competence” as personal ability. (These definitions are adapted to reflect language commonly used in educational settings.) In fact, the six ACGME “competencies” actually represent domains in which a physician must ultimately demonstrate competence. Our review supports the competency construct as a complex but demonstrable integration of numerous related objectives, the latter being discrete measurable behaviors. Attainment of defined competencies helps reach a set goal, which is by definition lofty, vague, and far-reaching. The elements of competency-based education are best understood when contrasted with the elements of the structure-and process-based system that pervades medical education today (see Table 1).
THE EMERGENCE OF THE COMPETENCY CONSTRUCT IN THE 1970S AND 1980S
In addition to defining competency-based education, early publications focused on the forces behind the paradigm shift and the process of curriculum development. The cultural climate of the 1960s and early 1970s caused a significant fragmentation of curricula and a de-emphasis on basic skills, with a concomitant decline in scores of indicators of educational effectiveness such as Student Achievement Tests and classroom examinations. This deterioration in scores prompted a “back-to-basics” movement with emphasis on minimum standards and performance competencies at all educational levels.9 At the same time, the public demanded increased competence, even in the “professions” previously immune to consumerism. Public health leaders also called for competency-based training, and sought a workforce equipped to handle the population's needs by emphasizing competence in the context of the practice setting.10 Professional organizations, such as the American Dietetic Association11 and the State Board of Higher Education of the University of Illinois, joined this movement early, establishing guidelines and even edicts for the paradigm shift in the educational institutions over which they presided.12 These organizations prompted the implementation of several competency-based programs ranging from small-scale projects, such as developing interview skills in residents,13 to large-scale endeavors, such as creating a competency-based curriculum for first-year psychiatry residents,14 or a baccalaureate program for physical therapy students.15 As early as 1972, the American Board of Pediatrics published one of the first comprehensive documents on this subject, entitled Foundations for Evaluating the Competency of Pediatricians.16,17
Having set the stage for the context in which competency-based education developed, the stepwise approach to curricular design emerged as a consistent theme throughout the literature. The four steps are (1) competency identification, (2) determination of competency components and performance levels, (3) competency evaluation, and (4) overall assessment of the process. Possible methods for identifying competencies (step one) include the Delphi technique, which uses a consensus of individual experts,18 and the nominal group technique, which relies on group consensus19; task analysis, in which a researcher accompanies a physician to document all activities over a period of time18; the critical-incident survey, in which qualified practitioners describe observed incidents that reflect good or bad practice10,19; the behavioral-event interview, in which star performers describe critical clinical situations and characteristics of a good doctor10; and the simplest method—practitioner surveys.6 The identification of competencies received more attention than the other steps in the process.
The second step involves determining competency components and performance levels. The former includes “tasks” that, either sequentially or in sum, make up the competency. These “tasks” are often referred to as benchmarks or performance indicators. They must be measurable and in the aggregate determine achievement of the specific competency. Performance criteria set the threshold for demonstrating competence.2 The expected performance level for each benchmark must be clearly defined to determine whether competence has been achieved. The educator must then determine the methods by which the competency might be attained, such as through didactic learning, small-group discussions, or on-site experiences, or via information technology.14
The third step determines how the attainment of competence will be assessed. Criterion-referenced measures that compare performance against a set standard or threshold are the preferred methods.2 The normative-based assessment, typical of the structure- and process-based curriculum, compares the student's performance with that of a peer group. However, this assessment fails to provide a clear understanding of what a student can or cannot do, and cannot determine which, if any, benchmarks or performance indicators have been met.20 As the final step, the competencies, attainment procedures, and assessment system are validated.2
While several studies in the 1970s and 1980s furnished a practical description of the competency-based curriculum development process,2,12,14,21,22 only one provided a comparison between a competency-based curriculum and the traditional structure- and process-based one.9 Thurman and Sanders split a class of radiology technician students to receive either a traditional or a competency-based instructional method for one learning block.9 While the groups were small (n = 6 and 5, respectively) and the participants not masked with regard to study group, scores on the post-test assessments were significantly higher than those on the pre-test assessments among the competency-based group. A study from the nursing literature that evaluated participants of competency-based workshops likewise showed improvements in effectiveness and efficiency of specific skills.23
Although the medical education process during the 1970s included generally defined competencies, corresponding curricular objectives or benchmarks to describe the competencies were inadequate. Residency programs classically contained superficial curriculum guidelines without clear definitions of expected competencies.24 Despite the prediction of Dunn et al. that competency-based education was an “idea whose time seems to have come,” the competency movement of this era dwindled.18 The lack of a direct link between the desired competencies and curricular objectives, as well as inadequate assessment tools to evaluate competence, may have contributed to its demise.
THE LAST DECADE
At the beginning of the decade, and coincidentally with revisions in the Essential Requirements for Residency Training in Family Medicine by its residency review committee (RRC), the Society of Teachers of Family Medicine promulgated a new curriculum, entitled “Essentials for Family Practice.”25 It contained a visionary proposal to develop competency-based curricula and provide objective measurements of competence for each rotation. The authors cautioned against a focus limited to those competencies that can be measured rather than those that need to be learned. The nursing literature shared the concern that emphasis on skill acquisition, which is more easily measured, may replace the development of necessary cognitive and critical thinking26 as well as the interpersonal skills needed for effective patient interaction.27,28
Brown University School of Medicine serves as a model of an institution that has recently adopted the paradigm shift to competency-based education through the MD2000 project.29 Faculty were intimately involved in the process of defining nine abilities all students must attain prior to graduation and translated each ability into observable behaviors rated at three levels of competence: beginning, intermediate, and advanced. They then developed new assessment methods based on clear performance criteria. Students were required to demonstrate application of knowledge with certification in each course, as well as attain an intermediate level of competence in all nine abilities and an advanced level in problem solving. Preliminary results on the United States Medical Licensing Examination indicate current students' scores are at the national mean and their pass rates slightly above the mean, using this new educational strategy.30
The Baylor College of Dentistry undertook an extensive process of curriculum reform similar to the MD2000 project. The authors noted the importance of developing a competency-based curriculum as an integral part of the school's strategic plan, as well as capitalizing on new accreditation requirements to facilitate change. Including faculty in significant and continuing ways throughout the process emerged as an important feature. The process also required administrative support for developing, managing, and assessing the curriculum, and assurance that the planning process was clearly linked to an assessment plan. The curriculum creators also developed various methods for assessment of students' competence, incorporating evaluations from many observers in different situations to make the final assessments. Observing students doing real work, keeping the faculty close to the assessment process, designing a curricular review process that is competency-based, and developing a competency document that focuses on beginning professional practice were all important to the success of curricular revision. Other dental educators have likewise identified competency-based education as a critical foundation for their education programs.31–34
On a smaller scale, additional studies have explored the effect of a competency-based program for selected medical school rotations and residency programs. A pilot program to assess the value of a competency-based clinical skills assessment program was undertaken for third-year medical students during their surgical clerkship.35 Scores on the check-list skills assessment correlated poorly with those from the standard global evaluation forms and those on standardized national board examinations, but improved when students attended an orientation session with clear delineation of expectations. Martin et al. demonstrated improvement in clinical skills and patient care when a competency-based instruction module on three invasive procedures was introduced into a surgery residency program.36 Pre-testing, group instruction, and hands-on teaching resulted in residents' reducing their failure and complication rates in all three procedures in the laboratory. This effect translated into a documented reduction in the residents' trauma resuscitation time in the clinical arena.
Few specialties in medicine have undertaken total restructuring of their curricula into a competency-based model. As part of the Brown MD2000, the faculty developed a competency-based curriculum in preventive medicine.37 On a broader scale, national educators in preventive medicine embarked on a project to develop competencies using a consensus process.38 Engaging faculty and other stakeholders proved to be one of the most critical ingredients for success.39,40 Indicators were defined for each competency to distinguish successful from unsuccessful performance and identify superior performance. By addressing the reliability, validity, and predictive validity, educators attempted to ensure results would be predictive of future success as a specialist.
Through the 1990s much of the literature focused on the debate surrounding the evaluation of competence. Does a minimum threshold exist that defines one as competent versus incompetent? Chambers and Glassman suggested five stages, beginning with novice; progressing through beginner, competent, and proficient; and culminating in expert.41 For the novice, the focus concerns isolated facts that tests can evaluate. For the beginner, synthesis and integration of information learned in seminars, in labs, and through supervised work are evaluated via simulations. The competent individual functions as an independent learner and practices in a realistic work setting. Evaluation is authentic and comprises portfolios that contain ratings of supervisors, exemplary products, and test cases. Professional identity and norms characterize proficiency, which is achieved by socialization and specialized training and evaluated by work-related markers. The expert—at the highest level of competence—has an internalized, patient-centered focus, learns through self-direction, and relies on self-assessment and internalized standards of evaluation.
The nursing literature also addressed the need for real-world observation in the evaluation of seasoned nurses, pointing out that current methods are typically geared to beginners.26 Defined competencies are needed for supervisors to assess staff nursing skills adequately and identify areas requiring remediation.42,43 Competency-based instruction is preferred for adult learners, who tend to be self-directed and willing to assume responsibility in the learning process.44,45 Citing similarities between the competency-based model and the adult-learning theory model, studies have highlighted the feedback and evaluation processes that are essential components of active learning.46 Allowances for differences in learning style and remediation and re-assessment of students who do not meet standards must be considered.47 One earlier study described the “clinical contract” as a strategy to evaluate clinical performance by identifying how, when, what, where, and by whom the clinical performance will be evaluated.48 The teacher, acting as facilitator, designs the clinical learning contract based on the elements of adult learning. The individual nature of curricular design is consistent with the concept that attainment of competence is dependent on individual progress. Recently, neurosurgery residents have attained procedural competencies with individually paced learning much sooner than with fixed time schedules.49 As such, one may conclude that certification of competence should be independent of time, replacing the predetermined fixed length of training for each subspecialty.
The competency movement has also received some attention in the international arena. For example, a decade of evolving curricular reform of medical education in Canada has set the precedent for competency-based education from undergraduate programs through the maintenance of certification.50,51 The Web site of the Royal College of Physicians and Surgeons not only focuses on competency-based graduate medical education but places a major emphasis on competence in practice through the maintenance of certification programs.52 The Educational Commission for Foreign Medical Graduates requires the Clinical Skills Assessment for international medical students seeking training in the United States, which likewise demonstrates the recent focus on evaluation of competence through the use of standardized patients.53
Several other countries have reported various efforts at incorporating competency-based training and evaluation for medical students,54–57 residents,58,59 and practicing physicians.7,60,61 The nursing profession in Australia undertook a review of the literature on competency-based learning as early as 1982.62 Unfortunately, these reports were hampered by a lack of standardized terminology. While assessing and enhancing “competence” is mentioned as the goal in each of these publications, wide variation exists in the extents to which true competency-based learning objectives were instituted. Australian nursing competencies are being written and will be uniform throughout the country,63 although some raise concern that the competencies may control the curriculum.28 In the United Kingdom, a method of measurement and evaluation of performance was developed for nurses for use within their first year of employment. Initial results of an in-depth audit showed that measurement instruments developed were clear indicators of performance, although longterm validity studies are pending.64 At the residency level, one interesting study compared competency-based evaluation with more subjective supervisors' evaluations of a large cohort of residents.58 When subjectively evaluated by their supervisors, the majority of residents were judged “competent.” Less than 2% of residents were found competent when more objective criteria were used.
In collaboration with American colleagues and the Chinese Medical Board of New York, three Chinese medical schools incorporated standardized patient programs.56 One year after implementation, participating students significantly outperformed their counterparts who were not enrolled. The new curriculum has been rapidly incorporated and has led to measurable improvement in students' clinical skills, in both increased performance scores and decreased variation among students.
THE NEW MILLENNIUM
The driving force behind the recent joint effort of the ACGME and the ABMS to shift from structure- and process-based to competency-based medical education is accountability to the public, particularly in light of the reliance on public funding.65 Outcomes-based data are needed for informed discussions with policy leaders focused on funding graduate medical education and patient safety. Also, the current system does not directly measure the quality of the educational outcomes of a program. At the February 1999 meeting, the ACGME endorsed six general competencies as the foundation of all graduate medical education: (1) patient care, (2) medical knowledge, (3) practice-based learning and improvement, (4) interpersonal and communication skills, (5) professionalism, and (6) systems-based practice. Some minimal language to address the competencies is being incorporated into the requirements for residency training for each RRC; however, the timeline for full implementation and evaluation will span the next decade.
Review of the literature over the last three decades reflects a defined movement toward competency-based curricula and outcomes evaluation. Despite societal forces for documented competence among medical professionals, widespread adoption is not yet a reality. In addition, our review revealed little scientific evidence evaluating the outcomes of competency-based education. What evidence does exist clearly favors competency-based education over the current structure- and process-based model. Nonetheless, several lessons may be learned from the available evidence. Of critical importance is the strategic planning phase of identifying and defining competencies needed for professional practice. A series of benchmarks or performance indicators describing the outcome expectancy of each competency must be outlined.66 The knowledge, skills, and attitudes underpinning each competency need to be clearly written, measurable, and in summation reflect the achievement of that competency. The threshold for achieving competence must be predetermined. Assessment tools must be specifically matched to the competency to effectively evaluate outcomes. Evaluation should reflect real-world observation and consist of a “portfolio” of assessment tools. Faculty and learner buy-in with consensus building and coupling with strong administrative support are crucial every step of the way. The final step in achieving successful implementation is to ensure that those intimately involved with this process assume responsibility for the creation of faculty development programs for the clinician educators who teach our trainees.
The challenges identified in the conclusion of The Federated Council of Internal Medicine's Resource Guide for Residency Education include coordinating medical student and residency curricula, expanding programs for faculty development, creating better systems of evaluation, and garnering the resources to develop learner-centered residency programs.67 In addition, active rather than passive learning needs to provide the infrastructure for the educational process. This will require a change in ethos on the teacher's part as well as the learner's, resulting in “socialization into the new paradigm.”30
PRESCRIPTION FOR THE FUTURE HEALTH AND WELL-BEING OF MEDICAL EDUCATION
Much descriptive work has defined competencies and outlined processes that can be used in creating competency-based curricula. Assessment tools to evaluate competence have received less attention. The creation of tools that are valid, reliable, and predictive of future success is our immediate challenge. As educators we must take the lead in defining and studying the outcomes that result from this paradigm shift to competency-based education with the same rigor we use in basic science laboratories and randomized clinical trials. Only then will we know whether competency-based training produces more competent physicians, and whether the paradigm shift of the new century is as significant as the Flexnerian revolution of the last one.
1. Flexner A. Medical Education in the United States and Canada. A Report to the Carnegie Foundation for the Advancement of Teaching. Bulletin No. 4. Boston, MA: Updyke, 1910.
2. Brown TC, McCleary LE, Stenchever MA, Poulson AM. A competency-based educational approach to reproductive biology. Am J Obstet Gynecol. 1973;116:1036–43.
3. Spady WG. Competency-based education: a bandwagon in search of a definition. Educ Res. 1977;6:9–14.
4. Bell CG. Role vs. entry-level competencies in competency-based education. J Am Diet Assoc. 1976;69:133–7.
5. Rinke WJ. Competency-based education. J Am Diet Assoc. 1980;76:247–52.
6. Grussing PG. Education and practice: is competency-based education closing the gap? Am J Pharm Educ. 1984;48:117–24.
7. Hager P, Gonczi A. Competency-based standards: a boon for continuing professional education? Stud Cont Educ. 1991;13:24–40.
8. Bell HS, Kozakowski SM, Winter RO. Competency-based education in family practice. Fam Med. 1997;29:701–4.
9. Thurman GK, Sanders MK. Competency-based education versus traditional education: a comparison of effectiveness. Radiol Technol. 1987;59:164–9.
10. McGahie WC, Miller GE, Sajid AW, Telder TV. Competency-based curriculum development in medical education: an introduction. Public Health Pap. 1978;68:11–91.
11. Argo JK, Watson DR, Lee EC. A computer-managed clinical evaluation system: implications for competency-based dietetic education programs. J Am Diet Assoc. 1984;4:36–41.
12. Quinlan TH. The Rockford experience: competency-based medical curriculum. Am J Pharm Educ. 1975;39:435–9.
13. Stillman PL, Sabers DL. Using a competency-based program to assess interviewing skills of pediatric housestaff. J Med Educ. 1978;53:493–6.
14. Weinstein HM, Russell ML. Competency-based psychiatric education. Am J Psychiatry. 1976;133:935–9.
15. May BJ. Evaluation in a competency-based educational system. Phys Ther. 1976;57:28–33.
16. Burg FD, Brownlee RC, Wright FH, et al. A method for defining competency in pediatrics. J Med Educ. 1974;51:824–8.
17. American Board of Pediatrics. Foundations for Evaluating the Competency of Pediatricians. Chicago, IL: American Board of Pediatrics, 1974.
18. Dunn WR, Hamilton DD, Harden RM. Techniques of identifying competencies needed of doctors. Med Teach. 1985;7:15–25.
19. Pierleoni RG. Clinical evaluations techniques for the health professions. Improv Hum Performance Q. 1978;7:204–16.
20. Turnbull J. What is… normative versus criterion-referenced assessment. Med Teach. 1989;1:145–50.
21. Bair JN, Powell PJ. Structured competency-based hospital pharmacy internship program. Am J Hosp Pharm. 1981;38:1705–8.
22. Poole SR, Morrison JD, Adolf A, Reed FM. Pediatric training in family practice: a core curriculum. J Fam Pract. 1982;15:1145–56.
23. Greaves PE, Loquist RS. Impact evaluation: a competency-based approach. Nurs Admin Q. 1983;7:81–6.
24. Bashook PG, Sandlow LJ, Reinhard JW. Defining a universe of expected competencies: a methodological example for internal medicine. Proceedings of the American Educational Research Association, Toronto, ON, Canada, March 27–31, 1978.
25. Marenstein JH, Schulte JJ. STFM Task Force on Residency Curriculum of the Future. a residency curriculum for the future. Fam Med. 1990;22:467–73.
26. Bechtel GA, Davidhizar R, Bradshaw MJ. Problem-based learning in a competency-based world. Nurse Educ Today. 1999;19:182–7.
27. Benner P. Issues in competency-based testing. Nurs Outlook. 1982;30:303–9.
28. Chapman H. Some important limitations of competency-based education with respect to nurse education: an Australian perspective. Nurse Educ Today. 1999;19:129–35.
29. Smith SR, Fuller B. MD2000: a competency-based curriculum for the Brown University School of Medicine. Med Health RI. 1996;79:292–8.
30. Smith SR, Dollase R. AMEE guide no. 14: outcome-based education: Part 2—planning, implementing and evaluating a competency-based curriculum. Med Teach. 1999;21:15–23.
31. McCann AL, Babler WJ, Cohen PA. Lessons learned from the competency-based curriculum initiative at Baylor College of Dentistry. J Dent Educ. 1998;62:197–206.
32. Hendricson WD, Kleffner JH. Curricular and instructional implications of competency-based dental education. J Dent Educ. 1998;62:183–96.
33. Chambers DW. Competency-based dental education in context. Eur J Dent Educ. 1998;2:8–13.
34. Yip HK, Smales RJ. Review of competency-based education in dentistry. Br Dent J. 2000;189:324–6.
35. Dunnington GL, Wright K. A pilot experience with competency-based clinical skills assessment in a surgical clerkship. Am J Surg. 1994;167:604–7.
36. Martin M, Vashisht B, Frezza E, et al. Competency-based instruction in critical invasive skills improves both resident performance and patient safety. Surgery. 1998;124:313–7.
37. Pololi LH, Coletta EM, Kern DG, et al. Developing a competency-based preventive medicine curriculum for medical schools. Am J Prev Med. 1994;10:240–4.
38. Lane DS, Ross V, Parkinson MD, Chen DW. Performance indicators for assessing competencies of preventive medicine residents. Am J Prev Med. 1995;11:1–8.
39. Lane DS, Ross V. Consensus on core competencies for preventive medicine residents. Am J Prev Med. 1994;10:52–5.
40. Lane DS, Ross V. The importance of defining physicians' competencies: lessons from preventive medicine. Acad Med. 1994;69:972–4.
41. Chambers DW, Glassman P. A primer on competency-based evaluation. J Dent Educ. 1997;61:651–66.
42. Feeney J, Benson-Landau M. Competency-based evaluation: not just for new nurses. Dimens Crit Care Nurs. 1987;6:368–72.
43. Helm A. Legal perspective on competency-based evaluation. Dimens Crit Care Nurs. 1987;6:373–6.
44. Redus KM. A literature review of competency-based orientation for nurses. J Nurs Staff Dev. 1994;10:239–43.
45. del Bueno DJ. Competency based education. Nurse Educ. 1986;3:10–4.
46. Musinski BA. Educated as an adult: a competency-based practical nurse program. J Pract Nurs. 1996;46:20–3.
47. Tutuska AM, Nahigian E. Competency-based evaluation: one hospital's approach. J Nurs Staff Dev. 1997;13:44–6.
48. Beare P. The clinical contract—an approach to competency-based clinical learning and evaluation. J Nurs Educ. 1985;24:75–82.
49. Long DM. Competency-based residency training: the next advance in graduate medical education. Acad Med. 2000;75:1178–83.
50. Mandin H, Harasym P, Eagle C, Watanabe M. Developing a “clinical presentation” curriculum at the University of Calgary. Acad Med. 1995;70:186–93.
51. Mandin H, Dauphinee WD. Conceptual guidelines for developing and maintaining curriculum and examination objectives. Acad Med. 2000;75:1031–7.
52. General information and regulations on residency requirements and examinations leading to certification, 〈http://rcpsc.medical.org/english/
〉. Accessed 2/1/02. The Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada, 2001.
53. ECFMG certification—clinical skills assessment 〈http://www.ECFMG.org
〉. Accessed 4/10/01. Educational Commission for Foreign Medical Graduates, Philadelphia, PA, 2001.
54. Stone DH. A method of deriving definitions of specific medical competencies: a framework for curriculum planning and evaluation. Med Teach. 1987;9:155–9.
55. Jeffery HE, Henderson-Smart DJ, Hill DA. Competency-based learning in neonatology. Med Educ. 1996;30:440–4.
56. Stillman PL, Wang Y, Quyang Q, Zhang S, Yang Y, Sawyer WD. Teaching and assessing clinical skills: a competency-based programme in China. Med Educ. 1997;31:33–40.
57. Eldin M, Magzoub MA, Schmidt HG, Abel-Hameed AA, Dolmans D, Mustafa SE. Student assessment in community settings: a comprehensive approach. Med Educ. 1998;32:50–9.
58. Al-Chalabi TS, Al-Na'Ama MR, Al-Thamery DM, et al. Critical performance analysis of rotating resident doctors in Iraq. Med Educ. 1983;17:378–84.
59. Rourke J. Postgraduate medical education for rural family practice in Canada. J Rural Health. 2000;16:280–7.
60. Yuen K, Barrington D, Headford N, et al. Educating doctors in palliative medicine: development of a competency-based training program. J Palliat Care. 1998;14:79–82.
61. Hartley R. Area health services as learning organizations: the rural experience. Aust J Rural Health. 2000;8:77–80.
62. Scott B. Competency based learning: a literature review. Int J Nurs Stud. 1982;19:119–24.
63. Parkes R. Competency-based training: Australia moves to a competency-based system of training and education. Aust Nurs J. 1991;21:12–13.
64. O'Connor SE, Pearce J, Smith RL, Vogeli D, Walton, P. Monitoring the quality of pre-registration education: development, validation and piloting of competency-based performance indicators for newly qualified nurses. Nurs Educ Today. 1999;19:334–41.
65. Outcomes Project 〈http://www.acgme.org
〉. Accessed 1/31/02. The Accreditation Council for Graduate Medical Education, Chicago, IL, 2001.
66. Lemons DE, Griswold JG. Defining the boundaries of physiological understanding: the benchmarks curriculum model. Adv Physiol Educ. 1998;20:S35–S45.
67. Ende J, Kelley M, Sox H. The Federated Council of Internal Medicine's resource guide for residency education: an instrument for curricular change. Ann Intern Med. 1997;127:454–7.
This article has been cited 114 time(s).
ChirurgCompetency-based medical education. National catalogue of learning objectives in surgeryChirurg
Academic Emergency MedicineAssessing Patient Care: Summary of the Breakout Group on Assessment of Observable Learner PerformanceAcademic Emergency Medicine
Journal of Social Work EducationA Critical Appraisal of the Use of Standardized Client Simulations in Social Work EducationJournal of Social Work Education
American Journal of MedicineMilestones: Do Learners and Teachers Agree?American Journal of Medicine
Bmc Medical EducationThe effect of implementing undergraduate competency-based medical education on students' knowledge acquisition, clinical performance and perceived preparedness for practice: a comparative studyBmc Medical Education
Medical EducationScientist or science-stuffed? Discourses of science in North American medical educationMedical Education
Advances in Health Sciences EducationCaptive on a carousel: discourses of 'new' in medical education 1910-2010Advances in Health Sciences Education
Advances in Health Sciences EducationOutcome (competency) based education: an exploration of its origins, theoretical basis, and empirical evidenceAdvances in Health Sciences Education
Action ResearchEvolving on purpose: Results of a qualitative study to explore how public youth system reform advocates apply anti-oppressive practice frameworks in a collaborative training and action processAction Research
2011 4Th International Conference of Education, Research and Innovation (Iceri)
Co-Assessment and Self-Assessment As An Active and Integrative Strategy in Neurophysiology
2011 4Th International Conference of Education, Research and Innovation (Iceri), ():
Medical EducationPeer assessment of professional competenceMedical Education
Teaching and Learning in Medicine
"Coming about"! A faculty workshop on teaching beliefs
Teaching and Learning in Medicine, 19(2):
Proceedings of 2007 International Conference on Management Science and Engineering Management
On the construction of a competency model of medical graduates
Proceedings of 2007 International Conference on Management Science and Engineering Management, ():
Professional Psychology-Research and PracticeRecognizing, assessing, and intervening with problems of professional competenceProfessional Psychology-Research and Practice
PediatricsLinking Process to Outcome: Are We Training Pediatricians to Meet Evolving Health Care Needs?Pediatrics
Journal of Veterinary Medical Education
The scholarship of teaching in health science schools
Journal of Veterinary Medical Education, 32(1):
Proceedings of the 21St Ieee International Symposium on Computer-Based Medical Systems
Developing competence assessment procedure for spinal anaesthesia
Proceedings of the 21St Ieee International Symposium on Computer-Based Medical Systems, ():
An integrative approach to cultural competence in the psychiatric curriculum
Academic Psychiatry, 32(4):
Teaching and Learning in MedicineEvaluation of Essay Questions Used to Assess Medical Students' Application and Integration of Basic and Clinical Science KnowledgeTeaching and Learning in Medicine
International Journal of Occupational and Environmental Health
A global survey of occupational health competencies and curriculum
International Journal of Occupational and Environmental Health, 11(2):
Mount Sinai Journal of Medicine
Comprehensive educational performance improvement (CEPI): An innovative, competency-based assessment tool
Mount Sinai Journal of Medicine, 72(5):
Teaching and Learning in MedicineHow much do differences in medical schools influence student performance? A longitudinal study employing hierarchical linear modelingTeaching and Learning in Medicine
Medical EducationEntrustability of professional activities and competency-based trainingMedical Education
Educating the pediatrician of the 21st century: Defining and implementing a competency-based system
American Journal of Respiratory and Critical Care Medicine
Curriculum and competency assessment tools for sleep disorders in pulmonary fellowship training programs
American Journal of Respiratory and Critical Care Medicine, 172(3):
Medical EducationAssessing resident's knowledge and communication skills using four different evaluation toolsMedical Education
Child and Adolescent Psychiatric Clinics of North AmericaCompetenciesChild and Adolescent Psychiatric Clinics of North America
Journal of the American Board of Family MedicineWhat comprises clinical experience in recognizing depression?: The primary care clinician's perspectiveJournal of the American Board of Family Medicine
OphthalmologyTime, money, and the brave new world of residency educationOphthalmology
Medical Journal of Australia
The effectiveness of competency-based education in equipping primary health care workers to manage chronic disease in Australian general practice settings
Medical Journal of Australia, 188(8):
The Family Medicine Curriculum Resource Project structural framework
Family Medicine, 39(1):
Medical TeacherMentoring portfolio use in undergraduate and postgraduate medical educationMedical Teacher
American Journal of Rhinology & AllergyVideo-based assessment of operative competency in endoscopic sinus surgeryAmerican Journal of Rhinology & Allergy
Use of clerkship learning objectives by members of the Association of Directors of Medical Student Education in Psychiatry
Academic Psychiatry, 30(2):
Advances in Health Sciences EducationThe competency movement in the health professions: ensuring consistent standards or reproducing conventional domains of practice?Advances in Health Sciences Education
Journal of Clinical Psychology in Medical SettingsCompetencies for psychologists in academic health centers (AHCs)Journal of Clinical Psychology in Medical Settings
Medical TeacherContinuity clinic preceptors and ACGME competenciesMedical Teacher
Professional Psychology-Research and PracticeThe competency movement within psychology: An historical perspectiveProfessional Psychology-Research and Practice
Journal of Professional NursingAn Investigation of Nursing Competence and the Competency Outcomes Performance Assessment Curricular Approach: Senior Students' Self-Reported PerceptionsJournal of Professional Nursing
Identification of resident and attending physicians: Do parents know who is caring for their hospitalized child?
Ambulatory Pediatrics, 4(3):
Teaching and Learning in Medicine
Evaluating competence using a portfolio: A literature review and web-based application to the ACGME competencies
Teaching and Learning in Medicine, 16(4):
Archives of Disease in ChildhoodUsing children as standardised patients for assessing clinical competence in paediatricsArchives of Disease in Childhood
Human Resources for HealthDeveloping a competency-based curriculum in HIV for nursing schools in HaitiHuman Resources for Health
Medical TeacherAn innovative outcomes-based medical education program built on adult learning principlesMedical Teacher
Journal of Social Work Education
Evaluating the outcomes of social work practice: A pilot program
Journal of Social Work Education, 38(3):
Competency-based goals for sleep and chronobiology in undergraduate medical education
Canadian Journal of Anaesthesia-Journal Canadien D Anesthesie
Full scale computer simulators in anesthesia training and evaluation
Canadian Journal of Anaesthesia-Journal Canadien D Anesthesie, 51(5):
Medical EducationLearning management systems: technology to measure the medical knowledge competency of the ACGMEMedical Education
PediatricsAchieving consensus on competency in community pediatricsPediatrics
Child and Adolescent Psychiatric Clinics of North AmericaTeaching evidence-based medicine pediatric psychopharmacology: Integrating psychopharmacologic treatment into the broad spectrum of careChild and Adolescent Psychiatric Clinics of North America
Ophthalmic Surgery Lasers & Imaging
Is it safe to have an ophthalmic emergency in July?
Ophthalmic Surgery Lasers & Imaging, 38(5):
Australian Health Review
Graduate capabilities for health service managers: reconfiguring health management education @UNSW
Australian Health Review, 31(3):
Medical TeacherFaculty development: Yesterday, today and tomorrowMedical Teacher
HnoStructured residency training program for otolaryngology. A trendsetting principleHno
Medical Journal of Australia
Improving safety and quality: how can education help?
Medical Journal of Australia, 184():
RespirologyA competency-based test of bronchoscopic knowledge using the Essential Bronchoscopist: An initial concept studyRespirology
Medical TeacherFundamental components of a curriculum for residents in health advocacyMedical Teacher
Teaching and Learning in MedicineThe Importance of Measuring Competency-Based Outcomes: Standard Evaluation Measures Are Not Surrogates for Clinical Performance of Internal Medicine ResidentsTeaching and Learning in Medicine
Training and Education in Professional PsychologyCompetency Assessment Toolkit for Professional PsychologyTraining and Education in Professional Psychology
Competence-based assessment for higher specialist training in endocrinology and diabetes mellitus
Diabetic Medicine, 21():
Medical TeacherPeer teaching in medical education: twelve reasons to move from theory to practiceMedical Teacher
Teaching and Learning in MedicineResident performance on the in-training and board examinations in obstetrics and gynecology: Implications for the ACGME outcome projectTeaching and Learning in Medicine
Medical TeacherRestructuring a basic science course for core competencies: An example from anatomy teachingMedical Teacher
Journal of Dental Education
The Educational Challenge of Dental Geriatrics
Journal of Dental Education, 74(1):
Journal of the American Geriatrics Society
An unfolding case with a linked Objective Structured Clinical Examination (OSCE): A curriculum in inpatient geriatric medicine
Journal of the American Geriatrics Society, 52(7):
A national study of medical student clinical skills assessment
Academic Medicine, 80():
Obstetrics and Gynecology Clinics of North AmericaChanging the way we train gynecologic surgeonsObstetrics and Gynecology Clinics of North America
Bmc Health Services ResearchDesired Chinese medicine practitioner capabilities and professional development needs: a survey of registered practitioners in Victoria, AustraliaBmc Health Services Research
PediatricsWhat Can Data Tell Us About the Quality and Relevance of Current Pediatric Residency Education?Pediatrics
Canadian Journal of Anaesthesia-Journal Canadien D AnesthesieIntroducing information literacy into anesthesia curriculaCanadian Journal of Anaesthesia-Journal Canadien D Anesthesie
Annual Review of Public Health, Vol 31Outcome-Based Workforce Development and Education in Public HealthAnnual Review of Public Health, Vol 31
British Medical JournalMedical education - Trust competence, and the supervisor's role in postgraduate trainingBritish Medical Journal
Medical TeacherUsing outcomes-based methodology for the education, training and assessment of competence of healthcare professionalsMedical Teacher
Medical EducationEducational competencies or education for professional competence?Medical Education
Journal of Social Work Education
Can we build a better mousetrap? Improving the measures of practice performance in the field practicum
Journal of Social Work Education, 43(2):
ChestReliability of a 25-Item Low-Stakes Multiple-Choice Assessment of Bronchoscopic KnowledgeChest
Medical TeacherUsing a structured clinical coaching program to improve clinical skills training and assessment, as well as teachers' and students' satisfactionMedical Teacher
Tying it all together? A competency-based linkage model for family medicine
Family Medicine, 35(9):
NervenarztImplementation of a competency-based graduate medical education program in a neurology departmentNervenarzt
Medical EducationDefining characteristics of educational competenciesMedical Education
Public HealthThe three domains of public health: An internationally relevant basis for public health education?Public Health
RespirationValidation of two instruments to assess technical bronchoscopic skill using virtual reality simulationRespiration
Curricular Adaptations in Inpatient Child Psychiatry for the 21st Century: The Flexner Model Revisited
Academic Psychiatry, 34(3):
Documenting competency in the Mini Mental State Exam
Family Medicine, 38(4):
Medical TeacherCompetency-based education in family medicineMedical Teacher
Research on Social Work PracticeConfirmatory Factor Analysis on the Professional Suitability Scale for Social Work PracticeResearch on Social Work Practice
The Pediatrics Milestones: Initial Evidence for Their Use as Learning Road Maps for Residents
Academic Pediatrics, 13(1):
Medical TeacherWhat are we preparing them for? Development of an inventory of tasks for medical, surgical and supportive specialtiesMedical Teacher
Bmc Medical EducationWhat are the benefits of early patient contact? - A comparison of three preclinical patient contact settingsBmc Medical Education
Professional Psychology-Research and PracticeAssessing Psychologists in Practice: Lessons From the Health Professions Using Multisource FeedbackProfessional Psychology-Research and Practice
Bmc Medical EducationWhich characteristics of written feedback are perceived as stimulating students' reflective competence: an exploratory studyBmc Medical Education
Medical TeacherFrameworks for learner assessment in medicine: AMEE Guide No. 78Medical Teacher
Journal of Veterinary Medical EducationBeyond NAVMEC: Competency-Based Veterinary Education and Assessment of the Professional CompetenciesJournal of Veterinary Medical Education
SurgeryAugmenting, not cheating!Surgery
4Th International Technology, Education and Development Conference (Inted 2010)
Numeric Indicators for Competence-Based Evaluation in Statistical Learning
4Th International Technology, Education and Development Conference (Inted 2010), ():
Academic MedicineFor-Profit Undergraduate Medical Education: Back to the Future?Academic Medicine
Academic MedicineAbraham Flexner's “Mooted Question” and the Story of IntegrationAcademic Medicine
Academic MedicineMore on Competency-Based EducationAcademic Medicine
AJN The American Journal of NursingDeveloping Competence for Nurses and Social WorkersAJN The American Journal of Nursing
Obstetrics & GynecologyTraining the Gynecologic SurgeonObstetrics & Gynecology
© 2002 Association of American Medical Colleges