Skip to main content
SpringerLink
Log in

Assessment: Practical Strategies Applied to the Professions

  • Chapter
  • First Online:
Extraordinary Learning in the Workplace

Part of the book series: Innovation and Change in Professional Education ((ICPE,volume 6))

  • 1161 Accesses

Abstract

Utilizing knowledge, skills, and attitudes as an organizational structure, this chapter reviews research into the methods of assessment during workplace training for each of the four professions (medicine, nursing, theology, and education) that are the focus of the book. Not all assessments are conducted in the “physical workplace”: frequently learners are observed and assessed in simulated, offsite situations that are meant to serve as a close approximation to conditions in the workplace. One finding was that assessment methods are often used differently in different professions; one assessment method may be used to gauge attitudes in medicine and knowledge in education. In addition, many assessment methods integrate combinations of domains, evaluating performance in both knowledge and skills, for example. The authors explore how to measure a student’s ability to translate new knowledge or attitudes into the workplace in the future and suggest practical approaches to assess learners in workplace settings.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Accreditation Council on Graduate Medical Education. (2009). ACGME Outcome project slides. Available at: http://www.acgme.org/outcome/project/OutIntro.htm. Accessed August 1.

  • Alexander, J. G., McDaniel, G. S., Baldwin, M. S., & Money, B. J. (2002). Promoting, applying and evaluating problem-based learning in the undergraduate nursing curriculum. Nursing Education Perspectives, 23(5), 248–257.

    Google Scholar 

  • American Board of Internal Medicine. (1985). A guide to awareness and evaluation of humanistic qualities in the internist. Philadelphia: American Board of Internal Medicine.

    Google Scholar 

  • Anderson, R. S., & DeMeulle, L. (1998). Portfolio use in twenty-four teacher education programs. Teacher Education Quarterly, 25, 23–31.

    Google Scholar 

  • Angrist, J. D., & Guryan, J. (2008). Does teacher testing raise teacher quality? Evidence from state certification requirements. Economics of Education Review, 27, 483–503.

    Article  Google Scholar 

  • Argyris, C., & Schön, D. (1974). Theory in practice: Increasing professional effectiveness. San Francisco: Jossey-Bass.

    Google Scholar 

  • Arnold, L. (2002). Assessing professional behavior: Yesterday, today and tomorrow. Academic Medicine, 77, 502–515.

    Article  Google Scholar 

  • Aspan, P., & Hawkins, F. (2000). After the facts: Alternative student evaluation for active learning pedagogies in the undergraduate biblical studies classroom. Teaching Theology and Religion, 3(3), 133–151.

    Article  Google Scholar 

  • Barrows, H. S. (1993). An overview of the uses of standardized patients for teaching and evaluating clinical skills. Academic Medicine, 68, 443–451.

    Article  Google Scholar 

  • Beaubien, J. M., & Baker, D. P. (2004). The use of simulation for training teamwork skills in health care: How low can you go? Quality & Safety in Health Care, 13 (Suppl. 1), i51–i56.

    Article  Google Scholar 

  • Biggs, J. B. (1979). Individual Differences in study processes and quality of learning outcomes. Higher Education, 8, 381–394.

    Article  Google Scholar 

  • Boulet, J. R., McKinley, D. W., Whelan, G. P., & Hambleton, R. K. (2003). Quality assurance methods for performance based assessments. Advances in Health Sciences Education, 8, 27–47.

    Article  Google Scholar 

  • Burack, J. H., Irby, D. M., Carline, J. D., Root, R. K., & Larson, E. B. (1999). Teaching Compassion and Respect: Attending physicians’ responses to problematic behaviors. Journal of General Internal Medicine, 14, 49–55.

    Article  Google Scholar 

  • Christakis, D. A. (1993). Ethics in a short white coat: The ethical dilemmas that need student confront. Academic Medicine, 68(4), 249–254.

    Article  Google Scholar 

  • Collier, S. (1999). Characteristics of reflective thought during the student teaching experience. Journal of Teacher Education, 50, 173–181.

    Article  Google Scholar 

  • Considine, J., Botti, M., & Thomas, S. (2006). Design, format, validity and reliability of multiple choice questions for use in nursing research and education. Collegian, 12(1), 19–24.

    Google Scholar 

  • Cook, S. S., Kase, R., Middelton, L., & Monsen, R. B. (2003). Portfolio evaluation for professional competence: Credentialing in genetics for nurses. Journal of Professional Nursing, 19(2), 85–90.

    Article  Google Scholar 

  • Curtin, L. (1988). Ethics in nursing practice. Nursing Management, 19(5), 7–10.

    Google Scholar 

  • Damjanov, I., Fenderson, B. A., Veloski, J. J., & Rubin, E. (1995). Testing of medical students with open-ended, uncued questions. Human Pathology, 26, 362–365.

    Article  Google Scholar 

  • Darling-Hammond, L. (2000). How teacher education matters. Journal of Teacher Education, 51(3), 166–173.

    Article  Google Scholar 

  • Davis, M., & Karunathilake, I. (2005). The place of the oral examination in today’s assessment systems. Medical Teacher, 4, 294–297.

    Article  Google Scholar 

  • Day, L. (2005). Nursing practice and civic professionalism. American Journal of Critical Care, 14(5), 434–437.

    Google Scholar 

  • Day, S. C., Grosso, L. J., Norcini, J. J., Jr. Blank, L. L., Swanson, D. B., & Horne, M. H. (1990). Residents’ perception of evaluation procedures used by their training program. Journal of General Internal Medicine, 5(5), 421–426.

    Google Scholar 

  • Durning, S., Cation, L. J., Market, R. J., & Pangaro, L. N. (2002). Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Academic Medicine, 77, 900–904.

    Article  Google Scholar 

  • Durning, S. J., Cation, L. J., & Jackson, J. L. (2007). Are commonly used resident measurements associated with procedural skills in internal medicine residency training? Society of General Internal Medicine, 22, 357–361.

    Article  Google Scholar 

  • Elstein, A. S., Shulman, L. S., & Sprafka, S. A. (1978). Medical problem-solving: An analysis of clinical reasoning. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Fallows, S., & Chandramohan, B. (2001). Multiple approaches to assessment: Reflections on use of tutor, peer and self-assessment. Teaching in Higher Education, 6(2), 229–245.

    Article  Google Scholar 

  • Farmer, E. A., & Page, G. (2005). A practical guide to assessing clinical decision-making skills using the key features approach. Medical Education, 39, 1188–1194.

    Article  Google Scholar 

  • Fenderson, B. A., Damjanow, I., Robeson, M. R., Veloski, J. J., & Rubin, E. (1997). The virtues of extended matching and uncued tests as alternatives to multiple choice questions. Human Pathology, 28, 526–532.

    Article  Google Scholar 

  • Feudtner, C., & Christakis, D. (1994). Making the rounds: The ethical development of medical students in the context of clinical rotations. The Hastings Center Report, 24(1), 6–12.

    Article  Google Scholar 

  • Fowell, S. L., & Bligh, J. G. (1998). Recent developments in assessing medical students. Postgraduate Medical Journal, 74, 18–24.

    Article  Google Scholar 

  • Frohna, J. G., Kalet, A., Kachur, E., Zabar, S., Cox, M., Halpern, R., et al. (2004). Assessing resident’s competency in care management: Report of a consensus conference. Teaching and Leaning in Medicine, 16(1), 77–84.

    Article  Google Scholar 

  • Fuller, E. J. (1999). Does teacher certification matter? A comparison of TAAS performance in 1997 between schools with low and high percentages of certified teachers. Austin, TX: University of Texas at Austin Charles A. Dana Center.

    Google Scholar 

  • Glennon, F. (2008). Promoting freedom, responsibility, and learning in the classroom: The learning covenant a decade later. Teaching Theology and Religion, 11(1), 32–41.

    Google Scholar 

  • Goldstein, E. A., Maestas, R. R., Fryer-Edwards, K., Wenrich, M. D., Oelschlager, A. M. A., Baernstein, A., et al. (2006). Professionalism in medical education: An institutional challenge. Academic Medicine, 81, 871–876.

    Article  Google Scholar 

  • Hafferty, F. W., & Franks, R. (1994). The hidden curriculum, ethics teaching, and the structure of medical education. Academic Medicine, 69(11), 861–871.

    Article  Google Scholar 

  • Hamilton, K. E., Coates, V., Kelly, B., Boore, J., Cundell, J. H., Gracey, J., et al. (2007). Performance assessment in health care providers: A critical review of evidence and current practice. Journal of Nursing Management, 15, 773–791.

    Article  Google Scholar 

  • Harden, R., Stevenson, M., Downie, W. W., & Wilson, G. M. (1975). Clinical competence in using objective structured examination. British Medical Journal, 1, 447–451.

    Article  Google Scholar 

  • Harvard Divinity School. (2009). Learning Agreement. Accessed September 4, http://www.hds.harvard.edu/oms/Docs/LearningAgreement2008.pdf

  • Hatton, N., & Smith, D. (1995). Reflection in teacher education: Towards definition and implementation. Teaching and Teacher Education, 11(1), 33–49.

    Article  Google Scholar 

  • Hauck, F. R., Zyanski, S. J., Alemagno, S. A., & Medalie, J. H. (1990). Patient perceptions of humanism in physicians: Effects on positive health behaviors. Family Medicine, 22, 447–452.

    Google Scholar 

  • Interstate New Teacher Assessment and Support Consortium. (1992). Model Standards for beginning teacher licensing and development: A resource for state dialogue. Washington, DC: Council of Chief State School Officers.

    Google Scholar 

  • Ippolito, J., Latcovich, M., & Smith, J. M.. (2005). In fulfillment of their mission: the duties and tasks of a roman catholic priest: An assessment project. In Wabash Center for Teaching and Learning in Theology and Religion. USCCB Program of Priestly Formation (5th ed.).

    Google Scholar 

  • Irby, D. M., & Wilkerson, L. A. (2003). Educational innovations in academic medicine and environmental trends. Journal of General Internal Medicine, 18(5), 370–376.

    Article  Google Scholar 

  • Issenberg, B., McGaghie, W. C., Hart, I. R., Mayer, J. W., Felner, J. M., Petrusa, E. R., et al. (1999). Simulation technology for health care professional skills training and assessment. Journal of the American Medical Association, 282(9), 861–866.

    Article  Google Scholar 

  • Johnson, K., & Jones, E. (1998). Promoting teaching excellence: A comparison of two performance-based teacher assessment frameworks. Education, 118(4), 499–514.

    Google Scholar 

  • Jouglin, G. (2007). Student conceptions of oral presentations. Studies in Higher Education, 32(2), 323–336.

    Article  Google Scholar 

  • Kao, A., Lim, M., Spevick, J., & Barzansky, B. (2003). Teaching and evaluating school’s professionalism in US medical schools, 2002–2003. Journal of the American Medical Association, 290, 1151–1152.

    Article  Google Scholar 

  • Kassebaum, D. G., & Eaglen, R. H. (2000). Shortcomings in the evaluation of students’ clinical skills and behaviors in medical school. Academic Medicine, 74(7), 842–849.

    Article  Google Scholar 

  • Kogan, J. R., Bellini, L. M., & Shea, J. A. (2003). Feasibility, reliability, and validity of the mini-clinical evaluation exercise (mCEX) in a medicine core clerkship. Academic Medicine, 7(suppl. 8), S33–S35.

    Article  Google Scholar 

  • Kogan, J. R., & Shea, J. A. (2005). Psychometric characteristics of a write-up assessment form in a medicine core clerkship. Teaching and Learning in Medicine, 17, 101–106.

    Article  Google Scholar 

  • Kovach, R. A., Resch, D. S., & Verhulst, S. J. (2009). Peer assessment of professionalism: A five-year experience in medical clerkship. Journal of General Internal Medicine, 24 (6), 742–746. Epub 2009 Apr 24.

    Article  Google Scholar 

  • Kreiter, C. D., Ferguson, K., Lee, W. C., Brennan, R. L., & Densen, P. (1998). A generalizability study of a new standardized rating form used to evaluate students’ clinical clerkship performance. Academic Medicine, 73(12), 1294–1298.

    Article  Google Scholar 

  • Kroboth, F. J., Kapoor, W., Brown, F. H., Karpf, M., & Levey, G. S. (1985). A comparative trial of the clinical evaluation exercise. Archives of Internal Medicine, 145, 1121–1123.

    Article  Google Scholar 

  • Lettus, M. K., Moessner, P. H., & Dooley, L. (2001). The clinical portfolios as an assessment tool. Nursing Administration Quarterly, 25(2), 74–79.

    Google Scholar 

  • Lowry, J., Timms, J., & Underwood, D. G. (2000). From school to work: Employer perceptions of nursing skills. Journal for Nurses in Staff Development, 16(2), 80–85.

    Article  Google Scholar 

  • Marton, F., & Saljo, R. (1976). On qualitative differences in learning: Outcomes and process. British Journal of Educational Psychology, 46, 4–11.

    Google Scholar 

  • Masters, J. C., Hulsmeyer, B. S., Pike, M. E., Leichty, K., Miller, M. T., & Verst, A. L. (2001). Assessment of multiple-choice questions in selected test banks accompanying text books used in nursing education. Journal of Nursing Education, 40, 25–32.

    Google Scholar 

  • McCoubrie, P. (2004). Improving the fairness of multiple-choice questions: A literature review. Medical Teacher, 26(8), 709–712.

    Article  Google Scholar 

  • Medical School Objectives Writing Group. (1998). Report I: Learning objectives for medical student education. Academic Medicine, 74, 13–18.

    Google Scholar 

  • Mercer, J. A. (2002). Red light means stop! teaching theology through exposure learning in manila’s red light district. Teaching Theology and Religion, 5(2), 90–100.

    Article  Google Scholar 

  • Muzzin, L. J., & Hart, L. (1985). Oral examinations. In V. R. Neufeld, G. R. Norman (Eds.), Assessing clinical competence (pp. 71–93). New York: Springer.

    Google Scholar 

  • Noel, G. L., Herbers, J. E., Caplow, M. P., Cooper, G. S., Pangaro, L. N., & Harvey, J. (1992). How well do internal medicine faculty members evaluate the clinical skills of residents? Annals of Internal Medicine, 117(9), 757–765.

    Google Scholar 

  • Norcini, J. J. (1995). Peer assessment of competence. Medical Education, 37, 539–543.

    Article  Google Scholar 

  • Norcini, Blank, Arnold, & Kimball, (1984). A comparison of knowledge, synthesis and clincal judgment: Mutliple-choice questions in the assessment of physician competence. Evaluation and The Health Professions, 7(4), 485–500.

    Article  Google Scholar 

  • Norcini, J. J., Blank, L. L., Arnold, G. K., & Kimball, H. R. (1995). The mini-CEX (clinical evaluation exercise): A preliminary investigation. Annals of Internal Medicine, 123, 795–799.

    Google Scholar 

  • Page, G., & Bordage, G. (1995). The medical council of Canada’s key features project: A more valid written examination of clinical decision-making skills. Academic Medicine, 70, 104–110.

    Article  Google Scholar 

  • Papadakis, M. A., Loeser, H., & Healy, K. (2001). Early detection and evaluation of professionalism deficiencies in medical students: One school’s approach. Academic Medicine, 76(11), 1100–1106.

    Article  Google Scholar 

  • Papadakis, M. A., Osborn, E. H., Cooke, M., & Healy, K. (1999). A strategy for the detection and evaluation of unprofessional behavior in medical students. Academic Medicine, 74(9), 980–990.

    Article  Google Scholar 

  • Papadakis, M. A., Teherani, A., Banach, M. A., Knettler, T. R., Rattner, S. L., Stern, D. T., et al. (2005). Disciplinary action by medical boards and prior behaviour in medical school. New England Journal of Medicine, 353, 2673–2682.

    Article  Google Scholar 

  • Pickering, G. (1979). Against multiple choice questions. Medical Teacher, 1(2), 84–86.

    Article  Google Scholar 

  • Rogers, J. C., & Coutts, L. (2000). Do students’ attitudes during preclinical years predict their humanism as clerkship students? Academic Medicine, 75(10 Suppl), S74–S77.

    Article  Google Scholar 

  • Rotthoff, T., Baehring, T., Dicken, H., Fahron, U., Richter, B., Fischer, M. R., et al. (2006). Comparison between long-menu and open-ended questions in computerized medical assessments: A randomized controlled trial. BMC Medical Education 2006, 6. http://www.biomedcentral.com/1472-6920/6/50

  • Rushton, P., & Eggett, D. (2003). Comparison of written and oral examination in the baccalaureate medical-surgical nursing course. Journal of Professional Nursing, 19(3), 142–148.

    Article  Google Scholar 

  • Satterwhite, W. M., Satterwhite, R. C., & Enarcon, C. (1998). Medical students’ perceptions of unethical conduct at one medical school. Academic Medicine, 73(5), 529–531.

    Article  Google Scholar 

  • Schnabl, G. K., Hassard, T. H., & Kopelow, M. L. (1991). The assessment of interpersonal skills using standardized patients. Academic Medicine, 66 (suppl. 9), S34–S36.

    Article  Google Scholar 

  • Schubert, A., Tetzlaff, J. E., Tan, M., Ryckman, V., & Mascha, E. (1999). Consistency, inter-rater reliability, and validity of 441 consecutive mock oral examinations in anesthesiology. Anesthesiology, 91, 288–298.

    Article  Google Scholar 

  • Schuwirth, L. W. T., & van der Vleuten, C. P. M. (2004). Different written assessment methods: What can be said about their strengths and weaknesses? Medical Education, 38, 974–979.

    Article  Google Scholar 

  • Schuwirth, L. W., van der Vleuten, C. P., & Donkers, H. H. (1996). A closer look at cueing effects in multiple-choice questions. Medical Education, 30(1), 44–49.

    Article  Google Scholar 

  • Scouller, K. (1998). The influence of assessment method on students’ learning approaches: Multiple choice question examination versus assignment essay. Higher Education, 35, 453–472.

    Article  Google Scholar 

  • Shrank, W., Reed, V., & Jernstedt, C. (2004). Fostering professionalism in medical education. Journal of General Internal Medicine, 19, 887–892.

    Article  Google Scholar 

  • Stiggins, R. J. (1999). Evaluating classroom assessment training in teacher education programs: Educational measurement. Issues & Practice, 18(1), 23–27.

    Article  Google Scholar 

  • Stiggins, R. (2005). Assessment for learning: Building a culture of confident learners. In R. DuFour, R. Eaker, & R. DuFour (Eds.), On Common Ground: The power of professional learning communities. Bloomington, IN: Solution Tree (formely National Educational Service).

    Google Scholar 

  • Swick, H. M., Szenas, P., Danoff, D., & Whitcomb, M. E. (1999). Teaching professionalism in undergraduate medical education. Journal of the American Medical Association, 282, 830–832.

    Article  Google Scholar 

  • Tarrant, M., Knierim, A., Hayes, S. K., & Ware, J. (2006). The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments. Nurse Education Today, 26, 662–671.

    Article  Google Scholar 

  • Tyrone, H. C. (2003). Culturally relevant pedagogy: Ingredients for critical teacher reflection. Theory Into Practice, 42(3), 195–201.

    Article  Google Scholar 

  • Union Theological Seminary in the City of New York. (2009). Assessment goal statement. Accessed in September, http://www.utsnyc.edu

  • United States Medical Licensing Examination. (2003). Americans overwhelmingly support new medical license test; field trials show fairness, reliability of test. Accessed May 22, http://www.usmle.org/news/cse/newsrelease2503.htm

  • United States Medical Licensing Examination. (2009). Accessed September. http://www.usmle.org/Examinations/step2/step2.html.

  • Van Manen, M. (1977). Linking was of knowing which ways of being practical. Curriculum Inquiry, 6, 205–228.

    Article  Google Scholar 

  • Van der Vleuten, C. P. M., Scherpbier, A. J. J. A., Dolmans, D. H. J. M., Schuwirth, L. W. T., Verwijnen, G. M., & Wolfhagen, H. A. P. (2000). Clerkship assessment assessed. Medical Teacher, 22(6), 592–600.

    Article  Google Scholar 

  • Veloski, J. J., Fields, S. K., Boex, J. R., & Blank, L. L. (2005). Measuring professionalism: A review of studies with instruments reported in the literature between 1982 and 2002. Academic Medicine, 80, 366–370.

    Article  Google Scholar 

  • Veloski, J. J., Rabinowitz, H. K., & Robeson, M. R. (1993). A solution to the cueing effects of multiple choice questions: The un-q format. Medical Education, 27(4), 371–375.

    Article  Google Scholar 

  • Veloski, J. J., Rabinowitz, H. K., Robeson, M. R., & Young, P. R. (1999). Patients don’t present with five choices: An alternative to multiple-choice tests in assessing physicians’ competence. Academic Medicine, 74(5), 539–546.

    Article  Google Scholar 

  • Wade, R. C., & Yarbrough, D. B. (1996). Portfolios: A tool for reflective thinking in teacher education? Teaching and Teacher Education, 12, 63–79.

    Article  Google Scholar 

  • Walvood, B., & Anderson, V. J. (1998). Effective grading: A tool for learning and assessment. Jossey- Bass: San Francisco.

    Google Scholar 

  • Wass, V., & van der Vleuten, C. (2004). The Long Case. Medical Education, 38, 1176–1180.

    Article  Google Scholar 

  • Webster’s Online Dictionary. (2009). Accessed September. 4, http://www.websters-online-dictionary.org

  • Weingarten, M. A., Polliack, M. R., Tabenkin, H., & Kahan, E. (2000). Variations among examiners in family medicine residency board oral examinations. Medical Education, 34, 13–17.

    Article  Google Scholar 

  • Weis, D., & Schank, M. J. (2000). An instrument to measure professional nursing values. Journal of Nursing Scholarship, 32(2), p201–p212.

    Article  Google Scholar 

  • Wiggins, G. P., & McTighe, J. (2005). Understanding by design (2nd ed). Alexandria, VA: Advisory Committee for Students with Disabilities.

    Google Scholar 

  • Zeichner, K. (1999). The new scholarship in teacher education. Educational Research, 28(9), 4–15.

    Google Scholar 

  • Zeichner, K., & Wray, S. (2001). The teaching portfolio in US teacher education programs: What we know and what we need to know. Teaching and Teacher Education, 17, 613–621.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Mercer University School of Medicine, Macon, GA, USA

    Maurice Clifton

  2. State University of New York, Stony Brook University Medical Center, Stony Brook, NY, USA

    Elza Mylona

Authors
  1. Maurice Clifton
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Elza Mylona
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maurice Clifton .

Editor information

Editors and Affiliations

  1. Yale School of Medicine, New Haven, 06510, Connecticut, USA

    Janet P. Hafler

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media B.V.

About this chapter

Cite this chapter

Clifton, M., Mylona, E. (2011). Assessment: Practical Strategies Applied to the Professions. In: Hafler, J. (eds) Extraordinary Learning in the Workplace. Innovation and Change in Professional Education, vol 6. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-0271-4_6

Download citation

Publish with us

Policies and ethics

Search

Navigation