Skip to main content

Advertisement

SpringerLink
Log in

Development and Evaluation of a Three-Tier Diagnostic Test to Assess Undergraduate Primary Teachers’ Understanding of Ecological Footprint

  • Published:
Research in Science Education Aims and scope Submit manuscript

Abstract

This study focused on the development and validation of a three-tier multiple-choice diagnostic instrument about the ecological footprint. Each question in the three-tier test comprised by; (a) the content tier, assessing content knowledge; (b) the reason tier, assessing explanatory knowledge; and (c) the confidence tier that differentiates lack of knowledge from misconception through the use of a certainty response index. Based on the literature, the propositional knowledge statements and the identified misconceptions of 97 student-teachers, a first version of the test was developed and subsequently administered to another group of 219 student-teachers from Primary and Early Childhood Education Departments. Due to the complexity of the ecological footprint concept, and that it is a newly introduced concept, unknown to the public, both groups have been previously exposed to relevant instruction. Experts in the field established face and content validity. The reliability, in terms of Cronbach’s alpha, was found adequate (α = 0.839), and the test-retest reliability, as indicated by Pearson r, was also satisfactory (0.554). The mean performance of the students was 56.24% in total score, 59.75% in content tiers and 48.05% in reason tiers. A variety of concepts about the ecological footprint were also observed. The test can help educators to understand the alternative views that students hold about the ecological footprint concept and assist them in developing the concept through appropriately designed teaching methods and materials.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Arslan, H. O., Cigdemoglu, C., & Moseley, C. (2012). A three-tier diagnostic test to assess pre-service teachers’ misconceptions about global warming, greenhouse effect, ozone layer depletion, and acid rain. International Journal of Science Education, 34(11), 1667–1686.

    Google Scholar 

  • Barrett, J., Birch, R., Cherrett, N., & Simmons, C. (2004). An analysis of the policy and educational applications of the ecological footprint. York: Stockholm Environment Institute.

    Google Scholar 

  • Borucke, M., Moore, D., Cranston, G., Gracey, K., Iha, K., Larson, J., et al. (2013). Accounting for demand and supply of the biosphere’s regenerative capacity: the National Footprint Accounts’ underlying methodology and framework. Ecological Indicators, 24, 518–533.

    Google Scholar 

  • Brody, S. D., & Ryu, H. (2006). Measuring the educational impacts of a graduate course on sustainable development. Environmental Education Research, 12(2), 179–199.

    Google Scholar 

  • Caleon, I., & Subramaniam, R. (2010a). Development and application of a three tier diagnostic test to assess secondary students’ understanding of waves. International Journal of Science Education, 32(7), 939–961.

    Google Scholar 

  • Caleon, I., & Subramaniam, R. (2010b). Do students know what they know and what they don’t know? Using a four-tier diagnostic test to assess the nature of students’ alternative conceptions. Research in Science Education, 40, 313–337.

    Google Scholar 

  • Calik, M., & Ayas, A. (2005). A comparison of the level of understanding of eighth-grade students and science student teachers related to selected chemistry concepts. Journal of Research in Science Teaching, 42(6), 638–667.

    Google Scholar 

  • Cetin-Dindar, A., & Geban, O. (2011). Development of a three-tier test to assess high school students’ understanding of acids and bases. Procedia Social and Behavioral Sciences, 15, 600–604.

    Google Scholar 

  • Chandrasegaran, A. L., Treagust, D., & Mocerino, M. (2007). The development of a two-tier multiple-choice diagnostic instrument for evaluating secondary school students’ ability to describe and explain chemical reactions using multiple levels of representation. Chemistry Education Research and Practice, 8(3), 293–307.

    Google Scholar 

  • Cheong, I. P.-A., Johari, M., Said, H., & Treagust, D. F. (2015). What do you know about alternative energy? Development and use of a diagnostic instrument for upper secondary school science. International Journal of Science Education, 37(2), 210–236.

    Google Scholar 

  • Chu, H., Treagust, D. F., & Chandrasegaran, A. L. (2009). A stratified study of students’ understanding of basic optics concepts in different contexts using two-tier multiple-choice items. Research in Science and Technological Education, 27(3), 253–265.

    Google Scholar 

  • Cordero, E. C., Marie Todd, A., & Abellera, D. (2008). Climate change education and the ecological footprint. Bulletin of the American Meteorological Society, 89(6), 865–872. doi:10.1175/2007BAMS2432.1.

    Article  Google Scholar 

  • Costu, B., Ayas, A., Niaz, M., Unal, S., & Calik, M. (2007). Facilitating conceptual change in students’ understanding of boiling concept. Journal of Science Education and Technology, 16, 524–536.

    Google Scholar 

  • Crompton, S., Roy, R., & Caird, S. (2002). Household ecological footprinting for active distance learning and challenge of personal lifestyles. International Journal of Sustainability in Higher Education, 3(4), 313–323.

    Google Scholar 

  • Čuček, L., Klemeš, J. J., & Kravanja, Z. (2012). A review of footprint analysis tools for monitoring impacts on sustainability. Journal of Cleaner Production, 34, 9–20. doi:10.1016/j.jclepro.2012.02.036.

    Article  Google Scholar 

  • Dawe, F. M. G., Vetter, A., & Martin, S. (2004). An overview of ecological footprinting and other tools and their application to the development of sustainability process: audit and methodology at Holme Lacy College, UK. International Journal of Sustainability in Higher Education., 5(4), 340–371.

    Google Scholar 

  • Dove, J. (1996). Student teacher understanding of the greenhouse effect, ozone layer depletion, and acid rain. Environmental Education Research, 2(1), 89–100.

    Google Scholar 

  • Driver, R., Guesne, E., & Tiberghien, A. (1985). Some features of children’s ideas and their implications for teaching. In R. Driver, E. Guesne, & A. Tiberghien (Eds.), Children’s ideas in science (pp. 193–201). Milton Keynes: Open University Press.

    Google Scholar 

  • Engelhardt, P. V., & Beichner, R. J. (2004). Students’ understanding of direct current resistive electrical circuits. American Journal of Physics, 72, 98–115.

    Google Scholar 

  • Ewing, B., Moore, D., Goldfinger, S., Oursler, A., Reed, A., & Wackernagel, M. (2010). The ecological footprint atlas 2010. Oakland: Global Footprint Network.

    Google Scholar 

  • Footprint Network (n.d.a). Glossary. Retrieved from http://www.footprintnetwork.org/resources/glossary/.

  • Footprint Network (n.d.b). Overview. Retrieved from http://www.footprintnetwork.org/en/index.php/GFN/page/footprint_basics_overview/.

  • Footprint Network (n.d.c). Deficit/reserve. Retrieved from http://www.footprintnetwork.org/en/index.php/GFN/page/glossary/.

  • Gottlieb, D., Vigoda-Gadot, E., Haim, A., & Kissinger, M. (2012). The ecological footprint as an educational tool for sustainability: a case study analysis in an Israeli public high school. International Journal of Educational Development, 32(1), 193–200.

    Google Scholar 

  • Gottlieb, D., Vigoda-Gadot, E., & Haim, A. (2013). Encouraging ecological behaviors among students by using the ecological footprint as an educational tool: a quasi-experimental design in a public high school in the city of Haifa. Environmental Education Research, 1–20.

  • Griffard, P. B., & Wandersee, J. H. (2001). The two-tier instrument on photosynthesis: What does it diagnose? International Journal of Science Education, 23(10), 1039–1052.

    Google Scholar 

  • Groves, F. H., & Pugh, A. F. (1999). Elementary pre-service teacher perceptions of the greenhouse effect. Journal of Science Education and Technology, 8(1), 75–81.

    Google Scholar 

  • Hasan, S., Bagayoko, D., & Kelley, E. L. (1999). Misconceptions and the certainty of response index (CRI). Physics Education, 34(5), 294–299.

    Google Scholar 

  • Hashweh, M. Z. (1987). Effects of subject matter knowledge in the teaching of biology and physics. Teaching and Teacher Education, 3, 109–120.

    Google Scholar 

  • Hoekstra, A.Y. (2008). Water neutral: reducing and offsetting the impacts of water footprints. UNESCO-IHO, Institute for Water Education. Retrieved from http://waterfootprint.org/media/downloads/Report28-WaterNeutral.pdf.

  • Institute of Educational Policy—IEP (2011). Curriculum for ‘Environment and Education for Sustainable Development’ (in Greek). Retrieved from http://ebooks.edu.gr/info/newps/Περιβάλλον και Εκπαίδευση για την Αειφόρο Ανάπτυξη/Περιβάλλον και Εκπαίδευση για την Αειφόρο Ανάπτυξη - Δημοτικό.pdf.

  • Janis, A.J. (2007). Quantifying the ecological footprint of the Ohio State University, Ph.D. Thesis, The Ohio State University, Columbus.

  • Johansson, B., Marton, F., & Stevenson, L. (1985). An approach to describing learning as change between qualitatively different conceptions. In L. H. T. West & A. Pines (Eds.), Cognitive structure and conceptual change (pp. 233–255). Orlando: Academic Press.

    Google Scholar 

  • Keles, O., & Aydogdu, M. (2010a). Application and evaluation of ecological footprint as an environmental education tool. International Online Journal of Educational Sciences, 2(1), 65–80.

    Google Scholar 

  • Keles, O., & Aydogdu, M. (2010b). Pre-service science teachers’ views of the ecological footprint: the starting-points of sustainable living. Asia-Pacific Forum on Science Learning and Teaching, 11(2). Retrieved from https://www.ied.edu.hk/apfslt/v11_issue2/keles/.

  • Kılıç, D., & Sağlam, N. (2009). Development of a two-tier diagnostic test concerning genetics concepts: the study of validity and reliability. Procedia - Social and Behavioral Sciences, 1(1), 2685–2686. doi:10.1016/j.sbspro.2009.01.474.

    Article  Google Scholar 

  • Kitzes, J., & Wackernagel, M. (2009). Answers to common questions in ecological footprint accounting. Ecological Indicators, 9(4), 812–817.

    Google Scholar 

  • Kitzes, J., Peller, A., Goldfinger, S., & Wackernagel, M. (2007). Current methods for calculating National Ecological Footprint Accounts. Science for Environment and Sustainable Society, 4(1), 1–9.

    Google Scholar 

  • Kutluay, Y. (2005). Diagnosis of eleventh grade student’s misconceptions about geometric optic by a three-tier test. Master Thesis, Middle East Technical University, Graduate School of Natural and Applied Sciences.

  • Lien, A. L. (1971). Measurement and evaluation of learning. Dubuque: William C. Brown.

    Google Scholar 

  • Lin, S. W. (2004). Development an application of a two-tier diagnostic test for high school student’s understanding of flowering plant growth and development. International Journal of Science and Mathematics Education, 2, 175–199.

    Google Scholar 

  • Loh, A. S. L., Subramaniam, R., & Tan, K. C. D. (2014). Exploring students’ understanding of electrochemical cells using an enhanced two-tier diagnostic instrument. Research in Science and Technological Education, 32(3), 229–250.

    Google Scholar 

  • Lundeberg, M. A., Fox, P. W., Brown, A. C., & Elbedour, S. (2000). Cultural influences on confidence: country and gender. Journal of Educational Psychology, 92(1), 152–159.

    Google Scholar 

  • Malandrakis, G., Papadopoulou, P., Bellos, S., & Panoutsopoulos, A. (2014). Mental models regarding the understanding of the energy footprint concept by students of Florina’s Department of Primary Education. In E. Mavrikaki, P. Stasinakis, & H. Zahopoulos (Eds.), Proccedings of the 2nd Pan-Hellenic Conference ‘Biology in Education’ (pp. 53–62). Athens: Pan-Hellenic Society of Bioscientists. (In Greek).

  • McNichol, H., Davis, J. M., & O’Brien, K. R. (2011). An ecological footprint for an early learning centre: identifying opportunities for early childhood sustainability education through interdisciplinary research. Environmental Education Research, 17(5), 689–704.

    Google Scholar 

  • Minstrell, J., & Smith, C. (1983). Alternative conceptions and a strategy for change. Science and Children, 21(3), 31–33.

    Google Scholar 

  • Mitra, N. K., Nagaraja, H. S., Ponnudurai, G., & Judson, J. P. (2009). The levels of difficulty and discrimination indices in type a multiple choice questions of pre-clinical semester 1 multidisciplinary summative tests. International e-Journal of Science, Medicine and Education, 3(1), 2–7.

    Google Scholar 

  • Novak, J. D., & Gowin, D. B. (1984). Learning how to learn. Cambridge: Cambridge University Press.

    Google Scholar 

  • O’Gorman, L., & Davis, J. (2013). Ecological footprinting: its potential as a tool for change in preservice teacher education. Environmental Education Research, 19(6), 779–791.

    Google Scholar 

  • Osborne, R. J., & Gilbert, J. K. (1980). A technique for exploring students’ views of the world. Physics Education, 15, 376–379.

    Google Scholar 

  • Peşman, H., & Eryılmaz, A. (2010). Development of a three-tier test to assess misconceptions about simple electric circuits. The Journal of Educational Research, 103(3), 208–222.

    Google Scholar 

  • Ponthiere, G. (2009). The ecological footprint: an exhibit at an intergenerational trial? Environment, Development and Sustainability, 11(4), 677–694.

    Google Scholar 

  • Redish, E. F., Saul, J. M., & Steinberg, R. N. (1998). Student expectations in introductory physics. American Journal of Physics, 66, 212–224.

    Google Scholar 

  • Ryu, H. C., & Brody, S. D. (2006). Examining the impacts of a graduate course on sustainable development using ecological footprint analysis. International Journal of Sustainability in Higher Education, 7(2), 158–175.

    Google Scholar 

  • Scotti, M., Bondavalli, C., & Bodini, A. (2009). Ecological footprint as a tool for local sustainability: the municipality of Piacenza (Italy) as a case study. Environmental Impact Assessment Review, 29(1), 39–50.

    Google Scholar 

  • Sesli, E., & Kara, Y. (2012). Development and application of a two-tier multiple-choice diagnostic test for high school students’ understanding of cell division and reproduction. Journal of Biological Education, 46(4), 214–225.

    Google Scholar 

  • Sia, D. T., Treagust, D. F., & Chandrasegaran, A. L. (2012). High school students’ proficiency and confidence levels in displaying their understanding of basic electrolysis concepts. International Journal of Science and Mathematics Education, 10(6), 1325–1345.

    Google Scholar 

  • Simmons, C., Lewis, K., & Barrett, J. (2000). Two feet–two approaches: a component based model of ecological footprinting. Ecological Economics, 32, 375–380.

    Google Scholar 

  • Sreenivasulu, B., & Subramaniam, R. (2013). University students’ understanding of chemical thermodynamics. International Journal of Science Education, 35(4), 601–635.

    Google Scholar 

  • Stankov, L., & Crawford, J. D. (1997). Self-confidence and performance on tests of cognitive abilities. Intelligence, 25(2), 93–109.

    Google Scholar 

  • Sustainable Measures (2015). Ecological footprint. Retrieved from http://www.sustainablemeasures.com/node/102.

  • Tan, K. C. D., Goh, N. K., Chia, L. S., & Treagust, D. F. (2002). Development and application of a two-tier multiple choice diagnostic instrument to assess high school students’ understanding of inorganic chemistry qualitative analysis. Journal of Research in Science Teaching, 39(4), 283–301.

    Google Scholar 

  • Treagust, D. F. (1986). Evaluating students’ misconceptions by means of diagnostic multiple-choice items. Research in Science Education, 16, 199–207.

    Google Scholar 

  • Treagust, D. F. (1988). Development and use of diagnostic tests to evaluate students’ misconceptions in science. International Journal of Science Education, 10(2), 159–169.

    Google Scholar 

  • Treagust, D. F., & Mann, M. (1998). A pencil and paper instrument to diagnose students’ conceptions of breathing, gas exchange and respiration. Australian Science Teachers Journal, 44(2), 55–59.

    Google Scholar 

  • Tsai, C., & Chou, C. (2002). Diagnosing students’ alternative conceptions in science. Journal of Computer Assisted Learning, 18, 157–165.

    Google Scholar 

  • UNEP/SETAC, 2009. Life cycle management: how business uses it to decrease footprint, create opportunities and make value chains more sustainable. Retrieved from http://wedocs.unep.org/bitstream/handle/20.500.11822/7921/-Life%20Cycle%20Management%20-%20How%20business%20uses%20it%20to%20decrease%20footprint%2c%20create%20opportunities%20and%20make%20value%20chains%20more%20sustainable-20094125.pdf?sequence=3&isAllowed=y.

  • UNESCO (2009). UNESCO World Conference on Education for Sustainable Development, Proceedings, 31 March – 2 April, Bonn, Germany. Retrieved from http://unesdoc.unesco.org/images/0018/001850/185056e.pdf.

  • United Nations (n.d.). The Sustainable Development Agenda. Retrieved from http://www.un.org/sustainabledevelopment/development-agenda.

  • Van den Bergh, J. C. J., & Grazi, F. (2014). Ecological footprint policy? Land use as an environmental indicator: footprint policy? Journal of Industrial Ecology, 18(1), 10–19.

    Google Scholar 

  • Vosniadou, S. (2012). Reframing the classical approach to conceptual change: preconceptions, misconceptions and synthetic models. In Second international handbook of science education (pp. 119–130). Springer. Netherlands.

  • Vosniadou, S., & Brewer, W. (1992). Mental models of the earth: a study of conceptual change in childhood. Cognitive Psychology, 24, 535–585.

    Google Scholar 

  • Wackernagel, M. (1994). Ecological footprint and appropriated carrying capacity: a tool for planning toward sustainability. Ph.D. Thesis, The University of British Columbia.

  • Yen, C.-F., Yao, T.-W., & Chiu, Y.-C. (2004). Alternative conceptions in animal classification focusing on amphibians and reptiles: a cross-age study. International Journal of Science and Mathematics Education, 2(2), 159–174. doi:10.1007/s10763-004-1951-z.

    Article  Google Scholar 

  • Yen, C., Yao, T., & Mintzes, J. J. (2007). Taiwanese students’ alternative conceptions of animal biodiversity. International Journal of Science Education, 29(4), 535–553. doi:10.1080/09500690601073418.

    Article  Google Scholar 

  • Zoupidis, A., Pnevmatikos, D., Spyrtou, A., & Kariotoglou, P. (2016). The impact of procedural and epistemological knowledge on conceptual understanding: the case of density and floating–sinking phenomena. Instructional Science, 44(4), 315–334. doi:10.1007/s11251-016-9375-z.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Primary Education, University of Western Macedonia, 3rd Km of Florina-Niki National Road, 53100, Florina, Greece

    Vasiliki Liampa, George N. Malandrakis & Dimitrios Pnevmatikos

  2. Department of Early Childhood Education, University of Western Macedonia, 3rd Km of Florina-Niki National Road, 53100, Florina, Greece

    Penelope Papadopoulou

Authors
  1. Vasiliki Liampa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. George N. Malandrakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Penelope Papadopoulou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dimitrios Pnevmatikos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to George N. Malandrakis.

Appendix

Appendix

figure afigure afigure afigure a

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liampa, V., Malandrakis, G.N., Papadopoulou, P. et al. Development and Evaluation of a Three-Tier Diagnostic Test to Assess Undergraduate Primary Teachers’ Understanding of Ecological Footprint. Res Sci Educ 49, 711–736 (2019). https://doi.org/10.1007/s11165-017-9643-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11165-017-9643-1

Keywords

Search

Navigation