Abstract
We examined how self-regulated learning (SRL) and externally-facilitated self-regulated learning (ERL) differentially affected adolescents’ learning about the circulatory system while using hypermedia. A total of 128 middle-school and high school students with little prior knowledge of the topic were randomly assigned to either the SRL or ERL condition. Learners in the SRL condition regulated their own learning, while learners in the ERL condition had access to a human tutor who facilitated their self-regulated learning. We converged product (pretest-posttest shifts in students’ mental models and declarative knowledge measures) with process (think-aloud protocols) data to examine the effectiveness of self- versus externally-facilitated regulated learning. Findings revealed that learners in the ERL condition gained statistically significantly more declarative knowledge and that a greater number of participants in this condition displayed a more advanced mental model on the posttest. Verbal protocol data indicated that learners in the ERL condition regulated their learning by activating prior knowledge, engaging in several monitoring activities, deploying several effective strategies, and engaging in adaptive help-seeking. By contrast, learners in the SRL condition used ineffective strategies and engaged in fewer monitoring activities. Based on these findings, we present design principles for adaptive hypermedia learning environments, engineered to foster students’ self-regulated learning about complex and challenging science topics.
Similar content being viewed by others
Notes
We conducted a series of chi-square tests to examine how learners’ use of self-regulatory variables differed across conditions. We first converted the raw counts to percentages for each person’s use of each strategy. We then conducted a median split across all conditions for the proportion of use for each variable. We were then able to identify, for each variable, which participants used that variable at a proportion above or below the median. For example, participant 1029 used feeling of knowing (FOK) 3 times out of 87 utterances, or 3% of her moves. Across all participants, the median proportion for FOK was 14%, placing participant 1029 below the median proportion for FOK. By contrast, participant 1050 used FOK 20 times out of 95 moves, or 21% of her moves, placing her above the median proportion for FOK. We then conducted a 2 × 2 chi-square analysis for each self-regulatory variable to determine whether the distribution of participants above and below the median across the treatments was significantly different from the null.
References
Azevedo, R. (in press). The role of self-regulation in learning about science with hypermedia. In D. Robinson & G. Schraw (Eds.), Current perspectives on cognition, learning, and instruction.
Azevedo, R. (2002). Beyond intelligent tutoring systems: Computers as MetaCognitive tools to enhance learning? Instructional Science, 30(1), 31–45.
Azevedo, R. (2005). Using hypermedia as a metacognitive tool for enhancing student learning? The role of self-regulated learning. Educational Psychologist, 40(4), 199–209.
Azevedo, R., & Cromley, J. G. (2004). Does training on self-regulated learning facilitate students’ learning with hypermedia? Journal of Educational Psychology, 96(3), 523–535.
Azevedo, R., Cromley, J. G., & Seibert, D. (2004b). Does adaptive scaffolding facilitate students’ ability to regulate their learning with hypermedia? Contemporary Educational Psychology, 29, 344–370.
Azevedo, R., Cromley, J. G., Winters, F. I., Moos, D. C., & Greene, J. A. (2005). Adaptive human scaffolding facilitates adolescents’ self-regulated learning with hypermedia. Instructional Science, 33, 381–412.
Azevedo, R., Guthrie, J. T., & Seibert, D. (2004a). The role of self-regulated learning in fostering students’ conceptual understanding of complex systems with hypermedia. Journal of Educational Computing Research, 30(1), 87–111.
Azevedo, R., & Hadwin, A. F. (2005). Scaffolding self-regulated learning and metacognition: Implications for the design of computer-based scaffolds. Instructional Science, 33, 367–379.
Bendixen, L. D., & Hartley, K. (2003). Successful learning with hypermedia: The role of epistemological beliefs and metacognitive awareness. Journal of Educational Computing Research, 28(1), 15–30.
Brusilovsky, P. (2001). Adaptive hypermedia. User Modeling and User-Adapted Interaction, 11, 87–110.
Brusilovsky, P. (2004). Adaptive navigation support in educational hypermedia: The role of student knowledge level and the case for meta-adaptation. British Journal of Educational Technology, 34(4), 487–497.
Butler, D., & Winne, P. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245–281.
Chi, M. T. H. (1996). Constructing self-explanations and scaffolded explanations in tutoring. Applied Cognitive Pscyhology, 10, S33–S49.
Chi, M. T. H., de Leeuw, N., Chiu, M.-H., & LaVancher, C. (1994). Eliciting self-explanations improves understanding. Cognitive Science, 18, 439–477.
Chi, M. T. H., Siler, S., & Jeong, H. (2004). Can tutors monitor students’ understanding accurately? Cognition and Instruction, 22, 363–387.
Chi, M. T. H., Siler, S., Jeong, H., Yamauchi, T., & Hausmann, R. (2001). Learning from human tutoring. Cognitive Science, 25, 471–534.
Corno, L., & Mandinach, E. (1983). The role of cognitive engagement in classroom learning and motivation. Educational Psychologist, 18(2), 88–109.
Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (2nd ed.). Cambridge, MA: MIT Press.
Graesser, A. C., Bowers, C. A., Hacker, D. J., & Person, N. K. (1997). An anatomy of naturalistic tutoring. In K. Hogan & M. Pressley (Eds.), Effective scaffolding of instruction. Brookline Books.
Graesser, A. C., McNamara, D., & VanLehn, K. (2005). Scaffolding deep comprehension strategies through Point&Query, AutoTutor and iSTART. Educational Psychologist, 40, 225–234.
Graesser, A. C., Person, N. K., & Magliano, J. P. (1995). Collaborative dialogue patterns in naturalistic one-to-one tutoring. Applied Cognitive Pscyhology, 9, 495–522.
Graesser, A., Wiemer-Hastings, K., Wiemer-Hastings, P., Kruez, R., & The Tutoring Research Group. (2000). AutoTutor: A simulation of a human tutor. Journal of Cognitive Systems Research, 1, 35–51.
Greene, J. A., & Azevedo, R. (2005). Adolescents’ use of SRL behaviors and their relation to qualitative mental model shifts while using hypermedia. In C.-K. Looi, G. McCalla, B. Bredeweg, & J. Breuker (Eds.), Artificial intelligence in education: Supporting learning through intelligent and socially informed technology (pp. 233–240). Amsterdam: IOS Press.
Greene, B., & Land, S. (2000). A qualitative analysis of scaffolding use in a resource-based learning environment involving the World Wide Web. Journal of Educational Computing Research, 23(2), 151–179.
Hair, J. F. Jr., Anderson, R. E., Tatham, R. L., & Black, W. C. (1998). Multivariate data analysis (5th ed.). Upper Saddle River, NJ: Prentice Hall.
Hill, J., & Hannafin, M. (1997). Cognitive strategies and learning from the World Wide. Educational Technology Research and Development, 45, 37–64.
Hmelo-Silver, C., & Azevedo, R. (2006). Understanding complex systems: Some core challenges. Journal of the Learning Sciences, 15(1), 53–61.
Hogan, K., & Pressley, M. (1997). Scaffolding student learning: Instructional approaches and issues. Cambridge, MA: Brookline Books.
Jacobson, M. (in press). From non-adaptive to adaptive educational hypermedia: Theory, research, and design issues.
Jacobson, M. J., & Wilensky, U. (2006). Complex systems in education: Scientific and educational importance and implications for the learning sciences. The Journal of the Learning Sciences, 15(1), 11–34.
Lajoie, S. P., & Azevedo, R. (2006). Teaching and learning in technology-rich environments. In P. Alexander & P. Winne (Eds.), Handbook of educational psychology (2nd ed., pp. 803–821). Mahwah, NJ: Erlbaum.
Land, S., & Greene, B. (2000). Project-based learning with the World Wide Web: A qualitative study of resource integration. Educational Technology Research & Development, 48(3), 61–78.
Land, S., & Zembal-Saul, C. (2003). Scaffolding reflection and articulation of scientific explanations in a data-rich, project-based learning environment: An investigation of progress portfolio. Educational Technology Research & Development, 51(4), 65–84.
Lepper, M. R., Drake, M. F., & O’Donnell-Johnson, T. (1997). Scaffolding techniques of expert human tutors. In K. Hogan & M. Pressley (Eds.), Scaffolding student learning: Instructional approaches and issues (pp. 108–144). Cambridge, MA: Brookline.
Lepper, M., & Wolverton, M. (2002). The wisdom of practice: Lessons learned from the study of highly effective tutors. In J. Aranson (Ed.), Improving academic achievement: Impact of psychological factors on education. New York, NY: Academic Press.
McCaslin, M., & Hickey, D.T. (2001). Self-regulated learning and academic achievement: A Vygotskyan View. In B. Zimmerman & D. Schunk (Eds.), Self-regulated learning and academic achievement: Theoretical perspectives (pp. 227–252). Mawah, NJ: Erlbaum.
Merrill, D. C., Reiser, B. J., Merrill, S. K., & Landes, S. (1995). Tutoring: Guided learning by doing. Cognition and Instruction, 13(3), 315–372.
Park, O.-C., & Lee, J. (2004). Adaptive instructional systems. In D. H. Jonassen (Ed.), Handbook of research for education communications and technology (2nd ed., pp. 651–684). Mahwah, NJ: Erlbaum.
Pea, R. D. (2004). The social and technological dimensions of scaffolding and related theoretical concepts for learning, education, and human activity. Journal of the Learning Sciences, 13, 423–451.
Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In M. Boekaerts, P. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 451–502). San Diego, CA: Academic Press.
Pintrich, P., & Zusho, A. (2002). The development of academic self-regulation: The role of cognitive and motivational factors. In A. Wigfield & J. S. Eccles (Eds.), Development of achievement motivation (pp. 249–284). San Diego, CA: Academic Press.
Puntambekar, S., & Hubscher, R. (2005). Tools for scaffolding students in a complex learning environment: What have we gained and what have we missed? Educational Psychologist, 40(1), 1–12.
Shapiro, A. (1999). The relationship between prior knowledge and interactive overviews during hypermedia-aided learning. Journal of Educational Computing Research, 20(2), 143–167.
Shapiro, A. (2000). The effect of interactive overviews on the development of conceptual structure in novices learning from hypermedia. Journal of Educational Multimedia & Hypermedia, 9, 57–78.
Shapiro, A., & Niederhauser, D. (2004). Learning from hypertext: Research issues and findings. In D. H. Jonassen (Ed.), Handbook of research for education communications and technology (2nd ed.). Mahwah, NJ: Erlbaum.
Shute, V., & Psotka, J. (1996). Intelligent tutoring system: Past, present, and future. In D. Jonassen (Ed.), Handbook of research for educational communications and technology (pp. 570–600). NY: Macmillan.
Winne, P. H. (2001). Self-regulated learning viewed from models of information processing. In B. Zimmerman & D. Schunk (Eds.), Self-regulated learning and academic achievement: Theoretical perspectives (pp. 153–189). Mawah, NJ: Erlbaum.
Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. Graesser (Eds.), Metacognition in educational theory and practice (pp. 277–304). Hillsdale, NJ: Erlbaum.
Winne, P. H., Jamieson-Noel, D., & Muis, K. (2002). Methodological issues and advances in researching tactics, strategies, and self-regulated learning. In P. Pintrich & M. Maehr (Eds.), New directions in measures and methods (pp. 121–156). Amsterdam, The Netherlands: JAI.
Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In M. Boekaerts, P. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 531–566). San Diego, CA: Academic Press.
Wood, D., Bruner, J., & Ross, G. (1976). The role of tutoring in problem solving. Journal of Child Psychology & Psychiatry & Allied Disciplines, 17(2), 89–102.
Zimmerman, B. (2000). Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 13–39). San Diego, CA: Academic Press.
Zimmerman, B. (2001). Theories of self-regulated learning and academic achievement: An overview and analysis. In B. Zimmerman & D. Schunk (Eds.), Self-regulated learning and academic achievement: Theoretical perspectives (pp. 1–38). Mawah, NJ: Erlbaum.
Zimmerman, B., & Schunk, D. (2001). Self-regulated learning and academic achievement (2nd ed.). Mawah, NJ: Erlbaum.
Zimmerman, B., & Tsikalas, K. (2005). Can computer-based learning environments (CBLEs) be used as self-regulatory tools to enhance learning? Educational Psychologist, 40(4), 267–271.
Acknowledgment
This research was supported by funding from the National Science Foundation (Early Career Grant ROLE#0133346, ROLE#0731828, and REESE#0633918) awarded to the first author. The authors would like to thank Megan Clark and Jessica Vick for assistance with data collection, and Angie Lucier, Ingrid Ulander, Jonny Meritt, Neil Hofman, Evan Olson, and Pragati Godbole for transcribing the audio data. The authors would like to thank Michael Jacobson, Steven Ross, Amy Witherspoon and Jeremiah Sullins for comments and feedback on earlier versions of this manuscript.
Author information
Authors and Affiliations
Corresponding author
Additional information
An earlier version of this paper was presented at the international conference of Artificial Intelligence in Education (AI-Ed 2005), Amsterdam, The Netherlands (August, 2005).
Appendices
Appendix A
Necessary features for each type of mental model (based on Azevedo and Cromley 2004)
-
Low mental model category
-
a. No understanding
-
b. Basic global concepts
-
blood circulates
-
-
c. Global concepts with purpose
-
blood circulates
-
describes “purpose”—oxygen/nutrient transport
-
-
d. Single loop—basic
-
blood circulates
-
heart as pump
-
vessels (arteries/veins) transport
-
-
e. Single loop with purpose
-
blood circulates
-
heart as pump
-
vessels (arteries/veins) transport
-
describe “purpose”—oxygen/nutrient transport
-
-
f. Single loop—advanced
-
blood circulates
-
heart as pump
-
vessels (arteries/veins) transport
-
describe “purpose”—oxygen/nutrient transport
-
mentions one of the following: electrical system, transport functions of blood, details of blood cells
-
-
-
Intermediate mental model category
-
g. Single loop with lungs
-
blood circulates
-
heart as pump
-
vessels (arteries/veins) transport
-
mentions lungs as a “stop” along the way
-
describe “purpose”—oxygen/nutrient transport
-
-
h. Single loop with lungs—advanced
-
blood circulates
-
heart as pump
-
vessels (arteries/veins) transport
-
mentions lungs as a “stop” along the way describe “purpose”—oxygen/nutrient transport mentions one of the following: electrical system, transport functions of blood, details of blood cells
-
-
-
High mental model category
-
i. Double loop concept
-
blood circulates
-
heart as pump
-
vessels (arteries/veins) transport
-
describes “purpose”—oxygen/nutrient transport
-
mentions separate pulmonary and systemic systems
-
mentions importance of lungs
-
-
j. Double loop—basic
-
blood circulates
-
heart as pump
-
vessels (arteries/veins) transport
-
describe “purpose”—oxygen/nutrient transport
-
describes loop: heart–body-heart-lungs-heart
-
-
k. Double loop—detailed
-
blood circulates
-
heart as pump
-
vessels (arteries/veins) transport
-
describe “purpose”—oxygen/nutrient transport
-
describes loop: heart–body–heart–lungs–heart
-
structural details described: names vessels, describes flow through valves
-
-
l. Double loop—advanced
-
blood circulates
-
heart as pump
-
vessels (arteries/veins) transport
-
describe “purpose”—oxygen/nutrient transport
-
describes loop: heart–body–heart–lungs–heart
-
structural details described: names vessels, describes flow through valves
-
mentions one of the following: electrical system, transport functions of blood, details of blood cell
-
-
Appendix B
Classes, descriptions and examples of the variables used to code students’ regulatory behavior (based on Azevedo and Cromley 2004)
Rights and permissions
About this article
Cite this article
Azevedo, R., Moos, D.C., Greene, J.A. et al. Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia?. Education Tech Research Dev 56, 45–72 (2008). https://doi.org/10.1007/s11423-007-9067-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-007-9067-0