doi:

DOI: 10.3724/SP.J.1042.2017.01623

Advances in Psychological Science (心理科学进展) 2017/25:9 PP.1623-1631

Applying psychometric models in learning progressions studies:Theory, method and breakthrough


Abstract:
Learning progressions are descriptions of students' increasingly sophisticated ways of thinking about or understanding a topic during a period. It's an iterative process to build learning progressions, beginning with hypothetical learning progressions and then validated by empirical approaches. Psychometric models, such as item response models, multidimensional item response models and cognitive diagnosis models, combine learning progressions with the function of assessing students. These models provide evidence for validating learning progressions and also make diagnosis about students. In addition, learning progressions have provided new perspectives for vertical scaling and adaptive learning. But we should be aware of some questions, such as differential item functioning.

Key words:learning progressions,item response models,cognitive diagnosis models,vertical scaling,adaptive learning,differential item functioning

ReleaseDate:2017-10-20 02:12:55



郭玉英, 姚建欣, 彭征. (2013). 美国《新一代科学教育标准》述评. 课程·教材·教法, 33(8), 118-127.

王烨晖, 边玉芳, 辛涛. (2011). 垂直等值的应用及最新发展述评. 心理学探新, 31, 472-476.

韦斯林, 柳秀峰, 王祖浩. (2014). 基于Rasch理论的计算机模型教学测验的设计与应用. 中国电化教育, (7), 139-144.

姚建欣, 郭玉英. (2014). 为学生认知发展建模:学习进阶十年研究回顾及展望. 教育学报, 10(5), 35-42.

喻晓锋, 丁树良, 秦春影, 陆云娜. (2011). 贝叶斯网在认知诊断属性层级结构确定中的应用. 心理学报, 43, 338-346.

Alonzo, A. C., & Steedle, J. T. (2009). Developing and assessing a force and motion learning progression. Science Education, 93, 389-421.

Anderson, C. W. (2008, February). Conceptual and empirical validation of learning progressions:Response to "learning progressions:Supporting instruction and formative assessment." Retrieved from http://www.cpre.org/ccii/images/stories/ccii_pdfs/learning%20progressions%20anderson.pdf

Berland, L. K., & McNeill, K. L. (2010). A learning progression for scientific argumentation:Understanding student work and designing supportive instructional contexts. Science Education, 94, 765-793.

Briggs, D. C., & Alonzo, A. C. (2012). The psychometric modeling of ordered multiple-choice item responses for diagnostic assessment with a learning progression. In A. Alonzo & A. W. Gotwals (Eds.), Learning progressions in science:Current challenges and future directions (pp. 293-316). Rotterdam:Sense Publishers.

Briggs, D. C., Alonzo, A. C., Schwab, C., & Wilson, M. (2006). Diagnostic assessment with ordered multiple-choice items. Educational Assessment, 11, 33-63.

Briggs, D. C., & Peck, F. A. (2015). Using learning progressions to design vertical scales that support coherent inferences about student growth. Measurement:Interdisciplinary Research and Perspectives, 13, 75-99.

Chen, F., Yan, Y., & Xin, T. (2017). Developing a learning progression for number sense based on the rule space model in China. Educational Psychology, 37, 128-144.

Chen, F., Zhang, S. S., Guo, Y. F., & Xin, T. (2016). Applying the rule space model to develop a learning progression for thermochemistry. Research in Science Education, doi:10.1007/s11165-016-9553-7.

Duncan, R. G., & Hmelo-Silver, C. E. (2009). Learning progressions:Aligning curriculum, instruction, and assessment. Journal of Research in Science Teaching, 46, 606-609.

Duncan, R. G., Rogat, A. D., & Yarden, A. (2009). A learning progression for deepening students' understandings of modern genetics across the 5th-10th grades. Journal of Research in Science Teaching, 46, 655-674.

Duschl, R., Maeng, S., & Sezen, A. (2011). Learning progressions and teaching sequences:A review and analysis. Studies in Science Education, 47, 123-182.

Foster, J., & Wiser, M. (2012). The potential of learning progression research to inform the design of state science standards. In A. Alonzo & A. W. Gotwals (Eds.), Learning progressions in science:Current challenges and future directions (pp. 435-460). Rotterdam:Sense Publishers.

Gotwals, A. W., & Alonzo, A. C. (2012). Introduction:Leaping into learning progressions in science. In A. C. Alonzo & A. W. Gotwals (Eds.), Learning Progressions in science:Current challenges and future directions (pp. 3-12). Rotterdam:Sense Publishers.

Hadenfeldt, J. C., Neumann, K., Bernholt, S., Liu, X. F., & Parchmann, I. (2016). Students' progression in understanding the matter concept. Journal of Research in Science Teaching, 53, 683-708.

Harris, D. J. (2007). Practical issues in vertical scaling. In N. J. Dorans, M. Pommerich, & P. W. Holland (Eds.), Linking and aligning scores and scales (pp. 233-251). New York:Springer-Verlag.

Johnson, P., & Tymms, P. (2011). The emergence of a learning progression in middle school chemistry. Journal of Research in Science Teaching, 48, 849-877.

Kelderman, H. (1996). Multidimensional Rasch models for partial-credit scoring. Applied Psychological Measurement, 20, 155-168.

Kobrin, J., Larson, S. J., Cromwell, A., & Garza, P. (2014, April). Establishing parameters for consideration of common core mathematics learning progressions. Annual Meeting of the American Educational Research Association Philadelphia, Pennsylvania.

Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking:Methods and practices (2nd ed.). New York, NY:Springer-Verlag.

Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.

Mohan, L., Chen, J., & Anderson, W. A. (2009). Developing a multi-year learning progression for carbon cycling in socio-ecological systems. Journal of Research in Science Teaching, 46, 675-698.

National Assessment Governing Board. (2007). Science assessment and item specifications for the 2009 national assessment of educational progress. Washington, DC:National Assessment Governing Board.

National Governors Association Center for Best Practices & Council of Chief State School Officers. (2010). Common core state standards. Washington, DC:National Governors Association Center for Best Practices & Council of Chief State School Officers.

National Research Council. (2007). Learning progressions. In R. A. Duschl, H. A. Schweingruber, & A. W. Shouse (Eds.), Taking science to school:Learning and teaching science in grades K-8 (Vol. 49, pp. 163-166). Washington, DC:The National Academics Press.

Neumann, K., Viering, T., Boone, W. J., & Fischer, H. E. (2013). Towards a learning progression of energy. Journal of Research in Science Teaching, 50, 162-188.

NGSS Lead States. (2013). Next generation science standards:For states, by states. Washington, DC:The National Academies Press.

Patz, R. J., & Yao, L. H. (2007). Methods and models for vertical scaling. In:N. J. Dorans, M. Pommerich, & P. W. Holland (Eds). Linking and aligning scores and scales (pp. 253-272). New York:Springer-Verlag.

Plummer, J. D., & Krajcik, J. S. (2010). Building a learning progression for celestial motion:Elementary levels from an earth-based perspective. Journal of Research in Science Teaching, 47, 768-787.

Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Chicago:University of Chicago Press.

Reckase, M. D., & Martineau, J. A. (2004, October). The vertical scaling of science achievement tests. Paper commissioned by the Committee on Test Design for K-12 Science Achievement, Washington, DC.

Retalis, R., & Papasalouros, A. (2005). Designing and generating educational adaptive hypermedia applications. Educational Technology & Society, 8, 26-35.

Rupp, A. A., Templin, J., & Henson, R. A. (2010). Diagnostic measurement:Theory, methods, and applications. New York, NY:Guilford Press.

Salinas, I. (2009, June). Learning progressions in science education:Two approaches for development. Paper presented at the Learning Progressions in Science (LeaPS) Conference, Iowa City, IA.

Schwarz, C. V., Reiser, B. J., Davis, E. A., Kenyon, L., Achér, A., Fortus, D., … Krajcik, J. (2009). Developing a learning progression for scientific modeling:Making scientific modeling accessible and meaningful for learners. Journal of Research in Science Teaching, 46, 632-654.

Sikorski, T. R., & Hammer, D. (2010, June). A critique of how learning progressions research conceptualizes sophistication and progress. Paper presented at the 9th International Conference of the Learning Sciences, Chicago, IL.

Smith, C. L., Wiser, M., Anderson, C. W., & Krajcik, J. (2006). Implications of research on children's learning for assessment:Matter and atomic molecular theory. Washington, DC:National Academy of Sciences.

Smith, C. L., Wiser, M., Anderson, C. W., & Krajcik, J. (2006). Implications of research on children's learning for assessment:Matter and atomic molecular theory. Measurement:Interdisciplinary Research and Perspectives, 4, 1-98.

Songer, N. B., Kelcey, B., & Gotwals, A. W. (2009). How and when does complex reasoning occur? Empirically driven development of a learning progression focused on complex reasoning about biodiversity. Journal of Research in Science Teaching, 46, 610-631.

Stevens, S. Y., Shin, N. & Krajcik, J. S. (2009). Towards a model for the development of an empirically tested learning progression. Paper presented at the Learning Progressions in Science (LeaPS) Conference, Iowa City, IA.

Talanquer, V. (2009). On cognitive constraints and learning progressions:The case of "structure of matter". International Journal of Science Education, 31, 2123-2136.

Tatsuoka, K. K. (1983). Rule space:An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345-354.

Tseng, J. C. R., Chu, H. C., Hwang, G. J., & Tsai, C. C. (2008). Development of an adaptive learning system with two sources of personalization information. Computers & Education, 51, 776-786.

West, P., Rutstein, D. W., Mislevy, R. J., Liu, J. H., Levy, R., Dicerbo, K. E., … Behrens, J. T. (2010). A Bayesian network approach to modeling learning progressions and task performance. CRESST Report. Los Angeles:The National Center for Research on Evaluation, Standards, and Student Testing (CRESST), Center for Studies in Education, UCLA.

Wilson, M. (2009). Measuring progressions:Assessment structures underlying a learning progression. Journal of Research in Science Teaching, 46, 716-730.