Development of Essay Test Assessment Rubric for Polya Theory-Based Mathematical Problem-Solving

Authors

  • Muhammad Rizki Cahyadi Universitas Muhammadiyah Malang, Indonesia
  • Bhaskoro Prasetyo Adi Maryanto Universitas Muhammadiyah Malang, Indonesia
  • Mohammad Syaifuddin Universitas Muhammadiyah Malang, Indonesia
  • Rani Darmayanti Universitas Muhammadiyah Malang, Indonesia

DOI:

https://doi.org/10.33603/jnpm.v7i1.7724

Abstract

Abstract. Assessment is an important part of the learning process. However, assessment is often carried out subjectively by the examiner, especially in essay tests. The scoring rubric is one of the solutions to minimize the subjectivity of the assessment to produce more objective and consistent grades. Therefore, it is necessary to develop an essay test assessment rubric. This study aims to produce a rubric for evaluating essay tests for mathematical problem-solving abilities based on Polya's theory. The method for developing an assessment rubric uses the Plomp model which consists of three phases, namely the initial research phase, the prototype phase, and the assessment phase. The results of the validity test by experts obtained a score of 3.40 on a scale of 1-4. The rubric of the validation results was then implicated in the assessment of the essay test given to 30 junior high school students. The implication of the rubric is as well as an empirical test of the effectiveness of the rubric. The empirical test results using three groups of raters obtained a correlation coefficient of 0.9290. Based on the results of validity tests and empirical tests, it can be concluded that the rubric for assessing essay tests for mathematical problem-solving abilities based on Polya theory is valid and feasible.

Keywords: Mathematical Problem Solving, Polya, Rubric Assesment, Essay Test.


References

Asmana, A, T. (2018). Development of an Analytic Rubric for Assessing Written Mathematical Communication in Mathematical Problem Solving. Electronic Journal of Mathematics Learning, 5(1), 1-10.

Asrul, A., Ananda, R., & Rosnita, R. (2015). Learning Evaluation. Jakarta: Citapustaka.

Choirudin, C., Nyoman, I., Degeng, S., Kuswandi, D., Purnomo, P., & Maba, A, P. (2022). Career Readiness among Low-Income Muslim Students. International Journal of Evaluation and Research in Education (IJERE) ,11(3), 1400–1406. https://doi.org/10.11591/ijere.v11i3.22727

Darmayanti, R., Sugianto, R., & Muhammad, Y. (2022). Analysis of Students' Adaptive Reasoning Ability in Solving HOTS Problems Arithmetic Sequences and Series in Terms of Learning Style. Numerical: Journal of Mathematics and Mathematics Education, 6(1), 70-93.

Darmayanti, R., Syaifuddin, M., Rizki, N., Sugianto, R., & Hasanah, N. (2022). High School Students' Mathematical Representation Ability: Evaluation of Disposition Based on Mastery Learning Assessment Model (MLAM). Journal of Advanced Sciences and Mathematics Education, 2(1), 1–15.

Docktor, J, L., Dornfeld, J., Frodermann, E., Heller, K., Hsu, L., Jackson, K, A., Mason, A., Ryan, Q, X., & Yang, J. (2016). Assessing Student Written Problem Solutions: A Problem-Solving Rubric with Application to Introductory Physics. Physical Review Physics Education Research, 12(1), 1-10. https://doi.org/10.1103/PhysRevPhysEducRes.12.010130.

Dodd, V., Hanson, J., & Hooley, T. (2022). Increasing Students' Career Readiness Through Career Guidance: Measuring The Impact with A Validated Measure. British Journal of Guidance and Counseling, 50(2), 260-272. https://doi.org/10.1080/03069885.2021.1937515.

Fauza, M, R., Inganah, S., Darmayanti, R., Prasetyo, B, A, M., & Lony, A. (2022). Problem Solving Ability: Strategy Analysis of Working Backwards Based on Polya Steps for Middle School Students YALC Pasuruan. Journal of Mathematics and Science Education), 10(2), 353–363. https://doi.org/10.25273/jems.v10i2.13338.

Febriana, R. (2021). Learning Evaluation (BS Fatmawati, Ed.). Script Earth.

Fitriani, S., & Yarmayani, A. (2018). Development of High School Students' Creative Thinking Rubric in Solving Mathematical Problems. Mosharafa: Journal of Mathematics Education, 7(1), 33-38. https://doi.org/10.31980/mosharafa.v7i1.339

Güner, P., & Erbay, H, N. (2021). Prospective Mathematics Teachers' Thinking Styles and Problem-Solving Skills. Thinking Skills and Creativity, 1(1), 1-10. https://doi.org/10.1016/j.tsc.2021.100827

Hairida, H., Ulfa, M., Hadi, L., Setyaningrum, V., & Arifiyanti, F. (2021). Collaborative Problem Solving (CPS) Based Collaboration Skills Rubric in Natural Science Learning. Journal of Physics: Conference Series, 1842(1), 12-31. https://doi.org/10.1088/1742-6596/1842/1/012031

Hermawan, H., Siahaan, P., Suhendi, E., Kaniawati, I., Samsudin, A., Setyadin, A, H., & Hidayat, S, R. (2017). Instrument Design for Middle School Students' Collaborative Ability Rubric in Reflection of Light Material. Journal of Research & Development of Physics Education, 3(2), 2599-2613. https://doi.org/10.21009/1.03207

Hull, M, M., Kuo, E., Gupta, A., & Elby, A. (2013). Problem-Solving Rubrics Revisited: Attending to The Blending of Informal Conceptual and Formal Mathematical Reasoning. Physical Review Special Topics-Physics Education Research, 9(1), 1-16. https://doi.org/10.1103/PhysRev STPER.9.010105

Hung, J, C., & Wang, C, C. (2021). Exploring The Website Object Layout of Responsive Web Design: Results of Eye Tracking Evaluations. Journal of Supercomputing, 77(1), 343-365. https://doi.org/10.1007/s11227-020-03283-1

Jonan, Y, R. (2020). Development of Scoring Rubric on Authentic Assessment for Volume and Block Area Material. Journal of Medicine: Journal of Mathematics Education IKIP Veteran Semarang, 4(2), 1-10. https://doi.org/10.31331/medivesveteran.v4i2.1174

Kao, J, C., Rivera, N, M., Clemens, B., & Cai, L. (2018). Validating Career-Readiness Features in High School Assessments. National Center for Research on Evaluation, Standards, and Student Testing (CRESST), December, 1-72.

Kurniasih, Y., Hamdu, G., & Lidinillah, D, A, M. (2020). Critical Thinking Performance Assessment Rubric in STEM Learning with Lightning Tamiya Car Media. Elementary School Scientific Journal, 4(2), 174-185. https://doi.org/10.23887/jisd.v4i2.25172

Lastuti, S. (2018). Development of HOTS-based Teaching Materials to Improve Students' Mathematical Problem Solving Ability. Kreano, Jurnal Matematika Kreatif-Inovatif, 9(2), 191–197.

Leacock, T, L., & Nesbit, J, C. (2007). A Framework for Evaluating The Quality of Multimedia Learning Resources. In Educational Technology and Society, 10(2), 44-59.

Lertyosbordin, C., Maneewan, S., Yampinij, S., & Thamwipat, K. (2019). Scoring Rubric of Problem-Solving on Computing Science Learning. International Education Studies, 12(8), 26-32. https://doi.org/10.5539/ies.v12n8p26

Mutiara, A, D., Sutawidjaya, A., & Abadyo, A. (2017). Development of A Scoring Rubric on Authentic Assessment for Tube Material. Journal of Education: Theory, Research, and Development. 2(10), 1-12.

NCTM. (2000). Principles and Standards for School Mathematics. US: Reston.

Nichols-Barrer, I., Place, K., Dillon, E., & Gill, B. (2016). Testing college readiness: Massachusetts compares the validity of two standardized tests. Education Next, 16(3), 1-10.

Nurhaifa, I., Hamdu, G., & Suryana, Y. (2020). Performance Assessment Rubric in 4C Skills-Based STEM Learning. Indonesian Journal of Primary Education, 4(1), 1-10. https://doi.org/https://doi.org/10.17509/ijpe.v4i1.24742

Nurtanto, M., Kholifah, N., Masek, A., Sudira, P., & Samsudin, A. (2021). Crucial Problems in Arranged The Lesson Plan of Vocational Teacher. International Journal of Evaluation and Research in Education, 10(1), 345–354. https://doi.org/10.11591/ijere.v10i1.20604

Otgonbaatar, K. (2021). Effectiveness of Anchoring Vignettes in Re-Evaluating Self-Assessed Social and Emotional Skills in Mathematics. International Journal of Evaluation and Research in Education (IJERE), 1(1), 237–244.

Özer, B., Duran, V., & Tekke, M. (2020). Training of Trainers: an Action-Based Research for Improving The Pedagogical Skills of Academicians. International Journal of Evaluation and Research in Education, 9(3), 704–715. https://doi.org/10.11591/ijere.v9i3.20327

Palinussa, A, L., Molle, J, S., & Gaspersz, M. (2021). Realistic Mathematics Education: Mathematical Reasoning and Communication Skills in Rural Contexts. International Journal of Evaluation and Research in Education ,10(2), 522-534. https://doi.org/10.11591/ijere.v10i2.20640

Pathuddin, P., & Bennu, S. (2021). Metacognitive Skills of Students with High Mathematical Abilities in Solving Contextual Problems. Journal of Physics: Conference Series, 1832(1), 12-48. https://doi.org/10.1088/1742-6596/1832/1/012048

Polya, G. (1973). How to Solve It (2nd ed.). New Jersey: Prince University Press.

Prayitno, S. (2019). Evaluation of Mathematics Learning Indonesia: Science Library Ambassador.

Rismen, S., Juwita, R., & Devinda, U. (2020). Analysis of Students' Mathematical Problem Solving Ability in Terms of Impulsive Cognitive Style. Gantang Journal, 5(1), 1-10. https://doi.org/10.31629/jg.v5i1.1579

Salazar-Torres, J., Rincón Leal, O., & Vergel Ortega, M. (2021). The Rubric As an Assessment Tool for Solving Problem Situations in The Physics and Mathematics Teaching Context. Journal of Physics: Conference Series, 1981(1), 12-18. https://doi.org/10.1088/1742-6596/1981/1/012018

Sekaryanti, R., Cholily, Y, M., Darmayanti, R., Rahma, K., Prasetyo, B., & Maryanto, A. (2022). Analysis of Written Mathematics Communication Skills in Solving Solo Taxonomy Assisted Problems. Journal of Mathematics and Science Education), 10(2), 395–403. https://doi.org/10.25273/jems.v10i2.13707

Sesanti, N, R., & Ferdiani, R, D., (2017). Mathematics Learning Assessment. US: The Edelweiss Foundation.

Silvia, F., Risnita, R., & Syaiful, S. (2015). Development of Creative Thinking Skills Rubric in Solving Mathematics Problems for Class VIII Students of SMP Attaufiq Jambi. Edu-Science: Journal of Mathematics and Natural Sciences Education, 4(1), 1-10. https://doi.org/10.22437/jmpmipa. v4i1.2363

Srirahayu, R, R, Y., & Arty, I, S., (2018). The Validity and Reliability of The STEM-Based Science Literacy Performance Assessment Instrument. Journal of Educational Research and Evaluation, 6(4), 22(2). https://doi.org/10.21831/pep.v22i2.20270

Stevens, D, D., & Levi, A, J., (2013). Introduction to Rubrics: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning. US: Stylus Publishing.

Suwarno, S., & Aeni, C. (2021a). The Importance of Assessment Rubric in Measuring Students' Honesty. Education: Journal of Education, 19(1), 161-173. https://doi.org/10.31571/edukasi. v19i1.2364

Suwarno, S., & Aeni, C. (2021b). The Importance of Assessment Rubrics in Measuring Student Honesty. Education: Journal of Education, 19(1), 161-173. https://doi.org/10.31571/edukasi. v19i1.2364

Ulrich, T, A., Mortenson, T., Boring, R, L., & Prescott, S. (2020). Dynamic Modeling of Field Operators in Human Reliability Analysis: An Emrald and Goms-Hra Dynamic Model of Flex Operator Actions. Advances in Intelligent Systems and Computing, 346-352. https://doi.org/10.1007/978-3-030-50946-0_46

Widodo, S, A., (2018). Improving Mathematical Problem Solving Skills through Visual Media. Journal of Physics: Conference Series, 948(1), 309–326.

Zulfa, H., Saputro, D, R, S., & Riyadi, R. (2019). Students' Difficulties in Learning Mathematics With Artisan Character Types in The HOTS Trigonometry Test. Journal of Physics: Conference Series, 1321(2), 22-104. https://doi.org/10.1088/1742-6596/1321/2/022104

Downloads

Published

2023-03-31

Issue

Vol. 7 No. 1 (2023)

Section

Artikel

Citation Check

License

Penulis yang menerbitkan karyanya ke jurnal ini setuju dengan persyaratan berikut:

Penulis menyerahkan hak cipta dan memberikan hak penerbitan pertama kepada jurnal, dengan karya yang secara serentak dilisensikan di bawah Lisensi: Creative Commons Attribution - Share Alike 4.0 Internasional License yang memungkinkan orang lain membagikan karya dengan pengakuan penerbitan awal dan kepenulisan karya di jurnal ini.