Validation and implementation of 3-dimensional scientific literacy test (LISA3d test): Measuring scientific literacy for senior high school students based on scientific reasoning, scientific inquiry, and nature of science

Norwaliza Abdul Wahab

Abstract

This research aims to validate and implement an instrument to measure the scientific literacy of high school science program students, including the abilities of Scientific Reasoning, Scientific Inquiry, and Nature of Science (NOS), called the Lisa3D Test. These three instruments were validated using the Rasch model approach and pre-sented as a digital application. This research method was a descriptive survey with a quantitative approach. The research started from the test design, validation, and implementation stages. The types of validity used included content, psychometric, construct, and external validity. For construct validity, the instrument was tested on 197 high school students, while the implementation stage involved 407 students. The research results show that the Lisa3D Test has fulfilled all aspects of validity. The Lisa3D test has been successfully implemented via the page www.lisatest.id with a cut of 56% for the Scientific Reasoning test, 50% for the Scientific Inquiry test, and 56.25% for the NOS test. This research produces a standard instrument to measure the scientific literacy of high school science program students based on three dimensions, namely Scientific Reasoning, Scientific Inquiry, and Nature of Science (NOS). The Lisa3D test can be implemented on a broader scale and can be an additional criterion for graduating high school students so that all graduates can master science comprehensively. © 2024 Science Education Study Program FMIPA UNNES Semarang.

References

Adnan, A., Usman, U., & Bahri, A. (2021). Scientific literacy skills of students: Problem of biology teaching in junior high school in south sulawesi, indonesia. International Journal of Instruction, 14(3), 847-860.

Andrich, D., & Marais, I. (2019). A course in Rasch measurement theory. Measuring in the educational, social and health sciences, 41.

Anselmi, P., Vidotto, G., Bettinardi, O., & Bertolotti, G. (2015). Measurement of change in health status with Rasch models. Health and Quality of Life Outcomes, 13, 1-7.

Ardiyanti, Y., Suyanto, S., & Suryadarma, I. G. P. (2019, October). The role of students science literacy in Indonesia. In Journal of Physics: Conference Series (Vol. 1321, No. 3, p. 032085). IOP Publishing.

Arfiani, Y., Susongko, P., & Kusuma, M. (2023). Construct validity analysis with messick validity approach and rasch model application on scientific reasoning test items. THABIEA: JOURNAL OF NATURAL SCIENCE TEACHING, 6(1), 90-105.

Ariyanti, A. I. P., Ramli, M., & Prayitno, B. A. (2016). Preliminary Study on Developing Science Literacy Test for High School Students in Indonesia. In International Conference on Teacher Training and Education. Sebelas Maret University.

Atta, H. B., & Aras, I. (2020). Developing an instrument for students scientific literacy. In Journal of Physics: Conference Series (Vol. 1422, No. 1, p. 012019). IOP Publishing.

Baldwin, P., Margolis, M. J., Clauser, B. E., Mee, J., & Winward, M. (2020). The choice of response probability in bookmark standard setting: an experimental study. Educational Measurement: Issues and Practice, 39(1), 37-44.

Bao, L., Xiao, Y., Koenig, K., & Han, J. (2018). Validity evaluation of the Lawson classroom test of scientific reasoning. Physical Review Physics Education Research, 14(2), 020106.

Bond, T., Yan, Z., & Heene, M. (2020). Applying the Rasch model: Fundamental measurement in the human sciences. Routledge.

Bordbar, S., & Alavi, S. M. (2021). Detecting genderbiased items in a high-stakes language proficiency test: using Rasch model measurement. International Journal of Quantitative Research in Education, 5(3), 277-310.

Briggs, D. C. (2019). Interpreting and visualizing the unit of measurement in the Rasch Model. Measurement, 146, 961-971.

Chu, S. K. W., Reynolds, R. B., Tavares, N. J., Notari, M., & Lee, C. W. Y. (2021). 21st century skills development through inquiry-based learning from theory to practice. Springer International Publishing.

Clauser, B. E., Baldwin, P., Margolis, M. J., Mee, J., & Winward, M. (2017). An experimental study of the internal consistency of judgments made in bookmark standard setting. Journal of Educational Measurement, 54(4), 481-497.

Creswell, J. W., & Creswell, J. D. (2017). Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.

Dewi, C. A., Khery, Y., & Erna, M. (2019). An ethnoscience study in chemistry learning to develop scientific literacy. Jurnal Pendidikan IPA Indonesia, 8(2), 279-287.

Erduran, S., Dagher, Z. R., Erduran, S., & Dagher, Z. R. (2014). Reconceptualizing nature of science for science education (pp. 1-18). Springer Neth erlands.

Fakhriyah, F., Masfuah, S., Roysa, M., Rusilowati, A., & Rahayu, E. S. (2017). Student’s science literacy in the aspect of content science?. Jurnal Pendidikan IPA Indonesia, 6(1).

Filgona, J., Sakiyo, J., Gwany, D. M., & Okoronka, A. U. (2020). Motivation in learning. Asian Journal of Education and social studies, 10(4), 16-37.

Fives, H., Huebner, W., Birnbaum, A. S., & Nicolich, M. (2014). Developing a measure of scientific literacy for middle school students. Science Education, 98(4), 549-580.

Gall, M. D., Gall, J. P., & Borg, W. R. (2014). Applying educational research: How to read, do, and use research to solve problems of practice. Pearson Higher Ed.