ANALYSING TEST-WISENESS OF NATIONAL EXAMINATION ITEMS OF ENGLISH SUBJECT FOR JUNIOR HIGH SCHOOL STUDENTS

Gunawati Dwi Utami

Abstract


This study aimed to analyse the test-wiseness of three sets of national examination items for junior high school students, the year of 2016, 2017 and 2018.The reasearcher investigated which test-wiseness subscale(s) appeared, how frequent the test-wiseness appeared, and how item validity, item difficulty, item discrimination, distractor effectiveness and the reliability were related to the items having the test-wiseness for the students studying at higher, middle and lower schools at Kota Malang. The research design was quantitative evaluation research. The steps to conduct this research were 1) determining test-wiseness subscales for ESL/EFL; 2) analysing the data based on the subscales; 3) counting  the appeared subscales and the frequency; 4) checking the item analysis; and 5) drawing conclusion. The findings showed that similar-option, stem-option and item give-away were the appeared subscales. There were 15,3%  items having test-wiseness. The statistical analysis showed that the items having test-wiseness did not have any problems with the validity, the difficulty index, the distractors effectiveness, except from those from the lower level school. This means that test-wiseness do exist in national examination items and the appearance affects the students, especially those coming from high level school who have good cognitive ability. It is suggested to the test developer of national examination and English teachers to carefully develop a test, for the headmaster and English teachers community to hold a teacher training on assessment. For the future researcher, analysing the test-wisenessof the future national examination items with many more new sources and broader population is still worthly needed.

Full Text:

PDF

References


Allan, A. 1992. Development and validation of a scale to measure test-wiseness in EFL/ESL reading test takers. Language Testing. 9(2): 101-122

Amer, A. A. 2007. EFL/ESL Test-wiseness and Test-taking Strategies. ERIC (ED 497399). Online.Retrieved 14/03/2019 18.48. https://www.academia.edu/12139048/EFL_ESL_Test-wiseness_and_Test-taking_Strategies

Arikunto, S. 2016. Dasar-dasar Evaluasi Pendidikan Edisi Kedua. Jakarta: Bumi Aksara.

Ariyana, L. T. 2011. Analisis Butir Soal Ulangan Akhir Semester Gasal IPA Kelas IX SMP di Kabupaten Grobogan. Unpublished Thesis. Semarang: Mathematic and Science Faculty, State University of Malang

Badan Standar Nasional Pendidikan. 2018. Prosedur Operasional Standar (Pos) Penyelenggaraan Ujian Nasional Tahun Pelajaran 2018/2019. Jakarta: BSNP

Brown, H.D. & Lee, H. 2015. Teaching by Principles An Interactive Approach to Language Pedagogy (Fourth Edition). New York: Pearson Education Inc.

Depdikbud. 2005. Panduan Analisis Butir Soal Pilihan Ganda. Jakarta: Balitbang-Depdikbud

Evans, W . 1984. Test Wiseness: An Examination of Cue Using Strategies. The Journal of Experimental Education. 52(3): 141-144

Knapp, T. R., Faan, E. (Ed). 2018. Use of Multiple-Choice Questions in Nursing Research . Sage Journal: 27(8): 911-916.

Millman, J., Bishop, C.H., & Ebel, R.1965. An Analysis of Test-Wiseness. Educational and Psychological Measurement. XXV(3): 707-726

Otoum, A, Khalaf,H.B., Bajbeer, A.,Hamad, H.B. 2015. The Level of Test-wiseness for the Students of Arts and Science Faculty at Sharourah and Its Relationship with Some Variables. Journal of Education and Practice. 6(29): 102-113

Peraturan Menteri Pendidikan dan Kebudayaan R.I no 23/2016 tentang Standar Penilaian Pendidikan. 2016. Jakarta: Kementerian Pendidikan dan Kebudayaan

Powell, R.R. 2006. Evaluation Research: An Overview. Library Trends, 55(1): 102-120.

Pusat Penilaian Pendidikan. 2017. Panduan Penulian Soal 2017 SMP/MTs. Jakarta: Kementerian Pendidikan dan Kebudayaan

Qimala. 2013. Test-Wiseness Item Analysis On Sman 1 Kediri’s Selection Tests In The English Subject. Unpublished Thesis. Malang: Faculty of Letter, State University of Malang.

Rogers, W. and D. Bateson. 1991. Verification of a model of test taking behavior of high school seniors. Journal of Experimental Education, 59: 331-349

Sulistyo, G.H. 2002. Language Testing Some Selected Terminologies and Their Underlying Basic Concepts. Unpublished Textbook. Malang: English Department, State University of Malang

Sulistyo, G.H. & Rahmajanti, S. 2003. Tes Bahasa Inggris Sekolah Dasar. Malang: Bayumedia

Sulistyo, G.H. 2018. EFL Learning Assessment At Schools An Introduction to Its Basic Concepts and Principles. Malang: CV Bintang Sejahtera Abadi

Seaman, P. 2003. Multiple Choice Testing: will it work for Me? .online. February 14, 2019. http://www.lib.unb.ca/Texts/Teaching/JAN03/seaman.htm.

Scharnagl, T.M. 2004. The Effects of Test-taking Strategies on Students’ Reading Achievement. Unpublished Doctoral Dissertation. Union Institude and University, UMI 31444027

Tavakoli, E. & Samian , S. H. 2004. International Conference on Current Trends in ELT Test-wiseness Strategies in PBTs and IBTs: The Case of EFL Test Takers, Who Benefits More?. Procedia - Social and Behavioral Sciences. pp 1-10

Watanabe, Y. 2004. Exploring Test-Wiseness of Japanese Senior High School Students. Japanese Journal. 59: 27-34.

Yousef, Imad. 2004. The Effect of The Test-wiseness on Collection of a Sample from Students of College of Education-Minia University. Education and Psychology Research Journal. 17(3): 349-383

Zimmaro, D.M. 2016. Writing Good Multiple Choice Exams. Online. online. February 14, 2019. https://facultyinnovate.utexas.edu/sites/default/files/writing-good-multiple-choice-exams-fic-120116.pdf


Refbacks

  • There are currently no refbacks.