Utility of Complex Alternatives in Multiple-Choice Items: The Case of All of the Above

This study investigated the utility of all of the above (AOTA) as a test option in multiple-choice items. It aimed at estimating item fit, item difficulty, item discrimination, and guess factor of such a choice. Five reading passages of the Key English Test (KET, ۲۰۱۰) were adapted. The test was reconstructed in ۲ parallel forms: Test ۱ did not include the abovementioned alternative, whereas Test ۲, administered ۲ weeks later, included such an alternative. The ۲ tests, ۳۲ items each, were administered to ۱۴۲ high school third-graders. Results, analyzed through ۳-parameter logistic model, indicated that the multiple-choice questions, including the alternative all of the above, were easier. Results also revealed that the option all of the above increased the guess factor. Because guess factor is a source of measurement error, it may threaten test validity and reliability.

کلیدواژه ها:

Multiple-Choice Questions ، All of the Above ، Item Fit ، Item Difficulty ، Item Discrimination ، Guess Factor ، Item Response Theory