Title: Influences of Item Content and Format on the Dimensionality of Tests Combining Multiple-Choice and Open-Response Items: An Application of the Poly-DIMTEST Procedure.
Abstract:The DIMTEST statistical procedure was used in a confirmatory manner to explore the dimensionality structures of three kinds of achievement tests: multiple-choice tests, constructed-response tests, and...The DIMTEST statistical procedure was used in a confirmatory manner to explore the dimensionality structures of three kinds of achievement tests: multiple-choice tests, constructed-response tests, and tests combining both formats. The DIMTEST procedure is based on estimating conditional covariances of the responses to the item pairs. The analysis was conducted on the results from the joint administration of the Constructed-Response Supplement to the Iowa Tests of Basic Skills and Form M of the Iowa Tests of Basic Skills, using samples of 952 seventh graders and 882 eighth graders for the language tests, and 889 seventh graders and 918 eighth graders for the mathematics tests. Three potential sources of dimensional distinctness among items in the tests, caused by item format, item content, and item location, were investigated. The results differed for language and mathematics achievement tests, in part because the tests were dissimilar with regard to content composition and the number of items in the whole tests as well as subtests that were analyzed. The Poly-DIMTEST analysis presented provides evidence of dimensional heterogeneity of tests intended to provide assessments that are balanced with respect to the content composition of a targeted construct. The analysis also suggests that combining items of different formats may introduce additional complexity into the dimensionality structure of the composite test. (Contains 1 figure, 8 tables, and 31 references.) (SLD) ******************************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document. ******************************************************************************** Influences of Item Content and Format 1 Influences of Item Content and Format on the Dimensionality of Tests Combining Multiple-Choice and Open-Response Items: An Application of the Poly-DIMTEST Procedure Yelena Perkhounkova and Stephen B. Dunbar University of Iowa PERMISSION TO REPRODUCE AND DISSEMINATE THIS MATERIAL HAS BEEN GRANTED BY )62,1611a Ahotal YeA__ TO THE EDUCATIONAL RESOURCES ' INFORMATION CENTER (ERIC) U.S. DEPARTMENT OF EDUCATION Office of Educational Research and Improvement EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) cfrifIT's document has been reproduced as received from the person or organization originating it. 0 Minor changes have been made to improve reproduction quality. Points of view or opinions stated in this document do not necessarily represent official OERI position or policy. Paper presented at the 1999 Annual Meeting of the American Educational Research Association, Montreal, CanadaRead More
Publication Year: 1999
Publication Date: 1999-04-01
Language: en
Type: article
Access and Citation
Cited By Count: 5
AI Researcher Chatbot
Get quick answers to your questions about the article from our AI researcher chatbot