Method development for analysing and evaluating computerized achievement tests

Project description

The overall aim is to develop the theory for analysing and evaluating computerized achievement tests in order to create fare tests. Methods of DIF, i.e. if two groups (e.g. men and women) of test takers with the same ability gives different answer to an item, will be examined and developed for licensing tests. The loss of information will be examined when tests which measure several dimensions of a test-taker's ability are analysed with simple models, which are based on the assumption of one dimension. A method for equating two test versions which have some items in common will be created. Statistical inference theory and functional data analysis will be integrated with psychometrics in order to estimate the probability to answer an item correctly when the test-takers' ability are viewed as nuisance parameters. Analytical models will be created and tested through simulations where the parameters are known. Then, the methods will be applied to standardized tests, e.g. the Swedish SAT, national tests and the driving-license test.