Psychology Master Calendar
skip to events
advanced search
view calendar
| week selector | S | M | T | W | T | F | S |
|---|---|---|---|---|---|---|---|
go to week of Apr 1, 2012![]() | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
go to week of Apr 8, 2012![]() | 8 | 9 | 10 | 11 | 12 | 13 | 14 |
go to week of Apr 15, 2012![]() | 15 | 16 | 17 | 18 | 19 | 20 | 21 |
go to week of Apr 22, 2012![]() | 22 | 23 | 24 | 25 | 26 | 27 | 28 |
go to week of Apr 29, 2012![]() | 29 | 30 | 1 | 2 | 3 | 4 | 5 |
Event Detail Information
Event Detail Information
Quantitative Brown Bag - - Heuristic Cognitive Diagnosis When the Q-Matrix is Unknown
Date Apr 16, 2012
Time 1:30 pm
Location Psychology 819
Sponsor Quantitative Division
Contact Hans Friedrich Koehn
E-Mail hkoehn@illinois.edu
Event type Brown Bag
Views 832
Originating Calendar Psychology General Calendar
Current methods for fitting cognitive diagnosis models to educational data are based on maximum-likelihood estimation (MLE) methods such as Expectation Maximization (EM) and Markov Chain Monte Carlo that often suffer from practical
limitations. As an alternative to MLE, parameter-free, nonmodel-based classification techniques have been proposed as heuristic or approximate methods for fitting cognitive diagnosis models; the asymptotic classification theory of cognitive diagnosis by Chiu, Douglas, and Li provides a theoretical foundation for this approach. However, both MLE methods and nonmodel-based classification heuristics can be applied only if the ``Q-matrix'' underlying a given test is known a priori. The binary Q-matrix specifies the relation
between individual test items and the cognitive skills required to respond correctly to them and thus represents an integral component of all cognitive diagnosis models. Unfortunately, in practice, for most tests, the Q-matrix is
unknown so that the item-attribute associations must be estimated based on the (fallible) judgment of experts. A misspecified Q-matrix results in the incorrect classification of examinees regardless of whether MLE or
nonmodel-based heuristics are used. The asymptotic classification theory, for example, assumes that examinees' test item scores have been aggregated into sum-scores, an item-profile statistic that reflects the item-attribute
associations and, so requires the Q-matrix of the test in question to be known. In avoiding any complications arising from an unknown and possibly misspecified Q-matrix, we propose to classify examinees directly based on their raw-score item profiles. Extensive simulation studies show that using nonaggregated item profiles results in superior recovery rates of the true underlying cluster structure, as compared to grouping examinees based on their sum-score profiles.
