This shows you the differences between two versions of the page.
Both sides previous revision Previous revision | Next revision Both sides next revision | ||
knowledge_assessment:q-matrix [2012/07/05 10:31] jpetrovic |
knowledge_assessment:q-matrix [2012/07/05 12:53] jpetrovic |
||
---|---|---|---|
Line 12: | Line 12: | ||
* Hand construction of the q-matrix by experts' assigning concepts to questions and then comparing student answers to closest matrix responses. Problems: a q-matrix is a much more abstract measure of the relationships of questions to concepts. We might assume that the questions designed to test students are a more accurate reflection of the teaching objectives than an abstract construct which relates questions to underlying concepts. | * Hand construction of the q-matrix by experts' assigning concepts to questions and then comparing student answers to closest matrix responses. Problems: a q-matrix is a much more abstract measure of the relationships of questions to concepts. We might assume that the questions designed to test students are a more accurate reflection of the teaching objectives than an abstract construct which relates questions to underlying concepts. | ||
* The alternative to this strategy is to design a method to extract a q-matrix, which explains student behavior, and reveals the underlying relationships between questions. Experts can examine the resulting q-matrix 25 to ensure that the extracted relationships seem to be valid, and then use that q-matrix to guide the generation of new problems. | * The alternative to this strategy is to design a method to extract a q-matrix, which explains student behavior, and reveals the underlying relationships between questions. Experts can examine the resulting q-matrix 25 to ensure that the extracted relationships seem to be valid, and then use that q-matrix to guide the generation of new problems. | ||
+ | |||
+ | How to automatically determine concepts? Using covariance matrix. Number of concepts should be smaller than number of questions. Still, this methos has proven to be less fault tollerant. |