knowledge_assessment:q-matrix
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision | Next revision Both sides next revision | ||
|
knowledge_assessment:q-matrix [2012/07/11 11:02] jpetrovic [How do I create a q-matrx?] |
knowledge_assessment:q-matrix [2012/07/11 11:08] jpetrovic [How do I create a q-matrx?] |
||
|---|---|---|---|
| Line 29: | Line 29: | ||
| * by having the domain experts analyze assessment items (questions) and define the concept (often referred to as attribute) corresponding to each item and thereby construct the q-matrix. In this case all the concepts in the q-matrix are exactly defined and labeled as elements of the domain. Q_matrix and student's knowledge is therefore easily interpretable. Problems: "//a q-matrix is a much more abstract measure of the relationships of questions to concepts. We might assume that the questions designed to test students are a more accurate reflection of the teaching objectives than an abstract construct which relates questions to underlying concepts.//" | * by having the domain experts analyze assessment items (questions) and define the concept (often referred to as attribute) corresponding to each item and thereby construct the q-matrix. In this case all the concepts in the q-matrix are exactly defined and labeled as elements of the domain. Q_matrix and student's knowledge is therefore easily interpretable. Problems: "//a q-matrix is a much more abstract measure of the relationships of questions to concepts. We might assume that the questions designed to test students are a more accurate reflection of the teaching objectives than an abstract construct which relates questions to underlying concepts.//" | ||
| * by automatically extracting the matrix directly from obtaines students' performance on the test items. in this case, the number of concepts is determined by the algorithm (and is usually much smaller than the number of assessment items) and their labels are automatically assigned (and do not reffer to exact domain concepts). Experts can examine the resulting q-matrix to ensure that the extracted relationships seem to be valid, and then use that q-matrix to guide the generation of new problems. | * by automatically extracting the matrix directly from obtaines students' performance on the test items. in this case, the number of concepts is determined by the algorithm (and is usually much smaller than the number of assessment items) and their labels are automatically assigned (and do not reffer to exact domain concepts). Experts can examine the resulting q-matrix to ensure that the extracted relationships seem to be valid, and then use that q-matrix to guide the generation of new problems. | ||
| + | |||
| + | Factor analysis can be considered as an alternative to q-matrices. Concepts are in that case automatically determined using covariance matrix. Number of concepts should be smaller than number of questions. Still, this methos has proven to be less fault tollerant. | ||
| + | |||
| Line 34: | Line 37: | ||
| - | Factor analysis: | ||
| - | How to automatically determine concepts? Using covariance matrix. Number of concepts should be smaller than number of questions. Still, this methos has proven to be less fault tollerant. | ||
| ==== Q-matrix method ==== | ==== Q-matrix method ==== | ||
knowledge_assessment/q-matrix.txt ยท Last modified: 2023/06/19 18:03 (external edit)
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
