Outcome 3. Concept Inventory Validation (2024/2025)
At this stage, the primary goal is to ensure the accuracy and
effectiveness of the CI tools.
This requires the application of standard validation and reliability
methods to assess the items that represent the target content. Validity,
one of the principal considerations, assesses the extent to which both
evidence and theory support the interpretation of item scores for the
intended purpose of the CI. It also determines the degree of confidence
with which we can rely on the test results within specific circumstances
[44]. Reliability is another essential component of the CI tool to
ensure that the assessment consistently measures students’ understanding
of the targeted concepts. It determines whether the CI is functioning
effectively. A properly functioning instrument generates consistent
scores, with related items assessing the same construct, resulting in
reliable and reproducible outcomes [45]. To achieve the accuracy and
reproducibility of CI instruments, we will employ appropriate validation
and reliability methods systematically, encompassing all relevant
content and representing the target construct we aim to assess [46].
The validation process for CI instruments will integrate several
psychometric properties, including content validity, construct validity,
criterion validity, internal consistency,
and reliability tests [45, 47]. Furthermore, item statistics, such
as item difficulty and item discrimination, are integral to this
process. These steps collectively contribute to a comprehensive and
best-practice approach for CI development.