Claim Evaluation Tools
What are Claim Evaluation Tools?
The Claim Evaluation Tools database contains multiple-choice questions that assess an individual’s understanding of and ability to apply Key Concepts that people need to use to assess treatment claims and to make informed health choices [Austvoll-Dahlgren 2015].
Who are the questions for?
If you are preparing lessons to teach people about one or more of the Key Concepts, you may be interested in assessing what your students have learned. The multiple-choice questions can be used in tests in schools and other teaching settings and in self-assessment tools. They can also be used in randomised trials evaluating the effects of educational interventions, and in cross-sectional studies to gauge the ability of a population to assess treatment claims and make informed health choices.
All the questions in the Claim Evaluation Tools database have been developed for children (from the age of 10) as well as for adults.
How can you use the database?
Instead of a standard, fixed questionnaire, we have developed the Claim Evaluation Tools database as a flexible battery of multiple-choice questions from which teachers, researchers and others can select relevant questions for a specific purpose. Each multiple-choice question is designed to address one Key Concept. This means that you can create your own test or questionnaire based on which Key Concepts you want to teach or measure.
The Claim Evaluation Tools database is open access and free for non-commercial use. If you are interested in trying out the multiple-choice questions, please see our manual that will help you to develop your own test or questionnaire in a few easy steps.
We have developed the database based on extensive qualitative and quantitative feedback from methodological experts, health professionals, teachers and members of the public [Austvoll-Dahlgren 2016b]. We have validated the questions using Rasch analysis in several countries, including, China, Germany, Mexico, and Uganda.
For the test used in two IHC trials in Uganda [Nsangi 2017, Semakula 2017], we used 26 multiple-choice questions addressing the 12 concepts that the IHC primary school resources cover and the 9 concepts that the IHC podcast for their parents covers (13 concepts in total). Each Key Concept was evaluated by two questions.
The test also included questions that assess intended behaviours, self-efficacy, and attitudes. In addition, we included four questions that assess literacy, as a covariate in exploratory analyses in the trial of the primary school resources.
We used an absolute (criterion referenced) standard to set passing scores for the test – one for the 12 concepts covered by the IHC primary school resources and one for the nine concepts covered by the IHC podcast. We used a combination of Nedelsky’s and Angoff’s methods to determine the criteria [Davies 2017], which are cut-offs for passing scores. In addition, we determined a second cut-off for scores that indicate mastery of the concepts, using the same methods.
Translation of the questions
Multiple-choice questions in the Claim Evaluation Tools database are currently available in several languages, including: Chinese, English, German, Luganda, Norwegian, and Spanish.
For more information, please see the Manual for preparing a test or questionnaire based on the Claim Evaluation Tools database.
Contact us if you would like to receive a test that can be used to assess the ability of children to apply the 12 concepts covered in the primary school resources.
Also let us know if you would like to translate multiple-choice questions to other languages or contribute to the ongoing development and validation of evaluation tools.
Lastly, please send us your feedback if you use the resources.