A Practical Guide To Test Blueprinting Discussion Paper
Post from Melanie
When developing a test, Billings and Halstead (2020) explains that educators put a lot of thought and planning into the process for it must be both valid and reliable (p. 474). Raymond and Grande (2019) explain that a test blueprint describes the key elements of a test and that it is a natural extension of the learning outcomes and objectives (paras 1 & 3). There are four major steps in developing a test blueprint (1) identify the major knowledge and skill domains (2) outline the objectives or learning outcomes to be assessed within each domain (3) determine the assessment format and (4) specify the weight to be given to each content category (Billings & Halstead, 2020, p.476; Raymond & Grande, 2019, Practice points). Raymond and Grande (2019) explain that the primary goal of the assessment is to allow an educator make a claim about what their learner knows and have the evidence to prove it. A Practical Guide To Test Blueprinting Discussion Paper
Bloom’s revised taxonomy and Miller’s pyramid are two common models used to organize learning but also assess learning (Raymond and Grande, 2019, paras 6 & 8). The third step of the test blueprint is important- deciding on the test format for the method needs to match the claim (Raymond and Grande, 2019, para 20); for instance a written exam for a claim that a nurse can perform a kinesthetic skill is not an appropriate assessment method. AlFallay (2018) in a study regarding educators utilizing test blueprints in Saudi for an English class revealed that a majority of the participants did not utilize or follow the recommended guidelines when they created their test blueprints nor did they make preparations prior to developing tests for their course/class (para 1). Though this study was focused on an English course in Saudi, it is a reminder that knowledge and utilization of a test blueprint is important so that the assessment or claim of a what a learner has learned is valid. A Practical Guide To Test Blueprinting Discussion Paper
References
AlFallay, I. S. (2018). Test Specifications and Blueprints: Reality and Expectations. International Journal of Instruction, 11(1), 195–210. https://doi-org.lopes.idm.oclc.org/10.12973/iji.2018.11114a
Billings, D. M., & Halstead, J. A. (2020). Teaching in nursing: A guide for faculty (6th ed.). Saunders.
Raymond, M. R., & Grande, J. P. (2019). A practical guide to test blueprinting. Medical Teacher, 41(8), 854–861. https://doi-org.lopes.idm.oclc.org/10.1080/0142159X.2019.1595556
Hi Melanie
Your analysis of test creation and test plans’ value is illuminating and helpful. Indeed, as emphasized by Double et al. (2020), significant thought is required throughout the test-development process to guarantee validity and reliability. Double et al. (2020) pointed out that a critical framework to match learning goals with the assessment process is the incorporation of test blueprints. Your highlight on the knowledge domain identification, goal formulation, assessment format choice, and content category weighting gives a proper assessment plan. I love your insight on Double et al. (2020) on how teachers need to make assertions about students’ understanding with backup evidence. A Practical Guide To Test Blueprinting Discussion Paper
I agree with you that choosing an evaluation method consistent with the expected result is crucial. Coordinating the assessment strategy with the desired outcomes is crucial to achieve the desired result. It is essential to point out that written tests are adequate measures of the kinesthetic abilities of students. However, it is vital to note that careful planning is crucial for student performance evaluation.
Your highlight on the recurring problem between official recommendations and ordinary practice when drawing up test plans gives an excellent remark relevant beyond an English lesson in Saudi Arabia. Thus it gives a universal difficulty in putting best learning practices into action. Practical sessions serve as a helpful reminder that tests must adhere to these principles to accurately represent students’ knowledge and abilities Double et al. (2020). Finally, I love how you have shed light on the complex nature of test creation and highlighted the importance of test blueprints in facilitating congruence between instructional goals and evaluation measures. It is thus essential for teachers to follow these procedures carefully to be able to make more legitimate assertions regarding their students’ abilities. A Practical Guide To Test Blueprinting Discussion Paper