ASSESSMENT DEVELOPMENT

Tests are invaluable for teachers, school leaders, district leaders, policy-makers, the public, parents and even students -- so long as they (and the inferences mades from the data they produce) are valid.

  • "Validity is the most important consideration in test evaluation." (1985 Standards for Psychological and Educational Testing)
  • "Validity is, therefore, the most fundamental consideration in developing and evaluating tests." (1999 Standards for Psychological and Educational Testing)
  • "Validity is, therefore, the most fundamental consideration in developing and evaluating tests." (2014 Standards for Psychological and Educational Testing)

Standardized the role of standardized testing in our schools has been on the rise for decades, and even 2015 ESSA (Every Student Succeeds Act) will do little to diminish that role. However, the tests that we use are of questionable validity. For all the criticism that psyshometricians and assessment industry professionals may make of teacher-made tests, there have long been validity problems with standardized tests which render the usefulness questionable. Historically, the assessment industry has focused on maximizing reliability, with far less attention to validity.

At AleDev, we build protocols, approaches, guides and techniques for developing standardized tests with an emphasis on validity, above all else. Primarily through our Rigorous Test Development (RTD) project, we are trying to help create better tests so that they can be useful both to those with who must take in a wide view of the progress of hundred, thousands or millions of students and are those who are focus on individual students and the content they are trying to master. 

Downloads

Rigorous Test Development Introduction: The Core Principles

Content Validity Checklist (MC)

Validity Committee Facilitator Responsibilities

Validity Committee Member Responsibilities

Argumentative Passage Review Tool

Informational Passage Review Tool

Literary Passage Review Tool

Paired Passage Review Tool