Chapter 3: Defining and Measuring Variables

A strong measurement system requires two essential qualities: validity, which ensures that an instrument actually measures what it claims to measure across multiple dimensions including face validity, concurrent validity, predictive validity, and construct validity through convergent and divergent evidence; and reliability, which establishes that measurements produce consistent results through test-retest stability, inter-rater agreement, and internal consistency assessed via split-half methods. The chapter then examines the four scales of measurement—nominal, ordinal, interval, and ratio—each providing different levels of mathematical precision and determining which statistical analyses are appropriate for subsequent data interpretation. Researchers select from three primary measurement modalities: self-report methods that ask participants directly about their experiences and attitudes, physiological measures that record biological indicators, and behavioral observations that document actual actions in controlled or natural settings, each carrying distinct advantages regarding validity, feasibility, and ethical considerations. The chapter addresses practical measurement challenges including ceiling and floor effects that restrict variability, range restrictions that limit sensitivity to differences, and systematic artifacts such as experimenter bias, demand characteristics that signal study hypotheses to participants, and reactivity effects where measurement itself changes behavior. Finally, the chapter emphasizes that selecting an appropriate measurement strategy requires balancing multiple competing demands: achieving adequate validity and reliability while maintaining practical feasibility, minimizing participant burden, ensuring ethical treatment, and maintaining sufficient sensitivity to detect meaningful effects in the phenomenon being studied.