Assessing mental skill and technique use in applied interventions: Recognizing and minimizing threats to the psychometric properties of the TOPS

Drawing from the experiences of the authors in developing, conducting, and evaluating sport psychology interventions, several considerations are highlighted and recommendations offered for effective psychometric assessment. Using the Test of Performance Strategies (TOPS; Thomas, Murphy, & Hardy, 1999) as a working example, opportunities for bias to undermine a measure’s validity and reliability are discussed with reference to a respondent’s four cognitive processes: (a) comprehension, (b) retrieval, (c) decision-making, and (d) response generation. Further threats to an instrument’s psychometric properties are highlighted in the form of demand characteristics athletes perceive in the environment. With these concerns in mind, several recommendations are made relating to the process of questionnaire administration and how possible compromises to the psychometric soundness of measures used in applied interventions can be minimized.