Notes
Short But Still Valid: Validating Single-Item Measures for Key Media Psychology Constructs for Experience Sampling Research
127With the deeper integration of digital media into everyday life, media psychologists’ interest in experience sampling methods (ESMs) has increased. In ESM designs, participants are sent several, short surveys per day, asking them about current/recent experiences. ESM’s advantages include being able to assess situational factors and minimize recall problems. Yet, ESM also has disadvantages, most importantly, their intrusiveness in participants’ daily lives and the effort required. To reduce effort and increase compliance, constructs are often assessed with one item in ESM studies. Single-item measures, however, are frequently criticized for having lower reliability and validity than multi-item measures. ESM-specific method literature recommends to use only measures that were validated for ESM to guarantee validity. However, there are nearly no validated single-item measures for ESM available. This research project aims to validate one-item measures for key communication science/media psychological constructs.
128The project consists of 5 studies. First, we surveyed scholars to identify key constructs for ESM for media psychology/communication science. Based on this, we selected 17 constructs including, for example, online vigilance, entertainment experiences, and heuristic and systematic processing. In a second study, we established the definitional correspondence and comprehensibility of items to identify best-fitting single-items per construct (N = 106, content-related validity evidence, preregistration: https://osf.io/uxs63/?view_only=2f1a1b235b7b4ccb9c27be4e368579da). In a third study, we recruited 400 participants via Prolific and asked them about four recent media use situations to test whether the selected single-item measures correlate with the full scales and with other constructs as expected (evidence regarding relationships with criteria, preregistration: https://osf.io/9a4rc/?view_only=5cef436c0aba46cfa417e61a0b88f0f6). In a fourth study, we will develop several vignettes per construct in order to test the single-item measures’ situational variability as this is a key requirement for situational measures. The final study will include testing the single-item measures in an ESM study. We will present the results of at least Study 1-4.
129Experience sampling / validation / single-items / measurement