Intrajudge and Interjudge Reliability of the Stuttering Severity Instrument–Fourth Edition

Purpose

The Stuttering Severity Instrument (SSI) is a tool used to measure the severity of stuttering. Previous versions of the instrument have known limitations (e.g., Lewis, 1995). The present study examined the intra- and interjudge reliability of the newest version, the Stuttering Severity Instrument–Fourth Edition (SSI-4) (Riley, 2009).

Method

Twelve judges who were trained on the SSI-4 protocol participated. Judges collected SSI-4 data while viewing 4 videos of adults who stutter at Time 1 and 4 weeks later at Time 2. Data were analyzed for intra- and interjudge reliability of the SSI-4 subscores (for Frequency, Duration, and Physical Concomitants), total score, and final severity rating.

Results

Intra- and interjudge reliability across the subscores and total score concurred with the manual's reported reliability when reliability was calculated using the methods described in the manual. New calculations of judge agreement produced different values from those in the manual—for the 3 subscores, total score, and final severity rating—and provided data absent from the manual.

Conclusions

Clinicians and researchers who use the SSI-4 should carefully consider the limitations of the instrument. Investigation into the multitasking demands of the instrument may provide information on whether separating the collection of data for specific variables will improve intra- and interjudge reliability of those variables.

http://article/doi/10.1044/2017_AJSLP-16-0079/2652715/Intrajudge-and-Interjudge-Reliability-of-the