Inter-observer reliability using the General Movement Assessment is influenced by rater experience

Abstract

Objective To describe the inter-observer reliability of the General Movement Assessment (GMA) among a sample of infants at high-risk of cerebral palsy (CP) among raters with various levels of experience. Methods Video assessments of 150 high-risk infants at 10–15 weeks corrected age were rated by three Prechtl GMA-certified observers with varied experience using the assessment. Videos were scored based on temporal organization of fidgety movements (FMs), presence of abnormal FMs, or absence of FMs. Inter-observer agreements were analyzed with Gwet's AC1 statistic. Results We found fair to moderate agreement when subcategories of normal FMs (continuous and intermittent) were included (AC1 = 0.32–0.57) and moderate to near perfect agreement when normal categories of FMs were combined (AC1 = 0.60–0.95). Reliability was higher among observers with more experience using the GMA (AC1 = 0.57–0.98) than the observer with less experience (AC1 = 0.32–0.61). Conclusions Caution may be warranted when the GMA is used to differentiate “continuous and intermittent” FMs temporal organization. The GMA is highly reliable among experienced raters when comparing normal FMs to other FMs categorizations.

Inter-observer reliability using the General Movement Assessment is influenced by rater experience