The Minimal Clinically-Important Difference (MCID) on the Vineland-II: Analysis of Data from 3,400 Individuals with ASD

Friday, May 12, 2017: 12:00 PM-1:40 PM
Golden Gate Ballroom (Marriott Marquis Hotel)
F. Bolognani1, T. Charman2, C. H. Chatham3, X. Liogier D’ardhuy4, M. del Valle Rubido5, E. Eule6, A. Fedele7, A. Y. Hardan8, E. Loth9, L. Murtagh5, A. San Jose Caceres10, L. Sikich11, L. Snyder12, K. Taylor13, J. Tillmann2, P. E. Ventola14, K. L. Walton-Bowen15, P. Wang16 and T. Willgoss17, (1)Neuroscience, Ophthalmology, and Rare Diseases (NORD), Roche Pharma Research and Early Development, Roche Innovation Center Basel, F. Hoffmann - La Roche AG, Basel, Switzerland, (2)Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United Kingdom, (3)Neuroscience, Ophthalmology, and Rare Diseases (NORD) Roche Pharma Research and Early Development. Roche Innovation Center Basel, Hoffmann La Roche, Basel, Switzerland, (4)​Neuroscience, Ophthalmology and Rare Diseases, F. Hoffmann-La Roche Ltd, Basel, Switzerland, (5)F. Hoffmann - La Roche AG, Basel, SWITZERLAND, (6)?Roche Pharmaceutical Research and Early Development - NORD, Basel, SWITZERLAND, (7)Autism Speaks, Mullica Hill, NJ, (8)Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, (9)Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United Kingdom, (10)Forensic and Neurodevelopmental Sciences, King's College, London, United Kingdom of Great Britain and Northern Ireland, (11)Duke Center for Autism and Brain Development, Durham, NC, (12)Simons Foundation, New York, NY, (13)Neuroscience, Ophthalmology, and Rare Diseases (NORD) Roche Pharma Research and Early Development Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd, Basel, Switzerland, (14)Yale Child Study Center, New Haven, CT, (15)Seaside Therapeutics, Cambridge, MA, (16)Pediatrics, Yale University School of Medicine, New Haven, CT, (17)Hoffmann-La Roche, Basel, Switzerland
Background: Autism Spectrum Disorder (ASD) is associated with impairments in adaptive abilities in multiple domains including personal, social, and communication. Relative to age-matched peers, these impairments become increasingly pronounced across development, and are present regardless of comorbid intellectual disability. The Vineland Adaptive Behavior Scales, Second Edition (VinelandTM-II) is the most commonly used instrument for quantifying these impairments but Minimal Clinically-Important Differences (MCIDs) on the VinelandTM-II have never been established. Determining MCIDs for the VinelandTM-II would facilitate the evaluation of new interventions for ASD, given the increasing use of the VinelandTM-II in clinical trials.

Objectives: To generate anchor-based and distribution-based estimates of the MCID on the VinelandTM-II adaptive behavior composite and standard scores for the socialization, communication and daily living subdomains.

Methods: We pooled data from several consortia/registries (EU-AIMS LEAP study, ABIDE-I, ABIDE-II, INFOR, Simons Simplex Collection) and clinical trials (Stanford, Yale, Roche). Quality control procedures were applied to the combined dataset (n>3,400 individuals), including the re-derivation of domain-level scores and outlier exclusion. The combined sample was stratified by age (children, adolescents and adults) and presence of comorbid intellectual disability (full-scale IQ < 70). Within each stratum, we adjusted for the fixed effects of age, gender, full-scale IQ, and the method of Vineland administration; we also adjusted for the random effect of dataset where possible. Two approaches were used to estimate the MCID: distribution-based methods and anchor-based methods. Distribution-based MCIDs include the standard error of the measurement, as well as one-fifth and one-half the covariate-adjusted standard deviation (both cross-sectionally [3,467 observations] and longitudinally [348 observations]). Anchor-based MCIDs include the slope of linear regression of CGI-S on Vineland score (630 observations), the slope of linear regression of CGI-I category on Vineland change (848 observations), the Vineland change score maximally differentiating minimal from no improvement on the CGI-I, the linking equation (Fayers & Hays, 2014), and equipercentile equating. Each MCID is reported separately, in addition to sample size-weighted averages for each MCID approach (anchor- vs. distribution-based).

Results: A Working Group was formed with representatives from Autism Speaks, Duke, King’s College London, Roche, Simons Foundation, Stanford, and Yale. The first outcome was a consensus Statistical Analysis Plan (SAP) describing the QC process and methods for MCID estimation. At the time of writing, estimates of the VinelandTM-II MCID individuals fall within the range of 1.83 to 4.67 points for the Vineland composite score across strata (d-MCID range: 1.83-3.15; a-MCID range: 2.05-4.67), with a trend towards lower MCIDs in the younger and intellectually-disabled populations due to increased variance among adults. MCIDs will be further refined as our pooled sample size increases.

Conclusions:  Collaboration across academia, advocacy groups, and industry is critical to establishing a consensus on interpretation of clinical endpoints. Use of the VinelandTM-II as an outcome instrument must take into account both the statistical and clinical significance of any observed change. Our ongoing analyses will inform the evaluation of new interventions for ASD by providing estimates of the Vineland™-II MCID across a wide range of ages and intellectual abilities.