Original Articles
A Comparison of Measures of Adjustment, Symptoms, and Impairment among Children with Chronic Medical Conditions

https://doi.org/10.1097/00004583-199608000-00013Get rights and content

ABSTRACT

Objective

To examine the concurrent and criterion validity of three instruments used to measure emotional and behavioral problems among children with chronic illness.

Method

The Personal Adjustment and Role Skills Scale (PARS III), Child Behavior Checklist (CBCL), and Columbia Impairment Scale (CIS) were compared with each other and with structured interview-derived psychiatric diagnoses in 116 chronically ill children, aged 9 to 18 years. Three cutoff scores were used for each measure.

Results

The measures had good concurrent validity despite only moderate agreement with each other. Their criterion validity was only fair: levels of sensitivity were fair at low cutoffs and poor at standard and high cutoffs; specificity and positive predictive values rose from moderate at low cutoffs to high at standard and high cutoffs. The agreement between the scales and a mental disorder diagnosis was only moderate at any of the cutoff points.

Conclusions

Each of these measures has significant limitations. Both the CBCL and the PARS III appear to measure similar constructs but are likely to underidentify medically ill children with comorbid psychiatric problems. Consideration of global functioning across domains, with a measure such as the CIS, might provide an alternative approach to behavioral and symptom checklists in the assessment and management of children with chronic conditions.

REFERENCES (38)

  • American Psychiatric Association

    Diagnostic and Statistical Manual of Mental Disorders, 3rd edition-revised (DSM-III-R)

    (1987)
  • RA Barkley

    Child behavior rating scales and checklists

  • HR Bird et al.

    Further measures of the psychometric properties of the Children's Global Assessment Scale

    Arch Gen Psychiatry

    (1987)
  • HR Bird et al.

    The Columbia Impairment Scale (CIS): pilot findings on a measure of global impairment for children and adolescents

    Int J Methods Psychiatry

    (1993)
  • EH Canning et al.

    Performance of screening tools for mental health problems in chronically ill children

    Arch Pediatr Adolesc Med

    (1994)
  • LH Daltroy et al.

    Psychosocial adjustment in juvenile arthritis

    J Pediatr Psychol

    (1992)
  • C Eiser

    Chronic Childhood Disease: An Introduction to Psychological Theory and Research

    (1990)
  • C Eiser et al.

    Adjustment to chronic disease in relation to age and gender: mothers' and fathers' reports of their children's behavior

    J Pediatr Psychol

    (1992)
  • JM Fletcher et al.

    Behavioral adjustment of children with hydrocephalus: relationships with etiology, neurology, and family status

    J Pediatr Psychol

    (1995)
  • Cited by (58)

    • Examining psychotropic medication use among youth in the U.S. by race/ethnicity and psychological impairment

      2017, General Hospital Psychiatry
      Citation Excerpt :

      The CIS has excellent psychometric properties, correlates well with the Children's Global Assessment Scale, referral for mental health services, academic performance and school difficulties [27,25], and has been shown to have reliability and validity among diverse racial, ethnic and socioeconomic populations [28]. We utilized a cutoff score of 16 in this pediatric sample, which has shown moderate agreement with DSM diagnoses (kappa, 0.48; sensitivity, 0.44; specificity, 0.96; positive predictive value, 0.79) [29]. To assess disparities under conditions of greater sensitivity, we conducted sensitivity analyses lowering the cutoff score to 12 +.

    • Medical and Psychiatric Comorbidities in Children and Adolescents: A Guide to Issues and Treatment Approaches

      2010, Nursing Clinics of North America
      Citation Excerpt :

      These include the health care context, specifically illness management, adherence to care, and the child’s response to medical procedures, school context, such as academic performance and school attendance, and peer context, such as relationships and interactions with peers.4 Poor psychological adjustment to a medical illness is characterized by emotional distress, developmental delays, poor adherence to medical treatment, poor peer relationships, poor school performance, and behavioral problems.4,6 In addition to models of psychological adjustment, stress and coping models have been developed to illustrate the factors that influence a child’s response to a chronic medical illness.

    • Comparing the convergent validity and clinical utility of the Behavior Assessment System for Children-Parent Rating Scales and Child Behavior Checklist in children with epilepsy

      2008, Epilepsy and Behavior
      Citation Excerpt :

      The high rates of psychopathology captured during the current study cannot be regarded as definitive estimates of psychopathology in this population given that quantitative rating scales may not accurately capture the true level of symptomotology in chronically ill populations. CBCL scores, in particular, have reportedly been over-sensitive to impairment in this cohort [41,42]. Although commonly-administered in studies of children with medical illnesses including cystic fibrosis [43], diabetes mellitus [44], cancer [45], asthma [46], and inflammatory bowel disease [47], concerns exist regarding the usefulness of the CBCL in populations with chronic somatic complaints.

    • Adjunctive Treatments for Childhood Disorders

      2008, Evidence-Based Adjunctive Treatments
    • Depression and Anxiety in Children at the End of Life

      2007, Pediatric Clinics of North America
      Citation Excerpt :

      The use of standardized screening measures is also an option. It was originally thought that self-report screening measures, which are sometimes used in the general pediatric population, were invalid in chronically ill patients [29–31]. However, the Children's Depression Inventory (CDI) and other similar measures have been evaluated in medically ill children and were found to be reasonably accurate in predicting depression and distress [23,32–34].

    View all citing articles on Scopus

    This study was supported by a Scientist Development Award for Clinicians ( K20 MH-00864) from the NIMH, Rockville, MD; a Biomedical Research Support Grant ( RR05353) from the Division of Research Resources, NIH, Bethesda, MD; a grant from the Stanford Center for the Study of Families, Children, & Youth (to E.S.H.); a National Research Service Award ( T32 MH-15169) (to R.D.C.); and funding from the Staunton Farm Foundation, Pittsburgh (to K.J.K.).

    View full text