Elizabeth Boggs, Nori Minich, Anna Maria Hibbs
Department of Pediatrics, Case Western Reserve University, Cleveland, USA.
School of Medicine, Case Western Reserve University, Cleveland, USA.
DOI: 10.4236/ojped.2013.33045   PDF    HTML     3,964 Downloads   5,942 Views   Citations

Abstract

Background: Items from respiratory questionnaires validated in older children are often used in research studies of preterm infants, although they have not been validated in this population. We aimed to assess both test-retest reliability and convergent validity of a group of commonly used respiratory questionnaire items in a cohort of preterm infants. Methods: The health status of 300 preterm infants was assessed by telephone questionnaire as part of a prospective cohort study. The questionnaire items analyzed in this study included six commonly used respiratory questions. The questionnaire responses used in this analysis were from the telephone follow-up in this cohort at six months of age adjusted for prematurity. A repeat interview one to two weeks after this interview was performed in a subset of subjects to assess test-retest reliability. The convergent validity of the respiratory items was also assessed by calculating the associations among the responses to the respiratory questions. Results: A total of 43 infants were singletons that met the criteria for test-retest reliability analysis. All of the respiratory questions demonstrated fair to strong test-retest reliability. Among 206 respondents, respiratory questionnaire items also demonstrated strong convergent validity, in that caretakers reporting wheezing or whistling in the chest were significantly more likely to also report other respiratory events. Conclusions: This selection of standard respiratory questionnaire items performed well for research purposes in this population.

Keywords

Respiratory Questionnaire; Preterm; Wheeze

Share and Cite:

1. INTRODUCTION

Persistent wheezing in the first year of life is a common and long-lasting complication of prematurity [1,2,3-7]. Preterm infants born at less than 37 weeks gestational age (GA) are more likely than term-born infants to experience wheezing in infancy and also to develop asthma [2,4,8-12]. While several questionnaires assessing respiratory health have been well-validated in older children, their performance in infants, and in particular preterm infants, have not been well assessed [13-19].

Non-invasive questionnaire-based assessments of the respiratory outcomes of neonatal intensive care unit (NICU) graduates often borrow from validated questionnaires designed for older children, often those with asthma. For instance, in the follow-up of trials testing interventions to decrease bronchopulmonary dysplasia, parent-perceived wheezing is often assessed by asking about “wheezing and whistling in the chest”, a phrasing borrowed from questionnaires such as the International Study of Asthma and Allergies (ISAAC) questionnaire [17,18] and American Thoracic Society child questionnaire ATS-DLD-78-C [19]. In addition, parental reports of medical interventions, such as hospitalization, physician diagnoses, or prescription of medications, are also frequently used as markers of the long-term pulmonary status of infants born preterm [20-26]. Such questions have been used in the follow-up assessments of major multi-center trials studying preterm infants (e.g. NO CLD [NCT00006401] [14,20] and SUPPORT [NCT- 00233324]) [21,22,27]. However, the reliability and validity of these questions in the premature population have not been established.

The objective of this study was to assess the performance of a group of commonly used respiratory questionnaire items in a preterm cohort. We aimed to both assess the test-retest reliability and explore the convergent validity of this set of questionnaire items. We hypothesized that the items would demonstrate good test-retest reliability and that the responses to questions about respiratory morbidity, such as parental reports of “wheezing or whistling in the chest” or inhaled medication use, would be highly correlated with each other.

2. METHODS

2.1. Population

As part of a prospective cohort study of 300 preterm infants, “Gastrointestinal Risk Factors for Wheezing in Premature Infants (GRWPI)”, health status was assessed by telephone questionnaire at 3, 6, 9, and 12 months of age adjusted for prematurity. This study enrolled infants born at 28^0/7 - 34^6/7 GA. Infants with bronchopulmonary dysplasia (supplemental oxygen requirement >28 days), major anomalies, severe neurological injury, or a history of necrotizing colitis were excluded from the study. All participants were born at or transferred to Rainbow Babies and Children’s Hospital.

2.2. Performance of Questionnaire Items

This analysis of the performance of the respiratory items on the questionnaire focused on the assessment at 6 months adjusted age. At this time point, a repeat interview was planned one to two weeks after the primary interview in the first 60 infants that were followed. The analysis of test-retest reliability was restricted to singletons for whom the same caretaker participated in both interviews.

The questionnaire items analyzed in this study included the following:

“Has your child had wheezing or whistling in the chest?”

“Has a doctor diagnosed your child with wheezing or asthma?”

“Has your child had a respiratory infection, such as a cold, bronchiolitis, or pneumonia?”

“Has your child been diagnosed with RSV, or Respiratory Syncytial Virus?”

“Has your child been seen in the emergency room for a breathing problem?”

“Has your child been admitted to the hospital for a breathing problem?”

Answer choices were “yes,” “no,” and “unsure”. “Unsure” answers were treated as missing.

2.3. Convergent Validity

Odds of reporting a concurrent respiratory event given positive responses to another respiratory questionnaire item were calculated to assess internal consistency and convergent validity. An additional non-respiratory questionnaire item “In the past week, has your child refused a feed when hungry?” was included as a control.

2.4. Statistical Analysis

Test-retest reliability was assessed using both Cohen’s kappa and percent agreement. Associations between markers of respiratory morbidity (e.g. hospitalization and medication use) were assessed with odds ratios, Chi square’s, and Fischer’s exact tests. Statistical analyses were performed with Stata version 9.2 (StataCorp, College Station, TX).

3. RESULTS

Two hundred seventy nine infants were followed at the six month time point (93% follow up). Of these, 206 were singletons meeting criteria for the analysis. The chronological age of participants at this interview ranged from 206 to 278 days (Table 1).

Test and retest respiratory interviews were conducted

in 61 infants, as opposed to the goal of 60, due to the presence of twins in the sample. Among the 61 infants, 43 met criteria for the test-retest reliability analysis. Demographic characteristics for the test-retest subset were generally representative of the whole cohort (Table 1). Repeat administrations of the questionnaire were done 6 - 19 days after the first administration.

In this relatively healthy population of preterm infants, several of the questions had a low rate of positive responses. Doctor diagnoses of wheezing or asthma, RSV infections, ER visits for breathing problems, and hospital admissions for breathing problems were the least frequently reported markers of respiratory morbidity. Wheezing and whistling in the chest and respiratory infections had the highest reported rates (Table 2).

All of the respiratory questions demonstrated fair to strong test-retest reliability (Table 2). The strongest agreement existed for doctor diagnosis of wheezing or asthma, hospital admissions for breathing problems, and RSV infections. ER visits for a breathing problem and wheezing and whistling in the chest also demonstrated substantial agreement.

Convergent validity was assessed by calculating the odds of a caretaker answering an item affirmatively if they had also answered another item affirmatively (Table 3). Notably, caretakers reporting parental recognition

of wheezing or whistling in the chest were significantly more likely to also report a doctor diagnosis of wheezing, respiratory infection, RSV infection, ER visit for a breathing problem, hospitalization, and use of inhaled or use of oral steroids to address a breathing problem. Refusal to feed was significantly correlated with wheezing and whistling in the chest and doctor diagnosis of RSV infection, though overall it was not strongly correlated with this set of respiratory questions.

4. CONCLUSIONS

We assessed the performance of commonly used respiratory questionnaire items in a cohort of relatively healthy preterm infants. All of the respiratory questions demonstrated fair to strong test-retest reliability. Furthermore, these items demonstrated convergent validity; the markers of respiratory severity assessed were strongly associated with each other. Taken together, these results suggest that these standard respiratory questions perform well for research purposes in this population.

In the analysis of test-retest reliability, respiratory events with lower rates of positive responses tended to demonstrate better agreement. This is likely due to the fact that the less frequent events, such as hospitalization, may also be more salient for the parent. However, rare outcomes are non-ideal primary endpoints for research studies due to their impact on sample-size. Furthermore, hospitalization may be driven by a number of nonmedical factors [28-35]. The more frequently reported parental recognition of symptomatic wheezing or whistling in the chest may be an outcome prone to more “noise” from misclassification; however, in real-world clinical interactions, physicians often rely on parental reports of symptom burden to drive care. Thus, studies wishing to assess respiratory morbidity by parental questionnaire benefit by capturing several complementary outcomes, which, as we have shown, do demonstrate strong convergent validity.

Interestingly, doctor diagnosis of wheezing or asthma performed very well in terms of test-retest reliability, yet it was the only item that was not significantly associated with other respiratory events in the exploration of convergent validity. One possible reason for this outcome is that the question “Has a doctor diagnosed your child with wheezing or asthma?” is a compound question, in that wheezing and asthma are two different diagnoses. A compound question was asked instead of a traditional wording validated in older children about doctor-diagnosed asthma due to reluctance of many practitioners to differentiate between wheezing and asthma in infants less than one year old. However, this may have weakened the performance of the question. Another possible reason for this outcome is that it reflects a true lack of association between doctor diagnosis and the other items assessed, perhaps due to a different threshold for using or recalling symptomatic treatment versus the application of a diagnostic label. Perhaps unsurprisingly, refused feed was correlated with wheezing and whistling in the chest and diagnosis of RSV infection, both indicators of symptomatic illness. Overall, this question did not correlate significantly with most of the respiratory questions, an indicator that correlation among respiratory items was not primarily driven by a general tendency of parents to affirm symptoms.

This study has several limitations. While these respiratory questions perform well in terms of test-retest reliability and convergent validity, it is noteworthy that the responses are not matched against medical records, thus we cannot assess the accuracy of these results. Furthermore, this analysis is a limited assessment of the performance of a series of commonly used respiratory questionnaire items. While it represents a first step in the assessment of the performance of these items in the preterm population, it is not a full validation of a freestanding questionnaire.

Nevertheless, this study offers reassurance that questionnaire items commonly used to asses respiratory outcomes in preterm infants perform well in terms of testretest reliability and convergent validity. Reliable and valid non-invasive measures are ideal assessment tools in a medically fragile population in whom more invasive testing of pulmonary status may be both medically risky and expensive. Furthermore, respiratory symptoms and resource utilization may reflect the experience of patients and families better than physiologic measures. Though this study is an initial step in fully validating a questionnaire in this population, so far the performance of these commonly used items suggests that their use in studies of preterm infants is sound. Future work is needed to develop a fully validated questionnaire to standardize the assessment of respiratory status in preterm infants.

5. ACKNOWLEDGEMENTS

Other Contributions: We acknowledge the funding received from the National Institutes of Health [K23 HD056299].

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Elder, D.E., Hagan, R., Evans, S.F., Benninger, H.R. and French, N.P. (1996) Recurrent wheezing in very preterm infants. Archives of Disease in Childhood Fetal and Neonatal Edition, 74, F165-F171. doi:10.1136/fn.74.3.F165
[2]	Greenough, A., Limb, E., Marston, L., Marlow, N., Calvert, S. and Peacock, J. (2005) Risk factors for respiratory morbidity in infancy after very premature birth. Archives of Disease in Childhood Fetal and Neonatal Edition, 90, F320-F323. doi:10.1136/adc.2004.062018
[3]	Evans, M., Palta, M., Sadek, M., Weinstein, M.R. and Peters, M.E. (1998) Associations between family history of asthma, bronchopulmonary dysplasia, and childhood asthma in very low birth weight children. American Journal of Epidemiology, 148, 460-466. doi:10.1093/oxfordjournals.aje.a009671
[4]	Hack, M., Taylor, H.G., Drotar, D., et al. (2005) Chronic conditions, functional limitations, and special health care needs of school aged children born with extremely low birth weight in the 1990s. Journal of the American Medical Association, 294, 318-325. doi:10.1001/jama.294.3.318
[5]	Halvorsen, T., Skadberg, B.T., Eide, G.E., Roksund, O.D., Carlsen, K.H. and Bakke, P. (2004) Pulmonary outcome in adolescents of extreme preterm birth: A regional cohort study. Acta Paediatrica, 93, 1294-1300. doi:10.1111/j.1651-2227.2004.tb02926.x
[6]	Korhonen, P., Laitinen, J., Hyodynmaa, E. and Tammela, O. (2004) Respiratory outcome in school-aged, very-lowbirth-weight children in the surfactant era. Acta Paediatrica, 93, 316-321. doi:10.1111/j.1651-2227.2004.tb02954.x
[7]	Palta, M., Sadek-Badawi, M., Sheehy, M., et al. (2001) Respiratory symptoms at age 8 years in a cohort of very low birth weight children. American Journal of Epidemiology, 154, 521-529. doi:10.1093/aje/154.6.521
[8]	Milner, J.D., Stein, D.M., McCarter, R. and Moon, R.Y. (2004) Early infant multivitamin supplementation is associated with increased risk for food allergy and asthma. Pediatrics, 114, 27-32. doi:10.1542/peds.114.1.27
[9]	Raby, B.A., Celedon, J.C., Litonjua, A.A., Phipatanakul, W., Sredl, D., Oken, E., Ryan, L., Weiss, S.T. and Gold, D.R. (2004) Low-normal gestational age as a predictor of asthma at 6 years of age. Pediatrics, 114, 327-332. doi:10.1542/peds.2003-0838-L
[10]	Boyle, E., Poulsen, G., Field, D., Kurinczuk, J., Wolke, D., Alfirevic, Z. and Quigley, M. (2012) Effects of gestational age at birth on health outcomes at 3 and 5 years of age: Population based cohort study. BMJ, 344, Article ID: e896. doi:10.1136/bmj.e896
[11]	Greenough, A. (2012) Long term respiratory outcomes of very premature birth (<32 weeks). Seminars in Fetal and Neonatal Medicine, 17, 73-76. doi:10.1016/j.siny.2012.01.009
[12]	Goyal, N., Fiks, A. and Lorch, S. (2011) Association of late-preterm birth with asthma in young children: Practice-based study. Pediatrics, 128, 830-838. doi:10.1542/peds.2011-0809
[13]	Martinez, F.D., Wright, A.L., Taussig, L.M., Holberg, C.J., Halonen, M. and Morgan, W.J. (1995) Asthma and wheezing in the first six years of life. The Group Health Medical Associates. New England Journal of Medicine, 332, 133-138. doi:10.1056/NEJM199501193320301
[14]	Ballard, R.A., Truog, W.E., Cnaan, A., et al. (2006) Inhaled nitric oxide in preterm infants undergoing mechanical ventilation. New England Journal of Medicine, 355, 343-353. doi:10.1056/NEJMoa061088
[15]	Celedon, J.C., Litonjua, A.A., Ryan, L., Weiss, S.T. and Gold, D.R. (2002) Bottle feeding in the bed or crib before sleep time and wheezing in early childhood. Pediatrics, 110, Article ID: e77. doi:10.1542/peds.110.6.e77
[16]	Asmussen, L., Olson, L.M., Grant, E.N., Fagan, J. and Weiss, K.B. (1999) Reliability and validity of the children’s health survey for Asthma. Pediatrics, 104, Article ID: e71. doi:10.1542/peds.104.6.e71
[17]	Asher, M.I., Keil, U., Anderson, H.R., Beasley, R., Crane, J., Martinez, F., et al. (1995) International Study of Asthma and Allergies in Childhood (ISAAC): Rationale and methods. European Respiratory Journal, 8, 483-491. doi:10.1183/09031936.95.08030483
[18]	Jenkins, M.A., Clarke, J.R., Carlin, J.B., Robertson, C.F., Hopper, J.L., Dalton, M.F., et al. (1996) Validation of questionnaire and bronchial hyperresponsiveness against respiratory physician assessment in the diagnosis of asthma. International Journal of Epidemiology, 25, 609-616. doi:10.1093/ije/25.3.609
[19]	Ferris, B.G. (1978) Epidemiology standardization project (American thoracic society). American Review Respiratory Distress, 118, 1-120.
[20]	Hibbs, A.M., Walsh, M.C., Martin, R.J., Truog, W.E., Lorch, S.A., Alessandrini, E., Cnaan, A., Palermo, L., Wadlinger, S.R., Coburn, C.E., Ballard, P.L. and Ballard, R.A. (2008) One-year respiratory outcomes of preterm infants enrolled in the nitric oxide (to prevent) chronic lung disease trial. Journal of Pediatrics, 153, 525-529. doi:10.1016/j.jpeds.2008.04.033
[21]	Carlo, W.A., Finer, N.N., Walsh, M.C., et al. (2010) Target ranges of oxygen saturation in extremely preterm infants. New England Journal of Medicine, 362, 1959-1969. doi:10.1056/NEJMoa0911781
[22]	Finer, N.N., Carlo, W.A., Walsh, M.C., et al. (2010) Early CPAP versus surfactant in extremely preterm infants. New England Journal of Medicine, 362, 1970-1979. doi:10.1056/NEJMoa0911783
[23]	Ehrenkranz, R., Walsh, M., Vohr, B., Jobe, A., Wright, L., Wrage, L. and Poole, K. (2005) Validation of the National Institutes of Health consensus definition of bronchopulmonary dysplasia. Pediatrics, 116, 1353-1360. doi:10.1542/peds.2005-0249
[24]	Greenough, A., Shaheen, S.O., Shennan, A., Seed, P.T. and Poston, L. (2010) Respiratory outcomes in early childhood following antenatal Vitamin C and E supplementation. Thorax, 65, 998-1003. doi:10.1136/thx.2010.139915
[25]	Marlow, N., Greenough, A., Peacock, J.L., et al. (2006) Randomised trial of high frequency oscillatory ventilation or conventional ventilation in babies of gestational age 28 weeks or less: Respiratory and neurological outcomes at 2 years. Archives of Disease in Childhood Fetal and Neonatal Edition, 91, F320-F326. doi:10.1136/adc.2005.079632
[26]	Davis, J.M., Parad, R.B., Michele, T., Allred, E., Price, A. and Rosenfeld, W. (2003) Pulmonary outcome at 1 year corrected age in premature infants treated at birth with recombinant human CuZn superoxide dismutase. Pediatrics, 111, 469-476. doi:10.1542/peds.111.3.469
[27]	Marlow, N., Greenough, A., Peacock, J.L., et al. (2006) Randomised trial of high frequency oscillatory ventilation or conventional ventilation in babies of gestational age 28 weeks or less: Respiratory and neurological outcomes at 2 years. Archives of Disease in Childhood Fetal and Neonatal Edition, 91, F320-F326. doi:10.1136/adc.2005.079632
[28]	Keatinge, W.R. and Donaldson, G.C. (2005) Changes in mortalities and hospital admissions associated with holidays and respiratory illness: Implications for medical services. Journal of Evaluation in Clinical Practice, 11, 275-281. doi:10.1111/j.1365-2753.2005.00533.x
[29]	Griffiths, C., Sturdy, P., Naish, J., Omar, R., Dolan, S. and Feder, G. (1997) Hospital admissions for asthma in east London: Associations with characteristics of local general practices, prescribing, and population. BMJ, 314, 482-486. doi:10.1136/bmj.314.7079.482
[30]	Brameld, K.J. and Holman, C.D. (2006) Demographic factors as predictors for hospital admission in patients with chronic disease. Australina and New Zealand Journal of Public Health, 30, 562-566. doi:10.1111/j.1467-842X.2006.tb00787.x
[31]	Ferraro, K.F., Thorpe Jr., R.J., McCabe, G.P., KelleyMoore, J.A. and Jiang Z. (2006) The color of hospitalization over the adult life course: Cumulative disadvantage in black and white? Journal of Gerontology Series B: Psychological Sciences and Social Sciences, 61, S299-S306. doi:10. 1093/geronb/61.6.S299
[32]	Watson, J.P., Cowen, P. and Lewis, R.A. (1996) The relationship between asthma admission rates, routes of admission, and socioeconomic deprivation. European Respiratory Journal, 9, 2087-2093. doi:10.1183/09031936.96.09102087
[33]	Alpern, E.R., Stanley, R.M., Gorelick, M.H., Donaldson, A., Knight, S., Teach, S.J., et al. (2006) Epidemiology of a pediatric emergency medicine research network: The PECARN core data project. Pediatric Emergency Care, 22, 689-699. doi:10.1097/01.pec.0000236830.39194.c0
[34]	Wynne, J. and Hull, D. (1977) Why are children admitted to hospital? British Medical Journal, 2, 1140-1142. doi:10.1136/bmj.2.6095.1140
[35]	Krug, S.E., Paul, R.I., Chessare, J.B., Christopher, N. and Satkowiak, L. (1997) Hospital admissions of children from the emergency department: Are decisions regarding children on public assistance different? Pediatric Emergency Care, 13, 87-91. doi:10.1097/00006565-199704000-00001