education & teaching

ONLINE APPENDIX

Three concerns with this study are that estimated relationships between diagnosis and future school behaviors may be artifacts of (1) the cut-point used to differentiate children with less severe versus more severe pre-diagnosis behaviors, (2) modeling strategy, or (3) stable unobserved differences between the teachers/classrooms of diagnosed and undiagnosed children. One reason results may be idiosyncratic to use of a 25th percentile cut-point is if, for example, diagnosed children are clustered around the 25th percentile cut-point. Resulting estimates may be upwardly biased for children with less severe pre-diagnosis behaviors and downwardly biased for children with more severe pre-diagnosis behaviors. However, estimates using cut-points ranging from the 10th to the 60th percentiles of the aggregate measure of pre-diagnosis ADHD-related behaviors are roughly stable, especially between the 15th and 50th percentile severity cut-points for children with less severe pre-diagnosis behavior problems (see Appendix Figure A.1; note that externalizing problems are reverse-coded so scales are comparable across outcomes). This indicates that results are not driven by choice of idiosyncratic cut-point. To assess whether PSM estimates are driven by modeling strategy, OLS estimates from the 25th percentile cut-point can be compared to the PSM estimates in the main text. Although estimates from the controlled OLS models tend to be larger in absolute values due to lesser sample balance, the general pattern of differences by severity group remains similar.

To examine whether results are driven by stable unobserved differences between the teachers/classrooms of diagnosed versus undiagnosed children (e.g., differences in class sizes or instructional practices that lead to differing constraints/supports or tolerance of behavioral issues), estimates are generated for diagnosed and undiagnosed children with the same teachers in 5th grade (Appendix Tables A.3 and A.4). Estimated effects of diagnosis are roughly twice as large, likely reflecting poorer sample balance given that only 15 percent of sample students have at least one diagnosed sample student in class. (However, these fixed-effects estimates are smaller, on average, than comparable estimates from the clustered subsample without fixed effects, as would be expected.) Nonetheless, patterns of difference between children with less severe versus more severe pre-diagnosis ADHD-related behaviors are consistent: diagnosed and medicated children with less severe pre-diagnosis ADHD-related behaviors fare worse than children with more severe behaviors.

A final question pertains to the visibility of the diagnosis by teachers. Analysis to this point has assumed—but not tested—that the differing effects of an ADHD diagnosis by pre-diagnosis behavioral severity may result, in part, from teachers contributing to children’s psychological processing of their diagnosis (i.e., not only from the diagnosed child’s internalization of negative stereotypes or stigma). To explicitly examine this possibility, supplemental matching analyses examine special education/educational accommodations receipt as another moderator of the relationship between diagnosis and future school behaviors. It is reasonable to assume teachers are aware of a diagnosis if the child is receiving special education. Because the same matching techniques continue to be used to pair children who are diagnosed and receiving special education with undiagnosed matches with the same pre-diagnosis behaviors, cognitive skills, and other characteristics, matching minimizes the effects of differential selection into special education from driving the estimated effects of “diagnosis with special education/accommodations” on observed outcomes relative to undiagnosed matches. Estimated differences are instead attributed to teachers’ explicit knowledge of the diagnosis/service-use apart from the underlying behaviors or other observed characteristics, with all caveats about risk of omitted variables bias.

Because so few children in this sample are diagnosed and receive special education services or educational accommodations (“special education” for short) without medication, I separately estimated the effects of diagnosis within each severity group for three subgroups, each relative to their undiagnosed matches: (1) diagnosed and unmedicated, no special education; (2) diagnosed and medicated, no special education; and (3) diagnosed and medicated, receiving special education. This analysis reveals that the net negative marginal effects of diagnosis appear for all three groups. However, the magnitudes are descriptively (but not statistically significantly) larger for diagnosed children receiving special education. This suggests that teachers’ increased likelihood of knowledge of a child’s diagnosis/service-use (the “external” label) does increase the negative effects of diagnosis, but only descriptively.

 

Appendix Table A.1. Balance Statistics for PSM Model Estimating Net Marginal Effect of ADHD Diagnosis with Medication Treatment on Later Positive Learning-Related Behaviors in 5th Grade among Children with Less Severe Pre-diagnosis ADHD-Related Behavior Problems
Variable Unmatched (U)/ Matched (M) Treated Control t-statistic (treated-control) p>|t|
Inattentive Behaviors Score in 1st Grade/Wave Prior to Diagnosis (Parent Report) U 0.20 -0.14 4.14 0.00
M 0.20 0.18 0.12 0.91
Hyperactive Behaviors Score in 1st Grade/Wave Prior to Diagnosis (Parent Report) U 0.03 -0.16 2.71 0.01
M 0.03 -0.06 0.82 0.41
ODD or CD Behaviors Score in 1st Grade/Wave Prior to Diagnosis (Parent Report) U -0.19 -0.11 -1.66 0.10
M -0.19 -0.21 0.16 0.87
Inattentive Behaviors Score in 1st Grade/Wave Prior to Diagnosis (Teacher Report) U 0.07 -0.27 3.76 0.00
M 0.07 0.13 -0.51 0.61
Hyperactive Behaviors Score in 1st Grade/Wave Prior to Diagnosis (Teacher Report) U -0.09 -0.22 2.35 0.02
M -0.09 -0.08 -0.13 0.90
ODD or CD Behaviors Score in 1st Grade/Wave Prior to Diagnosis (Teacher Report) U -0.12 -0.21 1.33 0.19
M -0.12 -0.03 -1.13 0.26
Internalizing Behavior Problems Score in 1st Grade/Wave Prior to Diagnosis (Teacher Report) U 1.54 1.51 0.45 0.66
M 1.54 1.52 0.27 0.79
Lack of Positive Approaches to Learning Behavior Score in 1st Grade/Wave Prior to Diagnosis (Teacher Report) U 2.87 3.25 -4.99 0.00
M 2.87 2.83 0.44 0.66
Reading Score in Kindergarten (std.) U -0.23 0.03 -1.91 0.06
M -0.23 -0.23 0.04 0.97
Math Score in Kindergarten (std.) U -0.23 0.11 -2.66 0.01
M -0.23 -0.28 0.33 0.75
Child Received Any Special Education Services in Kindergarten U 0.09 0.11 -0.36 0.72
M 0.09 0.15 -0.88 0.38
Parental Participation in Educational Institutions U 3.90 3.88 0.16 0.87
M 3.90 3.94 -0.27 0.79
Child Activities and Leisure Time U 2.63 2.71 -0.62 0.53
M 2.63 2.78 -0.81 0.42
Parent Perceptions of Responsibilities Toward Child Cog. and Social Development U 10.18 10.36 -0.79 0.43
M 10.18 10.14 0.12 0.90
Number of Books at Home U 69.52 75.52 -1.36 0.17
M 69.52 75.71 -1.03 0.31
Parent Educational Expectations for Child in Kindergarten U 2.89 3.14 -1.82 0.07
M 2.89 2.69 0.99 0.32
Male U 0.69 0.47 3.20 0.00
M 0.69 0.64 0.60 0.55
Other Race/Ethnicity U 0.04 0.12 -1.87 0.06
M 0.04 0.02 0.58 0.56
Black U 0.07 0.09 -0.34 0.73
M 0.07 0.09 -0.34 0.73
Hispanic U 0.02 0.17 -2.99 0.00
M 0.02 0.00 1.00 0.32
Lives in Midwest in Kindergarten/First Wave Available U 0.36 0.28 1.29 0.20
M 0.36 0.35 0.20 0.84
Lives in Northeast in Kindergarten/First Wave Available U 0.11 0.19 -1.46 0.14
M 0.11 0.11 0.00 1.00
Child Born Weighing Less Than 5.5 lbs (LBW) U 0.07 0.07 -0.01 0.99
M 0.07 0.07 0.00 1.00
Child Not Covered by Insurance U 0.13 0.17 -0.79 0.43
M 0.13 0.11 0.29 0.77
Household Income Below Federal Poverty Line U 0.05 0.15 -1.91 0.06
M 0.05 0.04 0.45 0.65
Number of Other Children in Household in Kindergarten U 1.27 1.56 -1.86 0.06
M 1.27 1.31 -0.17 0.87
Child Age at Kindergarten Entry (in Months) U 66.26 65.64 1.04 0.30
M 66.26 66.15 0.13 0.90
Child Has Been in Childcare Outside Home U 0.58 0.49 1.30 0.19
M 0.58 0.53 0.57 0.57
Mother Has High School Education U 0.38 0.29 1.51 0.13
M 0.38 0.35 0.39 0.70
Mother Completed Some College U 0.27 0.30 -0.49 0.63
M 0.27 0.29 -0.21 0.83
Mother Completed Four-Year College U 0.33 0.32 0.04 0.97
M 0.33 0.35 -0.20 0.84
Current Mother Age at Kindergarten Round U 33.96 34.09 -0.16 0.87
M 33.96 34.07 -0.10 0.92
Mother has CES-D Score >9 (Clinically Depressive Symptoms) U 0.18 0.14 0.78 0.44
M 0.18 0.20 -0.24 0.81

 

Appendix Table A.2. Counts of Diagnosed and Undiagnosed Children by Pre-diagnosis ADHD-Related Severity (N = 7,290)
Pre-diagnosis Behavioral Severity: Undiagnosed Diagnosed
More Severe 1,680 230
Less Severe 5,290 90
Note: Counts rounded to the nearest 10 in compliance with NCES restricted-data reporting requirements.
Source: ECLS-K:98 children who were eligible for sampling and present at all waves used in the analyses, who had complete information on ADD/ADHD diagnosis and the outcome measures, and whose composite pre-diagnosis ADHD-related behaviors score did not fall below that of the diagnosed child with the least severe pre-diagnosis ADHD-related behaviors composite score or above that of the diagnosed child with the most severe pre-diagnosis ADHD-related behaviors composite score. Multiple imputation was used to produce 20 datasets to address item-missingness on variables other than the outcomes and ADHD diagnosis.

 

 

 

Appendix Table A.3. OLS Regression with Teacher Fixed Effects: Estimates of the Average Marginal Relationships between an ADHD Diagnosis and Future Social and Academic Behaviors (N = 5,640)
  Positive Approaches to Learning (Teacher Report), 5th Grade Externalizing Behavior Problems (Teacher Report), 5th Grade
  (1) (2)
Diagnosed with ADD/ADHD -0.67*** 0.42***
(0.05) (0.04)
(3) (4)
Diagnosed with ADD/ADHD, Receiving Medication -0.59*** 0.33***
(0.06) (0.05)
Diagnosed with ADD/ADHD, Not Receiving Medication -0.79*** 0.58***
(0.09) (0.08)
Note: Displaying OLS regression estimates including teacher fixed effects as well as controls for teacher and parent reports of early behavior scores in 1st grade/wave prior to diagnosis (i.e., hyperactivity behaviors, inattentive behaviors, and ODD/CD behaviors), teacher reports of internalizing behaviors, early cognitive ability (i.e., math and reading achievement in kindergarten), parenting, parent’s educational expectations in kindergarten, maternal depression, and demographic characteristics shown in Table 1. Models 1 and 2 estimate the average marginal effect of ADHD diagnosis without consideration of medication use or non-use following diagnosis; Models 3 and 4 show estimates for children who are diagnosed and subsequently receive medication separately from those who are diagnosed and do not subsequently receive medication (in all cases compared to undiagnosed children).
Source: ECLS-K:98 children who were eligible for sampling and present at all waves used in the analyses, who had complete information on ADD/ADHD diagnosis and the outcome measures, and whose composite pre-diagnosis ADHD-related behaviors score did not fall below that of the diagnosed child with the least severe pre-diagnosis ADHD-related behaviors composite score or above that of the diagnosed child with the most severe pre-diagnosis ADHD-related behaviors composite score. Multiple imputation was used to produce 20 datasets to address item-missingness on variables other than the outcomes and ADHD diagnosis.

*p < 0.05; **p < 0.01; ***p < 0.001.

 

Appendix Table A.4. OLS Regression with Teacher Fixed Effects: Estimates of the Average Marginal Relationship between an ADHD Diagnosis and Future Social and Academic Behaviors, by Pre-diagnosis ADHD-Related Behavioral Severity (N = 5,640)
  Positive Approaches to Learning (Teacher Report), 5th Grade Severity Diff? (p < 0.05) Externalizing Behavior Problems (Teacher Report), 5th Grade Severity Diff? (p < 0.05)
Pre-diagnosis ADHD-Related Behavioral Severity:
(1) (2)   (3) (4)  
  Less Severe
(N = 4,310)
More Severe

(N = 1,330)

  Less Severe
(N = 4,310)
More Severe (N = 1,330)  
Diagnosed with ADD/ADHD, Receiving Medication -0.55*** -0.26*** * 0.31*** 0.03 *
(0.11) (0.09) (0.09) (0.10)
Diagnosed with ADD/ADHD, Not Receiving Medication -0.68*** -0.28 + 0.30* 0.12
(0.17) (0.17)   (0.14) (0.17)  
Note: Displaying OLS regression estimates including teacher fixed effects as well as controls for propensity score (predicted probability of ADHD diagnosis), teacher and parent reports of early behavior scores in 1st grade/wave prior to diagnosis (i.e., hyperactivity behaviors, inattentive behaviors, and ODD/CD behaviors), teacher reports of internalizing behaviors, early cognitive ability (i.e., math and reading achievement in kindergarten), parenting, parent’s educational expectations in kindergarten, maternal depression, and demographic characteristics shown in Table 1.
Source: ECLS-K:98 children who were eligible for sampling and present at all waves used in the analyses, who had complete information on ADD/ADHD diagnosis and the outcome measures, and whose composite pre-diagnosis ADHD-related behaviors score did not fall below that of the diagnosed child with the least severe pre-diagnosis ADHD-related behaviors composite score or above that of the diagnosed child with the most severe pre-diagnosis ADHD-related behaviors composite score. Multiple imputation was used to produce 20 datasets to address item-missingness on variables other than the outcomes and ADHD diagnosis.

*p < 0.05; **p < 0.01; ***p < 0.001.

 

 

 

Appendix Table A.5. Propensity Score Matching Estimates of the Average Marginal Relationship between an ADHD Diagnosis and Future Social and Academic Behaviors, by Three Categories of Pre-diagnosis ADHD-Related Behavioral Severity (N = 7,290)
Positive Approaches to Learning (Teacher Report), 5th Grade    Externalizing Behavior Problems (Teacher Report), 5th Grade
(1) (2) (3)   (4) (5) (6)
  Low Severity

(N = 5,380)

Mid Severity

(N = 1,640)

High Severity

(N = 270)

  Low Severity

(N = 5,380)

Mid Severity

(N = 1,640)

High Severity

(N = 270)

Diagnosed with ADD/ADHD, Receiving Medication -0.34***a -0.19* -0.03a   0.27***a 0.11 0.01a
(0.08) (0.07) (0.07)   (0.07) (0.08) (0.08)
Diagnosed with ADD/ADHD, Not Receiving Medication -0.32*** -0.35*** -0.24* 0.19** 0.22*** 0.03a
(0.11) (0.07) (0.10)   (0.08) (0.06) (0.13)
aSignificant difference between low severity and high severity at p < 0.05.
Differences between low severity and mid severity and between mid severity and high severity are not statistically significant at p < 0.05.
None of the within-model differences by medication treatment status reach statistical significance at p < 0.05.
Note: Displaying propensity score matching estimates with coarsened exact matching on pre-diagnosis behavioral problem severity groups. Propensity scores generated from teacher and parent reports of early behavior scores in 1st grade/wave prior to diagnosis (i.e., hyperactivity behaviors, inattentive behaviors, and ODD/CD behaviors), teacher reports of internalizing behaviors, early cognitive ability (i.e., math and reading achievement in kindergarten), parenting, parent’s educational expectations in kindergarten, maternal depression, and demographic characteristics shown in Table 1. The low severity group consists of diagnosed and undiagnosed children whose composite pre-diagnosis ADHD-related behaviors score falls below the 25th percentile of that of diagnosed children. The mid severity group consists of diagnosed and undiagnosed children whose composite pre-diagnosis behaviors score falls between the 25th and 75th percentiles of that of diagnosed children. The high severity group consists of diagnosed and undiagnosed children whose composite pre-diagnosis behaviors score falls above the 75th percentile of that of diagnosed children.
Source:
ECLS-K:98 children who were eligible for sampling and present at all waves used in the analyses, who had complete information on ADD/ADHD diagnosis and the outcome measures, and whose composite pre-diagnosis ADHD-related behaviors score did not fall below that of the diagnosed child with the least severe pre-diagnosis ADHD-related behaviors composite score or above that of the diagnosed child with the most severe pre-diagnosis ADHD-related behaviors composite score. Multiple imputation was used to produce 20 datasets to address item-missingness on variables other than the outcomes and ADHD diagnosis.

*p < 0.05; **p < 0.01; ***p < 0.001.

 

 

Powered by WordPress