Peter A. Wyman, PhD; Anthony R. Pisani, PhD; C. Hendricks Brown, PhD; Bryan Yates, BA; Lacy Morgan-DeVelder, MS; Karen Schmeelk-Cone, PhD;
Robert D. Gibbons, PhD; Eric D. Caine, MD; Mariya Petrova, PhD; Tracy Neal-Walden, PhD; David J. Linkh, PhD; Alicia Matteson, PhD;
Jordan Simonson, PhD; Steven E. Pflanz, MD
The Wingman-Connect program used group skill building for cohesion, shared purpose, and managing career and personal stressors (3 blocks of 2 hours each). Stress management training covered cognitive and behavioral strategies (2 hours). Both conditions had a 1-hour booster session, plus text messages.
The primary outcomes were scores on the suicidal ideation and depression scales of the Computerized Adaptive Test for Mental Health and self-reports of military occupational impairment. Class network protective factors hypothesized to mediate the effect of Wingman-Connect were assessed with 4 measures: cohesion assessed perceptions that classmates cooperate, work well together, and support each other; morale was measured with a single item used in other studies with military samples; healthy class norms assessed perceptions of behaviors supported by classmates; and bonds to classmates were assessed by asking each participant to name classmates whom they respect and would choose to spend time with.
A total of 215 classes including 1485 individuals (1222 men [82.3%]; mean [SD] age, 20.9 [3.1] years) participated; 748 individuals were enrolled in the Wingman-Connect program and 737 individuals were enrolled in the stress management program. At 1 month, the Wingman-Connect group reported lower suicidal ideation severity (effect size [ES],−0.23; 95% CI,−0.39 to−0.09; P = .001) and depression symptoms (ES,−0.24; 95% CI,−0.41 to−0.08; P = .002) and fewer occupational problems (ES,−0.14; 95% CI,−0.31 to−0.02; P = .02). At 6 months, the Wingman-Connect group reported lower depression symptoms (ES,−0.16; 95% CI,−0.34 to−0.02; P = .03), whereas the difference in suicidal ideation severity was not significant (ES,−0.13; 95% CI,−0.29 to 0.01; P = .06). The number needed to treat to produce 1 fewer participant with elevated depression at either follow-up point was 21. The benefits of the training on occupational problems did not extend past 1 month. The Wingman-Connect program strengthened cohesive, healthy class units, which helped reduce suicidal ideation severity (estimate,−0.035; 95% CI,−0.07 to−0.01; P = .02) and depression symptom scores (estimate,−0.039; 95% CI,−0.07 to−0.01; P = .02) at 1 month.
Wingman-Connect is the first universal prevention program to reduce suicidal ideation and depression symptoms in a general Air Force population. Group training that builds cohesive, healthy military units is promising for upstream suicide prevention and may be essential for ecological validity. Extension of the program to the operational Air Force is recommended for maintaining continuity and testing the prevention impact on suicidal behavior.
ClinicalTrials.gov Identifier: NCT04067401
Active duty military suicide rates (24.8 events per 100 000 in 2018) are now comparable to those in the general population, after decades of being lower, prompting unprecedented expansion of suicide prevention activities. Military suicide prevention programming has focused on high-risk groups, primarily the detection and treatment of individuals with suicidal thoughts or behaviors. Yet targeting broad population groups with universal upstream prevention has similar or greater potential to achieve large reductions in suicide rates. The Department of Defense has prioritized promoting healthy populations to reduce suicides. The US Air Force implemented a multilayered strategy in 1996, which a trend analysis identified as reducing suicides for several years; however, no single intervention was identified as reducing suicide risk.
Universal prevention programs have not been identified that reduce suicidal thoughts and behaviors in military populations. Cognitive skill training impacts physical performance, social cognition (eg, perspective taking), coping, and problem solving among US military personnel. Recent testing of coping and interpersonal skill training found no benefits on mental health for Canadian military or Royal Air Force enlistees; investigators of the Royal Air Force study noted that cognitive training may lack ecological validity without addressing unit functioning.
We developed and then tested Wingman-Connect, a network health suicide and depression prevention program for the US Air Force. Network health interventions target natural organizational groups to strengthen bonds, cohesion, and adaptive coping norms, all of which are logical targets for upstream military suicide prevention. Similar targets affected in school-based interventions show long-lasting outcomes regarding suicidal ideation and behavior. Strengthening peer relationships to prevent suicide is consistent with theoretical and empirical evidence showing that disrupted relationships commonly precede military suicides. Strong bonds reduce vulnerability to depression, and postenlistment depression is a specific factor associated with suicide attempts among military personnel. Unit-level influences are major factors associated with suicide risk. Units are foundational structures for military life and health. Unit cohesion is associated with lower likelihood of suicidal ideation. Data from the Army Study to Assess Risk and Resilience in Servicemembers showed that up to 20% of suicide attempts over 5 years were associated with membership in a unit in which a member had attempted suicide.
Suicide has been a leading manner of death for Airmen in recent years. We investigated the Wingman-Connect program as a strategy for strengthening cohesive, protective classes of Air Force personnel in training. Wingman-Connect used a universal prevention strategy targeting the full population of Air Force trainees across the continuum of risk. The highest suicide rates are among younger enlisted personnel; hence, it was important to focus on personnel entering training. The primary hypothesis tested was that Wingman-Connect would reduce suicidal ideation, depression symptoms, and job-related problems. A secondary objective was testing the guiding network health theoretical model.
All participants provided written informed consent. Study procedures were approved by the institutional review boards of the US Department of Defense and the University of Rochester. Participants were compensated $50 for completing the final 6-month assessment. This study follows the Consolidated Standards of Reporting Trials (CONSORT) reporting guideline for cluster trials. Supplement 1 contains the trial protocol.
This cluster randomized clinical trial with head-to-head comparison of 2 conditions was conducted with new personnel in training assigned to classes at the Technical Training School, Sheppard Air Force Base, Wichita Falls, Texas, between October 2017 and October 2019. We paired similar class units from the same squadron and randomly assigned 1 class from each pair to Wingman Connect and the other to stress management training (Figure 1). The design used an active comparison training to strengthen internal validity. Matching of classes is described in eAppendix 1 and eTable 1 in Supplement 2.
Classes with instructional length between 37 and 91 days were eligible (class size, 4-13 students) (Figure 1). Participants were informed their data would be deidentified at the earliest possible time and that no individual responses would be shared with the Air Force or used for crisis evaluation. All participants received information about mental health resources.
Wingman-Connect was developed between August 2015 and December 2016 at Sheppard Air Force Base by adapting a suicide prevention program used in public education settings (Sources of Strength). For content adaptation, Air Force topic experts identified protective factors essential to an Airman’s job success, supportive of mental health, and theoretically linked to reduced suicide risk. Group training for units was selected to align with Air Force culture, a departure from the Sources of Strength model of training selected opinion leaders.
Wingman-Connect classes participated in group skill building using active learning: high-energy activities and drawing out personal examples occurred in 3 90- to 120-minute blocks over 3 consecutive days. Skills focused on growing and sustaining 4 core protective values: kinship (belonging and accountability), purpose (goals and motivating values), guidance (mentors and institutional resources), and balance (activities for well-being). Each class completed group exercises emphasizing cohesion, shared purpose, and the value of a healthy unit. Participants created videos for class distribution. Peer-nominated participants (2-3 per class) were invited to a 1-hour lunch as training champions (with no formal role). After 1 month, classes were invited to a 1-hour booster review. Training was conducted by 2 trainers with varied backgrounds (educator and mental health clinician) and training (bachelor’s and master’s level) from the research group (1 trainer was L.M.-D.). All Wingman-Connect trainings were audio recorded. Using an established procedure, coders rated 8 of 22 modules for adherence (mean adherence, 97.7%) (eAppendix 2 in Supplement 2).
If randomized to stress management, participants received an overview of the stress response system and cognitive and behavioral strategies adapted from a cognitive behavioral therapy workbook (2 hours). Trainers used a slideshow to introduce concepts, show videos, and lead discussions. After 1 month, participants were invited for a 1-hour booster review. Training was conducted by 1 of the 2 trainers from the research team. Participants in both conditions were invited to receive training-specific informational and interactive text messages for 6 months.
After providing consent, participants completed baseline assessments using a tablet computer and then began their class’s designated training. One month later, after the 1-hour booster session, participants completed the second assessment. Participants provided contact information for the final 6-month assessment, sent via a URL, with up to 4 reminders.
Two of 3 prespecified primary outcomes were the suicide scale (CAT-SS) and depression scale (CAT-DI) of the Computerized Adaptive Test for Mental Health. The CAT-SS administers a statistically optimal subset of items from a bank of 111 items syndromally associated with suicidal thoughts and behaviors from validated scales (eg, “In last 2 weeks have you felt life is not worth living?”). There is a 52-fold increase in the likelihood of current suicidal ideation—validated against clinician assessment using the Columbia Suicide Rating Scale (C-SSRS)—across the range of CAT-SS
scores (0-100, with higher scores indicating worse symptoms). CAT-SS also yields categorical scores (low, medium, and high); a 1-category change corresponds to a 16 times greater likelihood of an increase in C-SSRS’s ordinal scale, and contrasting high and low risk categories yielded sensitivity of 1.0 and specificity of 0.95 for C-SSRS–rated suicidal ideation. We combined medium and high categories for this nonclinical sample. CAT-DI uses the same adaptive technology to yield a dimensional measure of depression severity (score range, 0-100, with higher scores indicating worse symptoms); when thresholded (score >35), CAT-DI scores have high sensitivity and specificity for diagnosis of major depressive disorder. Elevated depression and suicidal ideation score dichotomous indicators were created at each follow-up and to indicate an individual scoring above threshold at any point after baseline. See eAppendix 3 in Supplement 2.
The third primary outcome was self-reported behaviorally based performance outcomes for military occupational impairment (eg, corrective training for substandard performance), summed for a total impairment score (0-5). To supplement this self-report, information on involuntary separations was collected from the squadrons.
Class network protective factors hypothesized to mediate Wingman-Connect impact were assessed with 4 measures. Cohesion assessed perceptions that classmates cooperate, work well together, and support each other (α = .85; 3 items). Morale was measured with a single item used in other studies with military samples. Healthy class norms assessed perceptions of behaviors supported by classmates (α = .88; 5 items). Bonds to classmates were assessed by asking each participant to name classmates (up to 5) whom they respect and would choose to spend time with.
Individual factors posited as proximal targets of Wingman-Connect were measured by healthy career behaviors (α = .90; 5 items), help-seeking acceptability (α = .70; 4 items), maladaptive coping (α = .63; 4 items), personal (α = .63; 2 items) and social problem (α = .83; 3 items) subscales from a measure of military functional impairment, loneliness, the anxiety subscale of Computerized Adaptive Test for Mental Health (CAT-AX), anger intensity and frequency (α = .83; 5 items), and emotion regulation difficulties (α = .74; 8 items). Training satisfaction was assessed at 1 month (α = .91; 3 items).
The power and sample size estimates were focused on detecting change in the continuous CAT-SS measure. With 1550 participants in 200 classes, expecting 25% attrition, the power and sample size estimates using optimal design showed 80% power with an effect size of 0.15 when the intraclass correlation coefficient was 0.02 and an effect size of 0.17 when the intraclass correlation coefficient was 0.05.
All analyses used an intention to treat approach and included random effects to adjust for class heterogeneity. All tests used a 2-sided .05 type I error. Baseline equivalence of the randomly assigned groups was tested using multilevel analysis of variance and χ2 tests.
We used multilevel linear and logistic mixed-effects regression models in MPlus statistical software version 8 (Muthén and Muthén) and R statistical software version 4.0.0 (R Project for Statistical Computing) to test changes due to training separately on 1-month and 6-month outcomes using models controlling for the baseline version of the chosen dependent variable. Our primary analysis included a random intercept to adjust for the nesting of individuals within classes. We also added random effects (intercept and treatment) to account for the nesting of treated and control classes within pairs. Because all of these analyses yielded comparable statistical conclusions and the models with a single random intercept had lower bayesian information criteria, we report findings from that analysis. All models also included covariates of sex, age, race, ethnicity, and active duty vs nonactive duty, all of which have previously been associated with suicide risk. For CAT dimensional measures, the underlying Bayes estimate of severity was used. For dichotomized scales, 2-level binary models were used. To quantify impact, we calculated Cohen d effect sizes (ESs) for continuous measures and odds ratios (ORs) for dichotomous outcomes. To determine whether Wingman-Connect had a differential impact, we tested baseline by training condition interactions by comparing slopes using Wald type tests that assessed the coefficient’s size to its standard error. We also examined age and sex by training condition interactions. To test the theoretical model positing that a connected, healthy class would be associated with reduced suicidal ideation and depression, we conducted 2-level mediation models using the product of coefficients method; mediators were treated both as individual-level (2-1-1 modeling) and as class contextual effects (2-2-1 modeling). Formal tests were based on model-based bootstrapped confidence intervals (see eAppendix 5 in Supplement 2), Data analysis was performed from November 2019 to May 2020.
Of 1897 Airmen in the 216 selected classes, 1732 (91.3%) were exposed to their class’s respective intervention, and 1485 participants (85.7%) from 215 classes were enrolled in the study (1222 men [82.3%]; mean [SD] age, 20.9 [3.1] years); 748 individuals were enrolled in the Wingman-Connect program and 737 individuals were enrolled in the stress management program. Exposure and enrollment did not vary by condition. Baseline comparisons accounting for random class effects showed baseline equivalence of the Wingman-Connect and stress management groups (Table 1 and eTable 2 in Supplement 2). A diagnostic P-P plot showed no baseline imbalance (eFigure 3 in Supplement 2). Attrition at 1 month (6%) and 6 months (16%) was not predicted by assigned condition; tests showed no differential attrition. A total of 629 of 748 individuals assigned to Wingman-Connect (84.1%) and 618 of 737 individuals assigned to stress management (83.9%) participated in the 6-month assessment. Training satisfaction scores (range, 0-3) were equivalent in the Wingman-Connect (mean [SD], 1.9 [0.89]) and stress management (mean [SD], 2.0 [0.85]) groups. Fidelity was high for the Wingman-Connect group (98%), and although it was not formally measured for the stress management group, it followed a structured lecture format that ensured high fidelity.
The findings showed that the Wingman-Connect program had a beneficial impact on all primary outcomes during technical training (Table 2). Figure 2 shows the mean suicidal ideation scale and depression scale scores for the Wingman-Connect and stress management groups at the 3 assessment points across the 6-month study period.
At the 1-month follow-up, participants in Wingman-Connect classes reported lower suicidal ideation severity (ES,−0.23; 95% CI,−39 to−0.09; P = .001) and depression symptoms (ES,−0.24; 95% CI,−0.41 to−0.08; P = .002) and fewer occupational problems (ES,−0.13; 95% CI,−0.31 to −0.02; P = .02). The odds of elevated depression were 22% lower for participants in the Wingman-Connect group compared with the stress management group (OR, 0.78; 95% CI, 0.64 to 0.97). Wingman-Connect participants were less likely to report corrective training (OR, 0.51; 95% CI, 0.31 to 0.82) or receiving a negative counseling statement (OR, 0.50; 95% CI, 0.29 to 0.86) compared with participants in the stress management group (eFigure 1 in Supplement 2). Squadron data were consistent with participants’ self-reports: 7 participants in the stress management group separated from the Air Force compared with 4 participants in the Wingman-Connect group.
At 6-month follow-up, Wingman-Connect participants reported significantly lower depression symptoms (ES,−0.16; 95% CI,−0.34 to−0.02; P = .03) (Table 2), whereas suicidal ideation severity scores were not significantly lower (ES,−0.13; 95% CI,−0.29 to 0.01; P = .06). A beneficial impact on occupational problems was not evident after 6 months. Wingman-Connect participants were 20% less likely than participants in the stress management group to report elevated depression at either follow-up point (OR, 0.80; 95% CI, 0.64 to 0.97; P = .01) and 19% less likely, on average, to report elevated suicidal ideation scores, although the difference was not significant for suicidal ideation scores (OR, 0.81; 95% CI, 0.51 to 1.07; P = .07) (Table 2). The number needed to treat to produce 1 fewer participant with elevated depression at either 1 or 6 months was 21.
The analyses showed no differential effects of Wingman-Connect on suicidal ideation severity (1 month) or depression symptoms (1 month and 6 months) by levels of those problems at baseline, or by sex or age (ie, no moderation). The Wingman-Connect reduction in occupational problems at 1 month was greater for trainees who had more problems at baseline (Table 2).
Wingman-Connect participants gained on all class protective factors: cohesion, morale, bonds to classmates, and perceptions that members support healthy behaviors (ES, 0.18 to 0.23) (Table 3). Wingman-Connect increased positive career behaviors (ES, 0.16; 95% CI, 0.02 to 0.28) and reduced anxiety (ES,−0.14; 95% CI,−0.29 to−0.01) and anger (ES,−0.18; 95% CI,−0.35 to−0.04). Social (ES,−0.23; 95% CI,−0.49 to−0.02) and personal (ES,−0.54; 95% CI,−0.93 to−0.23) impairments were reduced among participants with the highest third of problems at baseline. Training group differences were not found regarding coping attitudes, loneliness, or emotion dysregulation.
Table 1
Baseline Characteristics of the Full Sample, Wingman-Connect Group, and Stress Management Group
| Participants, No. (%) | ||||
|---|---|---|---|---|
| Characteristic | Full sample | Wingman-Connect | Stress management | |
| Classes, No. | 215 | 107 | 108 | |
| Squadron | 363 Training squadron weapons 365 Training squadron maintainers | 96 (44.7) 119 (55.3) | 48 (44.9) 59 (55.1) | 48 (44.4) 60 (55.6) |
| Size, mean (SD), students | 6.87 (2.36) | 6.93 (2.47) | 6.81 (2.23) | |
| Duration, mean (SD), hc | 533.3 (128.1) | 534.8 (128.1) | 531.8 (127.5) | |
| Participants, No. | 1485 | 748 | 737 | |
| Sex | Male Female | 1222 (82.3) 253 (17.0) | 616 (82.4) 128 (17.1) | 606 (82.2) 125 (17.0) |
| Age, y | 18 19 20 21-24 ≥ 25 | 279 (18.8) 359 (24.2) 250 (16.8) 410 (27.6) 182 (12.3) | 140 (18.7) 190 (25.4) 126 (16.8) 196 (26.2) 94 (12.6) | 139 (18.9) 169 (22.9) 124 (16.8) 214 (29.1) 88 (11.9) |
| Race | African American or Black Asian Multiracial Native American or Hawaiian White Other | 174 (11.7) 62 (4.2) 131 (8.8) 30 (2.0) 981 (66.1) 93 (6.3) | 91 (12.2) 31 (4.1) 59 (7.9) 15 (2.0) 498 (66.6) 47 (6.3) | 83 (11.3) 31 (4.2) 72 (9.8) 15 (2.1) 483 (65.5) 46 (6.2) |
| Hispanic or Latino ethnicity | 291 (19.6) | 137 (18.3) | 154 (20.9) | |
| Education | General education diploma High school AA or AS BA or BS or higher | 53 (3.6) 1167 (78.6) 159 (10.7) 101 (6.8) | 30 (4.0) 596 (79.7) 72 (9.6) 47 (6.3) | 23 (3.1) 571 (77.5) 87 (11.8) 54 (7.4) |
| Component | Active duty National Guard Reserve | 1213 (81.7) 182 (12.3) 86 (5.8) | 617 (82.5) 92 (12.3) 37 (4.9) | 596 (80.9) 90 (12.2) 49 (6.6) |
| Prior service | 26 (1.8) | 15 (2.0) | 11 (1.5) |
A. There were no differences between the Wingman- Connect and Stress Management groups on any variable.
B. Some percentages do not equal 100% because of missing data.
C. Duration refers to instructional length of the class.
We constructed a latent factor—cohesive healthy class networks—using all class variables with excellent fit with the data (eAppendix 4 in Supplement 2). To test mediation, we ran models that separately estimated 1-month suicidal ideation and depression scores using all previously reported covariates, baseline outcome scores, and training conditions, and then added both the baseline and 1-month latent class factor. We did not find significant mediation using the class-level mediator for each individual. Detailed findings for the individual level mediation (2-1-1 model) are shown later. The formal test of mediation—based on the product of coefficients in the indirect paths from condition to class factor and from class factor to 1-month suicidal ideation and depression scale scores—showed significant mediation for suicidal ideation (estimate,−0.035; 95% CI,−0.07 to−0.01; P = .02) and for depression symptoms (estimate,−0.039; 95% CI,−0.07 to−0.01; P = .02) (see eFigure 2 in Supplement 2). Participants’ perceptions of being embedded in a more-cohesive, healthy class accounted for significant portions of Wingman-Connect’s impact on reducing suicidal ideation and depression symptoms
Table 2
Wingman-Connect Impact on Suicide Severity, Depression, and Occupational Impairment (Primary Outcomes) at 1-Month and 6-Month Follow-up
Abbreviation: ES, effect size.
a Negative regression estimates and ESs indicate beneficial Wingman-Connect impact. All models were adjusted for class (random effect) and sex, age, race/ethnicity, and Air Force component.
b Wingman-Connect benefit at 1 month was greater for personnel with more occupational problems at baseline, as evident by training condition × baseline interaction (relative change,−0.38; 95% CI,−0.78 to−0.08). No other baseline × treatment condition interactions were significant.
c A suicide scale score greater than 34 was considered elevated. Elevated scores for
suicidal ideation at 1 and/or 6 months were present among 77 participants (10.3%) in the Wingman-Connect group and 93 participants (12.6%) in the stress management group (odds ratio, 0.81; 95% CI, 0.61 to 1.07; P = .07; number needed to treat [ie, training in Wingman-Connect to reduce 1 person with elevated risk], 44).
d A depression scale score greater than 35 was considered elevated. Elevated depression scores were present in 120 participants (16.1%) in the Wingman-Connect group and 154 participants (20.9%) in the stress management group (odds ratio, 0.80; 95% CI, 0.64 to 0.97; P = .01; number needed to treat, 21).
e Data are odds ratio (95% CI).
Figure 2.
Wingman-Connect and Stress Management Group Scores on Computerized Adaptive Test for Mental Health
Wingman-Connect is the first universal upstream prevention program tested through a randomized clinical trial to reduce suicidal ideation and depression symptoms in a general, nonclinical Air Force population. The magnitude of effects at 1 month (ES,−0.23 to−0.24) was equivalent to those of state-of-the-art prevention programs targeting broad adolescent and young adult populations where the majority are not at high risk. The beneficial impact on reduced depression symptoms was maintained at 6 months, including lower likelihood of elevated depression (OR, 0.80) over the full study period. The effects of Wingman-Connect in reducing suicidal ideation severity (1 month) and depression symptoms (1 and 6 months) were distributed across personnel with different levels of those problems at baseline. That diverse personnel benefited from the program illustrates a strength of a universal prevention strategy for military populations with members at low risk and others at higher risk who may not seek mental health services.
Wingman-Connect–trained personnel reported fewer occupational problems at 1 month (ie, negative counseling statement [OR, 0.50] or corrective training [OR, 0.51]). The dual benefits for occupational functioning and mental health underline a strength of upstream prevention implemented before the detection of serious suicidal behavior: skills that strengthened the trainee’s capability to meet job-related challenges also reduced depression and suicidal ideation. Universal prevention programs that support operational and suicide prevention objectives are more likely to be sustained.
The study’s findings validate the underlying network health model: stronger bonds within a more cohesive healthy class reduced suicidal ideation and depression symptoms. These findings suggest that Wingman-Connect classes became increasingly unified around healthy norms and encouraged classmates who were vulnerable to mental health or occupational problems at a key juncture of military training, in addition to meeting their needs for belonging. Work beginning with Durkheim plus recent social network modeling show that cohesive groups serve a protective regulatory function through norms and pressures to conform. Future studies should also test whether Wingman-Connect would be less effective with Air Force personnel who are minimally connected to their assigned class.
An innovation of Wingman-Connect was training in natural organizational units. The positive outcomes suggest that Wingman-Connect leveraged the influence that personnel have on each other daily. Half of the training was dedicated to class skill building. This peer-to-peer approach differs from most current suicide prevention trainings. Group training for units may be critical for ecological validity of military suicide prevention and for transfer of skills into the organizational culture.
Expansion of the Wingman-Connect program to active duty Air Force bases will likely be necessary to promote protective working units for continuity of its impact. A reduction in occupational problems was not sustained beyond technical training. Future studies are needed to determine whether the Wingman-Connect program is associated with prevention of suicidal behaviors, which personnel benefit most, and what degree of saturation of Wingman-Connect–trained personnel will optimize its impact.
Table 3.
Wingman-Connect Impact on Targeted Class-Individual Risk and Protective Factors in Technical Training
Study limitations include the fact that participants and school leadership were not blinded to the intervention condition. Although training satisfaction ratings were comparable between the 2 conditions, the impact of awareness of the condition on self-ratings cannot be ruled out. Second, the outcomes relied on self-reports; however, these self-reported measures have been validated against structured clinical interviews with strong agreement. Third, trainers were research staff, and the findings may not generalize to training by military personnel.
In this cluster randomized clinical trial, the Wingman-Connect program reduced suicidal ideation, depression symptoms, and occupational problems for Airmen in technical training (at 1 month of follow-up), and the benefits on reduced depression symptoms were sustained for 6 months. Further research is recommended to test upward extension into operational Air Force and longer-term impact on preventing suicidal behaviors.
Accepted for Publication: August 30, 2020.
Published: October 21, 2020. doi:10.1001/jamanetworkopen.2020.22532
Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2020 Wyman PA et al. JAMA Network Open.
Corresponding Author: Peter A. Wyman, PhD, Department of Psychiatry, University of Rochester School of Medicine and Dentistry, 300 Crittenden Blvd, Rochester, NY 14620 (peter_wyman@urmc.rochester.edu).
Author Affiliations: Department of Psychiatry, University of Rochester School of Medicine and Dentistry, Rochester, New York (Wyman, Pisani, Yates, Morgan-DeVelder, Schmeelk-Cone, Caine, Petrova); Department of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, Illinois (Brown); Department of Medicine, Biological Sciences, The University of Chicago, Chicago, Illinois (Gibbons); Department of Public Health Sciences, Biological Sciences, The University of Chicago, Chicago, Illinois (Gibbons); Now with Miller School of Medicine, University of Miami, Miami, Florida (Petrova); US Air Force Surgeon General’s Office, Falls Church, Virginia (Neal-Walden, Linkh, Pflanz); Now with Cohen Veterans Network, Silver Spring, Maryland (Neal-Walden); US Air Force, Head Quarters Air Force, Washington, DC (Matteson, Simonson); Now with Syracuse Veterans Affairs Medical Center, Syracuse, New York (Pflanz).
Author Contributions: Dr Wyman had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Wyman, Pisani, Brown, Morgan-DeVelder, Caine, Petrova, Neal-Walden, Pflanz.
Acquisition, analysis, or interpretation of data: Wyman, Pisani, Brown, Yates, Morgan-DeVelder, Schmeelk-Cone, Gibbons, Linkh, Matteson, Simonson, Pflanz.
Drafting of the manuscript: Wyman, Pisani, Brown, Yates, Schmeelk-Cone, Caine, Simonson.
Critical revision of the manuscript for important intellectual content: Wyman, Pisani, Brown, Yates, Morgan-DeVelder, Schmeelk-Cone, Gibbons, Caine, Petrova, Neal-Walden, Linkh, Matteson, Pflanz.
Statistical analysis: Brown, Schmeelk-Cone, Gibbons.
Obtained funding: Wyman, Pisani.
Administrative, technical, or material support: Wyman, Yates, Morgan-DeVelder, Petrova, Neal-Walden, Linkh, Matteson, Simonson, Pflanz.
Supervision: Wyman, Morgan-DeVelder, Pflanz.
Conflict of Interest Disclosures: Dr Pisani reported receiving grants from the National Institute of Mental Health during the conduct of the study and speaking fees from SafeSide Prevention outside the submitted work. Dr Brown reported receiving grants from the Department of Defense and University of Rochester during the conduct of the study and personal fees from University of Chicago outside the submitted work. Dr Gibbons reported being an expert witness for the US Department of Justice, Merck, Glaxo-Smith-Kline, Pfizer, and Wyeth and being a founder of Adaptive Testing Technologies, which distributes the Computerized Adaptive Test for Mental Health battery of adaptive tests; the terms of this arrangement have been reviewed and approved by the University of Chicago in accordance with its conflict of interest policies. No other disclosures were reported.
Funding/Support: This work was supported by the Office of the Assistant Secretary of Defense for Health Affairs under Award No. W81XWH-14-1-0322. The US Army Medical Research Acquisition Activity is the awarding and administering acquisition office.
Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Disclaimer: The opinions, interpretations, conclusions and recommendations are those of the authors and are not necessarily endorsed by the Department of Defense.
Data Sharing Statement: See Supplement 3.
Additional Contributions: Mark LoMurray, BA (Sources of Strength, Inc), consulted on training process and content, and Timothy McGowan, MA (private contractor), worked as a Wingman-Connect trainer; they both received compensation for their activities. Chelsey Hartley, PhD (University of Rochester), provided training support, and Ian Cero, PhD (University of Rochester), provided comments on the analysis and manuscript; they were not compensated for their activities. We are also grateful for study support from Jessica Ditson, MSW, Lawrence Brown, BS, and other leaders and training cadre at the Technical Training School, Sheppard Air Force Base (82nd Training Wing).
1. Smolenski DJ, Reger MA, Alexander CL, et al. DoDSER: Department of Defense suicide event report—calendar year 2012 annual report. Published December 20, 2013. Accessed September 25, 2020. https://www.dspo.mil/ Portals/113/Documents/2012-DoDSER-Annual-Report.pdf
2. Pruitt LD, Smolenski DJ, Tucker J, et al DoDSER: Department of Defense suicide event report—calendar year 2017 annual report. Published July 12, 2018. Accessed September 25, 2020. https://www.dspo.mil/Portals/113/ Documents/2017-DoDSER-Annual-Report.pdf?ver=2019-07-19-110951-577
3. Hoge CW. Suicide reduction and research efforts in service members and veterans: sobering realities. JAMA Psychiatry. 2019;76(5):464-466. doi:10.1001/jamapsychiatry.2018.4564
4. Ramchand R, Acosta J, Burns RM, Jaycox LH, Pernin CG. The war within: preventing suicide in the U.S. Military. Rand Health Q. 2011;1(1):2. doi:10.7249/RB9529
5. Ursano RJ, Colpe LJ, Heeringa SG, Kessler RC, Schoenbaum M, Stein MB; Army STARRS collaborators. The Army study to assess risk and resilience in servicemembers (Army STARRS). Psychiatry. 2014;77(2):107-119. doi:10.1521/ psyc.2014.77.2.107
6. Bryan CJ, Mintz J, Clemans TA, et al. Effect of crisis response planning vs. contracts for safety on suicide risk in U.S. Army soldiers: a randomized clinical trial. J Affect Disord. 2017;212:64-72. doi:10.1016/j.jad.2017.01.028
7. Comtois KA, Kerbrat AH, DeCou CR, et al. Effect of augmenting standard care for military personnel with brief caring text messages for suicide prevention: a randomized clinical trial. JAMA Psychiatry. 2019;76(5):474-483. doi:10.1001/jamapsychiatry.2018.4530
8. Rudd MD, Bryan CJ, Wertenberger EG, et al. Brief cognitive-behavioral therapy effects on post-treatment suicide attempts in a military sample: results of a randomized clinical trial with 2-year follow-up. Am J Psychiatry. 2015;172(5):441-449. doi:10.1176/appi.ajp.2014.14070843
9. Stanley B, Brown GK, Brenner LA, et al. Comparison of the safety planning intervention with follow-up vs usual care of suicidal patients treated in the emergency department. JAMA Psychiatry. 2018;75(9):894-900. doi:10.1001/jamapsychiatry.2018.1776
10. Wyman PA. Developmental approach to prevent adolescent suicides: research pathways to effective upstream preventive interventions. Am J Prev Med. 2014;47(3)(suppl 2):S251-S256. doi:10.1016/j.amepre.2014.
11. Brown CH, Wyman PA, Brinales JM, Gibbons RD. The role of randomized trials in testing interventions for the prevention of youth suicide. Int Rev Psychiatry. 2007;19(6):617-631. doi:10.1080/09540260701797779
12. Rose G. Sick individuals and sick populations. Int J Epidemiol. 1985;14(1):32-38. doi:10.1093/ije/14.1.32
13. US Department of Defense; Under Secretary of Defense for Personnel and Readiness. Annual suicide report (ASR): calendar year 2018. Published 2019. Accessed September 25, 2020. https://www.dspo.mil/Portals/113/2018 %20DoD%20Annual%20Suicide%20Report_FINAL_25%20SEP%2019_508c.pdf
14. Knox KL, Litts DA, Talcott GW, Feig JC, Caine ED. Risk of suicide and related adverse outcomes after exposure to a suicide prevention programme in the US Air Force: cohort study. BMJ. 2003;327(7428):1376-1378. doi:10.1136/bmj.327.7428.1376
15. Adler AB, Bliese PD, Pickering MA, et al. Mental skills training with basic combat training soldiers: a group- randomized trial. J Appl Psychol. 2015;100(6):1752-1764. doi:10.1037/apl0000021
16. Cacioppo JT, Adler AB, Lester PB, et al. Building social resilience in soldiers: a double dissociative randomized controlled study. J Pers Soc Psychol. 2015;109(1):90-105. doi:10.1037/pspi0000022
17. Cohn A, Pakenham K. Efficacy of a cognitive-behavioral program to improve psychological adjustment among soldiers in recruit training. Mil Med. 2008;173(12):1151-1157. doi:10.7205/MILMED.173.12.1151
18. Williams A, Hagerty BM, Andrei AC, Yousha SM, Hirth RA, Hoyle KS. STARS: strategies to assist navy recruits’success. Mil Med. 2007;172(9):942-949. doi:10.7205/MILMED.172.9.942
19. Fikretoglu D, Liu A, Nazarov A, Blackler K. A group randomized control trial to test the efficacy of the Road to Mental Readiness (R2MR) program among Canadian military recruits. BMC Psychiatry. 2019;19(1):326. doi:10.1186/s12888-019-2287-0
20. Jones N, Whelan C, Harden L, Macfarlane A, Burdett H, Greenberg N. Resilience-based intervention for UK military recruits: a randomised controlled trial. Occup Environ Med. 2019;76(2):90-96. doi:10.1136/oemed-2018-
21. Wyman PA, Pickering TA, Pisani AR, et al. Peer-adult network structure and suicide attempts in 38 high schools: implications for network-informed suicide prevention. J Child Psychol Psychiatry. 2019;60(10):1065-1075. doi:10.1111/jcpp.13102
22. Wilcox HC, Kellam SG, Brown CH, et al. The impact of two universal randomized first- and second-grade classroom interventions on young adult suicide ideation and attempts. Drug Alcohol Depend. 2008;95(1)(suppl):S60-S73. doi:10.1016/j.drugalcdep.2008.01.005
23. Joiner T. Why People Die by Suicide. Harvard University Press; 2005.
24. Van Orden KA, Witte TK, Cukrowicz KC, Braithwaite SR, Selby EA, Joiner TE Jr. The interpersonal theory of suicide. Psychol Rev. 2010;117(2):575-600. doi:10.1037/a0018697
25. Lakey B, Cronin A. Low social support and major depression: research, theory and methodological issues. In: Dobson KS, Dozois DJA, eds. Risk Factors in Depression. Elsevier Academic Press; 2008:385-408. doi:10.1016/B978-0-08-045078-0.00017-4
26. Nock MK, Stein MB, Heeringa SG, et al; Army STARRS Collaborators. Prevalence and correlates of suicidal behavior among soldiers: results from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). JAMA Psychiatry. 2014;71(5):514-522. doi:10.1001/jamapsychiatry.2014.30
27. Ursano RJ, Kessler RC, Naifeh JA, et al; Army Study to Assess Risk and Resilience in Servicemembers (STARRS) Collaborators. Risk of suicide attempt among soldiers in army units with a history of suicide attempts. JAMA Psychiatry. 2017;74(9):924-931. doi:10.1001/jamapsychiatry.2017.1925
28. Mitchell MM, Gallaway MS, Millikan AM, Bell M. Interaction of combat exposure and unit cohesion in predicting suicide-related ideation among post-deployment soldiers. Suicide Life Threat Behav. 2012;42(5): 486-494. doi:10.1111/j.1943-278X.2012.00106.x
29. Griffith J. Cross (unit)-level effects of cohesion on relationships of suicide thoughts to combat exposure, postdeployment stressors, and postdeployment social support. Behav Med. 2015;41(3):98-106. doi:10.1080/08964289.2014.987719
30. Grudo G. Suicide leading cause of death for active duty Airmen. Air Force Magazine. Published August 10, 2017.Accessed September 30, 2020. https://www.airforcemag.com/suicide-leading-cause-of-death-for-active-duty-airmen/
31. Institute of Medicine. Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research. National Academies Press; 1994.
32. Pruitt LD, Smolenski DJ, Bush NE, et al. Suicide in the military: understanding rates and risk factors across the United States’ armed forces. Mil Med. 2019;184(1)(suppl):432-437. doi:10.1093/milmed/usy296
33. Brown CH, Ten Have TR, Jo B, et al. Adaptive designs for randomized trials in public health. Annu Rev Public Health. 2009;30:1-25. doi:10.1146/annurev.publhealth.031308.100223
34. LoMurray M. Sources of Strength Facilitators Guide: Suicide Prevention Peer Gatekeeper Training. The North Dakota Suicide Prevention Project; 2005.
35. Wyman PA, Brown CH, LoMurray M, et al. An outcome evaluation of the Sources of Strength suicide prevention program delivered by adolescent peer leaders in high schools. Am J Public Health. 2010;100(9):1653-1661. doi:10.2105/AJPH.2009.190025
36. Cross WF, Pisani AR, Schmeelk-Cone K, et al. Measuring trainer fidelity in the transfer of suicide prevention training. Crisis. 2014;35(3):202-212. doi:10.1027/0227-5910/a000253
37. Leahy RL. Cognitive Therapy Techniques: A Practitioner’s Guide. 2nd ed. Guildford Press; 2018.
38. Gibbons RD, Weiss DJ, Pilkonis PA, et al. Development of a computerized adaptive test for depression. Arch Gen Psychiatry. 2012;69(11):1104-1112. doi:10.1001/archgenpsychiatry.2012.14
39. Gibbons RD, Kupfer D, Frank E, Moore T, Beiser DG, Boudreaux ED. Development of a computerized adaptive test suicide scale: the CAT-SS. J Clin Psychiatry. 2017;78(9):1376-1382. doi:10.4088/JCP.16m10922
40. Achtyes ED, Halstead S, Smart L, et al. Validation of computerized adaptive testing in an outpatient nonacademic setting: the VOCATIONS trial. Psychiatr Serv. 2015;66(10):1091-1096. doi:10.1176/appi.ps.201400390
41. Graham AK, Minc A, Staab E, Beiser DG, Gibbons RD, Laiteerapong N. Validation of a computerized adaptive test for mental health in primary care. Ann Fam Med. 2019;17(1):23-30. doi:10.1370/afm.2316
42. Herrell RK, Edens EN, Riviere LA, Thomas JL, Bliese PD, Hoge CW. Assessing functional impairment in a working military population: the Walter Reed functional impairment scale. Psychol Serv. 2014;11(3):254-264. doi:10.1037/a0037347
43. Podsakoff PM, MacKenzie SB. An examination of the psychometric properties and nomological validity of some revised and reduced substitutes for leadership scales. J Appl Psychol. 1994;79(5):702-713. doi:10.1037/0021-9010.79.5.702
44. Britt TW, Dickinson JM. Morale during military operations: a positive psychology approach. In: Britt TW, Castro CA, Adler AB, eds. Military Performance: Military Life—The Psychology of Serving in Peace and Combat. Praeger Security International; 2006:157-184.
45. Valente TW. Social Networks and Health: Models, Methods and Applications. Oxford University Press; 2010. doi:10.1093/acprof:oso/9780195301014.001.0001
46. Schmeelk-Cone K, Pisani AR, Petrova M, Wyman PA. Three scales assessing high school students’ attitudes and perceived norms about seeking adult help for distress and suicide concerns. Suicide Life Threat Behav. 2012;42(2):157-172. doi:10.1111/j.1943-278X.2011.00079.x
47. Gould MS, Velting D, Kleinman M, Lucas C, Thomas JG, Chung M. Teenagers’ attitudes about coping strategies and help-seeking behavior for suicidality. J Am Acad Child Adolesc Psychiatry. 2004;43(9):1124-1133. doi:10.1097/01.chi.0000132811.06547.31
48. Hughes ME, Waite LJ, Hawkley LC, Cacioppo JT. A short scale for measuring loneliness in large surveys: results from two population-based studies. Res Aging. 2004;26(6):655-672. doi:10.1177/0164027504268574
49. Gibbons RD, Weiss DJ, Pilkonis PA, et al. Development of the CAT-ANX: a computerized adaptive test for anxiety. Am J Psychiatry. 2014;171(2):187-194. doi:10.1176/appi.ajp.2013.13020178
50. Forbes D, Alkemade N, Mitchell D, et al. Utility of the Dimensions of Anger Reactions-5 (DAR-5) scale as a brief anger measure. Depress Anxiety. 2014;31(2):166-173. doi:10.1002/da.22148
51. Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. J Psychopathol Behav Assess.2004;26(1):41-54. doi:10.1023/B:JOBA.0000007455.08539.94
52. Foran HM, Adler AB. Trainee perceptions of drill sergeant qualities during basic combat training. Mil Psychol.2013;25(6):577-587. doi:10.1037/mil0000023
53. Murray D. Design and Analysis of Group-Randomized Trials. Oxford University Press; 1998.
54. Muthén LK, Muthén BO. MPlus user’s guide, version 8. Published 2019. Accessed September 25, 2020. https://statmodel.com/download/usersguide/MplusUserGuideVer_8.pdf
55. R Project for Statistical Computing. R: a language and environment for statistical computing. Published 2020.Accessed September 25, 2020. https://www.r-project.org/
56. Kahan BC, Jairath V, Doré CJ, Morris TP. The risks and rewards of covariate adjustment in randomized trials: an assessment of 12 outcomes from 8 studies. Trials. 2014;15(1):139. doi:10.1186/1745-6215-15-139
57. Rosenthal R, Cooper H, Hedges L. Parametric measures of effect size. In: Cooper H, Hedges LV, eds. The Handbook of Research Synthesis. Russell Sage Foundation; 1994:231-244.
58. MacKinnon DP, Lockwood CM, Brown CH, Wang W, Hoffman JM. The intermediate endpoint effect in logistic and probit regression. Clin Trials. 2007;4(5):499-513. doi:10.1177/1740774507083434
59. Preacher KJ, Zyphur MJ, Zhang Z. A general multilevel SEM framework for assessing multilevel mediation. Psychol Methods. 2010;15(3):209-233. doi:10.1037/a0020141
60. Mackinnon DP, Lockwood CM, Williams J. Confidence limits for the indirect effect: distribution of the product and resampling methods. Multivariate Behav Res. 2004;39(1):99-128. doi:10.1207/s15327906mbr3901_4
61. Brown CH, Brincks A, Huang S, et al. Two-year impact of prevention programs on adolescent depression: An integrative data analysis approach. Prev Sci. 2018;19(1)(suppl):74-94. doi:10.1007/s11121-016-0737-1
62. Durkheim E. Suicide: A Sociological Study. The Free Press; 1897.
63. Bearman PS. The social structure of suicide. Sociol Forum. 1991;6:501-524. doi:10.1007/BF01114474
64. Bearman PS, Moody J. Suicide and friendships among American adolescents. Am J Public Health. 2004;94 (1):89-95. doi:10.2105/AJPH.94.1.89
SUPPLEMENT 1.
Trial Protocol
SUPPLEMENT 2.
eAppendix 1. Selection and Matching of Technical Training Classes
eTable 1. Matched Pairing of Enrolled Technical Training Classes
eAppendix 2. Procedures for Rating Adherence to Wingman-Connect Training Manual
eAppendix 3. Modification of CAT-SS Modification of CAT-SS Item Bank by Removing 1 Item
eAppendix 4. Protocol Deviations in Statistical Analyses
eAppendix 5. Statistical Analyses
eTable 2. Baseline Outcomes and Risk/Protective Factors for Full Sample, Wingman-Connect Group and Stress
Management Group
eFigure 1. Wingman-Connect Impact on Occupational Impairment Indicators in Technical Training
eFigure 2. Wingman-Connect Impact on Suicide Severity and Depression Mediated Through Stronger Class Units
eFigure 3. P-P Plot of Tests of Baseline Equivalence on Behavior Measures
eReferences.
SUPPLEMENT 3.
Data Sharing Statement
