Predicting nonresponse to sexual identity question in youth risk behavior surveillance: A machine learning analysis of complex survey data

ElsevierVolume 115, March 2026, Pages 37-44Annals of EpidemiologyAuthor links open overlay panel, AbstractPurpose

To compare seven machine learning (ML) models developed to predict non-response to the sexual identity question in the 2023 Youth Risk Behavior Surveillance System (YRBSS) and identify the best-performing ML model, along with key attributes associated with the non-response.

Methods

Data of 20,103 students, with 32 predictors across domains of personal characteristics, school behavior, substance use, and sexual activity were analyzed. Supervised ML models–including random forest (RF), gradient boosting, extreme gradient boosting, decision tree, neural network, lasso, and elastic net were developed and incorporated survey weights. Performance was assessed using F1 score, area under the ROC curve (AUC), and area under the precision-recall curve (AUPRC).

Results

About 10 % of students didn’t respond to the sexual identity question, with higher rates among racial/ethnic minorities, including American Indian/Alaska Native and Native Hawaiian/Pacific Islander youths. RF model showed the most robust overall performance across all metrics. Attributes predicting non-response included response status to questions of school absence due to safety concerns and having ≥ 4 sexual partners.

Conclusions

Non-response was non-random and concentrated among vulnerable groups. Predictive performance was strong, but findings suggest that response patterns to other sensitive survey items play substantial role, with implications for survey design and non-response adjustment.

List of abbreviationsYRBSS

Youth Risk Behavior Surveillance System

NNE

Neural network ensembles

GBM

Gradient boosting machine

XGB

Extreme gradient boosting

Caret

Classification And Regression Training

PPV

Positive predictive value

NPV

Negative predictive value

ROC

Receiver Operating Characteristic

AUC

Area Under the ROC Curve

AUPRC

Area Under the Precision-Recall Curve

IRB

Institutional review board

Keywords

Machine learning

Response bias

Health equity

Surveillance

Social determinants of health

© 2026 The Authors. Published by Elsevier Inc.

Comments (0)

No login
gif