This protocol presents a reproducible survey workflow for data collection, quality screening, and moderated mediation analysis in college students.
A subscription to JoVE is required to view this content. Sign in or start your free trial.
Method Article
This protocol presents a reproducible survey workflow for data collection, quality screening, and moderated mediation analysis in college students.
This method article presents a reproducible cross-sectional self-report survey protocol for examining associations among psychological resilience, sense of school belonging (SSB), higher-order thinking, and internet gaming disorder (IGD) in college students. In this protocol, new employment patterns are treated as a contextual background shaped by generative artificial intelligence, platform-based work, and changing graduate skill expectations rather than as a participant-level exposure variable. The protocol integrates institutional sampling, questionnaire administration, translation documentation, response-quality screening, missing-data handling, scale scoring, common-method-bias screening, variable centering, and conditional process analysis into one standardized workflow. SSB is specified as a statistical mediator, and IGD is specified as a moderator within an association-based moderated mediation framework. Representative outputs include sample-flow records, descriptive statistics, correlation matrices, mediation and moderated mediation estimates, conditional indirect effects, the index of moderated mediation, and interaction plots. Because the representative dataset is cross-sectional and self-reported, the protocol supports transparent estimation of statistical associations rather than causal or longitudinal inference. By standardizing preprocessing decisions and model specifications before analysis, this workflow improves transparency, comparability, and reproducibility in educational and behavioral survey research.
New employment patterns shaped by generative artificial intelligence, platform-based work, and cross-domain occupational integration have changed how universities discuss graduate preparedness and student development1. In this article, new employment patterns are treated as a contextual framing condition rather than a measured participant-level exposure. The protocol does not classify students according to their direct participation in platform labor, gig work, or artificial intelligence-mediated employment. Instead, this context explains why higher-order thinking (HOT), psychological resilience (PR), and school-based support are relevant constructs for college students facing increasingly uncertain educational and career transitions. This clarification is necessary because the protocol is designed for cross-sectional behavioral survey research rather than for estimating the effects of a measured employment-pattern exposure.
Within this context, graduates are increasingly expected to solve unfamiliar problems, transfer knowledge across domains, evaluate information critically, and make adaptive decisions under uncertainty2. Recent labor-market and higher-education discussions also point to a continuing mismatch between employer expectations and graduate preparedness, particularly in communication, collaboration, independent problem solving, and innovation3. These demands have made HOT a useful outcome construct in educational and behavioral research concerned with student adaptation under changing employment conditions4.
HOT refers to advanced cognitive activities beyond recall and basic comprehension, including analysis, evaluation, decision making, problem solving, and creative thinking5. Building on the classic distinction between lower-order and higher-order cognition, prior research emphasizes that HOT involves knowledge transformation rather than simple knowledge reproduction and that it is closely related to authentic problem contexts, integration of prior knowledge, and cognitive flexibility6. Under digitally mediated employment and learning environments, students are often required to interpret complex information, work with intelligent tools, and maintain cognitive autonomy when information is abundant but uneven in quality7. These conditions make HOT an appropriate focal construct for a reproducible behavioral research protocol.
PR is included in this protocol because it is theoretically and empirically related to students’ adaptive functioning under stress and uncertainty8. Although definitions of PR differ across outcome-based, trait-based, and process-based perspectives, most accounts converge on the idea that PR reflects the capacity to regulate oneself, recover from difficulty, and maintain functional adaptation in challenging conditions9. In the present protocol, PR is not treated as a proven causal determinant of HOT. Rather, it is modeled as an independent variable that may be statistically associated with HOT in a cross-sectional dataset. This wording is consistent with the design boundary of the study and avoids implying temporal ordering that the data cannot establish. This association is plausible because students with stronger PR may be more capable of maintaining goal-directed engagement, constructive coping, and adaptive reasoning when facing academic and career-related pressure10. Prior empirical work has linked PR with problem solving, critical thinking, and adaptive cognition, although direct evidence connecting PR to HOT remains limited11. For this reason, the present article uses the relationship between PR and HOT as a representative modeling example through which the full survey-to-analysis protocol can be demonstrated.
Sense of school belonging (SSB) is incorporated as a statistical mediator in the protocol. It is generally defined as students’ perceived experience of being accepted, respected, supported, and connected within the school community12. Most definitions emphasize an emotional and relational bond with the institution, teachers, and peers formed through participation, recognition, and support13. In a changing employment context, SSB is relevant because students often rely on university-based guidance, peer interaction, and institutional resources when preparing for uncertain academic and occupational futures14.
Existing studies suggest that PR is positively associated with SSB. Students with stronger PR may be more likely to seek support, maintain constructive engagement, and preserve a sense of connection with teachers and peers when facing stress15. SSB has also been associated with collaborative problem solving, critical thinking, creativity, and deeper engagement in learning activities16. On this basis, the present protocol specifies SSB as a statistical mediator between PR and HOT. This specification should be interpreted as an association-based mediation model suitable for cross-sectional survey data rather than as evidence that PR temporally causes SSB or that SSB causally produces HOT.
Internet gaming disorder (IGD) is included as a moderator because digital behavior may shape the strength of associations among PR, SSB, and HOT. IGD refers to persistent and recurrent gaming behavior associated with clinically meaningful impairment and has received increasing attention in student populations with intensive digital exposure17. Prior studies have linked problematic gaming with disrupted routines, reduced sleep quality, lower social support, weaker coping capacity, and poorer academic engagement18. These findings support the view that higher levels of IGD symptoms may weaken adaptive educational and psychosocial functioning.
At the same time, gaming-related behavior should not be interpreted simplistically. Some game environments involve strategic decision making, feedback-based learning, and cognitive challenge, but these features do not mean that IGD itself is beneficial19. In the present protocol, IGD is treated only as a statistical moderator of association patterns. Any interaction involving IGD is interpreted cautiously as a conditional association within the representative dataset rather than as clinical evidence that gaming disorder improves cognition or strengthens school functioning.
Despite growing interest in PR, SSB, HOT, and student digital behavior, a methodological gap remains. Many studies report associations among these constructs, but fewer provide a transparent and reproducible protocol linking participant recruitment, survey administration, translation documentation, invalid-response screening, missing-data handling, scale scoring, reliability screening, common-method-bias screening, variable centering, and conditional process analysis within one auditable framework. This gap is especially relevant for educational and behavioral survey research, where results may be difficult to reproduce if preprocessing rules and model decisions are only partially reported.
To address this gap, the present method article provides a reproducible protocol for conducting a cross-sectional self-report survey and generating representative moderated mediation outputs. The protocol uses PR, SSB, HOT, and IGD as an applied example, but its primary contribution is methodological rather than causal. The protocol demonstrates how to construct a sampling frame, administer a standardized questionnaire, document translation and scoring decisions, apply prespecified screening rules, prepare an analysis-ready dataset, and estimate conditional process Models 4 and 59 using fixed reporting rules. Compared with less standardized survey-analysis approaches, this protocol improves transparency, comparability, reproducibility, and auditability by documenting preprocessing decisions and model specifications before interpretation. By presenting these steps as a unified procedure, the article provides researchers with a reproducible framework for educational and behavioral survey research on college student adaptation and HOT development.
Access restricted. Please log in or start a trial to view this content.
This study was approved by the Ethics Committee of Liuzhou Vocational and Technical College (protocol code: LVTC-2024-02-879; approval date: February 1, 2024). Obtain electronic informed consent before questionnaire access. Remove direct identifiers before data export and analysis. Store raw, cleaned, analysis-ready, scoring, screening, and output files in restricted-access folders.
1. Recruit participants using a prespecified multistage random sampling workflow
2. Administer the questionnaire using a standardized online procedure
3. Score the measurement instruments using a locked scoring framework
4. Clean the dataset and create an analysis-ready file
5. Conduct the statistical analyses using a prespecified workflow
Access restricted. Please log in or start a trial to view this content.
Sample characteristics and preliminary variable patterns
The workflow successfully generated a complete sample-flow record before statistical modeling. As shown in Table 1, a total of 860 students were invited during the prespecified data-collection window, and 800 questionnaires were returned, giving an overall response rate of 93.0%. After response-quality screening, 24 invalid responses were excluded, leaving 776 valid cases in the final analysis-ready dataset. The retained sample...
Access restricted. Please log in or start a trial to view this content.
This method article presents a reproducible survey-to-analysis workflow for examining association-based mediation and moderated mediation patterns among PR, SSB, HOT, and IGD symptoms in college students. The primary contribution of the workflow is methodological rather than causal because the protocol demonstrates how a cross-sectional self-report dataset can be collected, screened, scored, documented, and analyzed through a transparent sequence of prespecified procedures. In this revised protocol, new employment patter...
Access restricted. Please log in or start a trial to view this content.
The authors declare that they have no competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
This research was supported by Liuzhou Polytechnic University (Grant No. 2023SB16).
Access restricted. Please log in or start a trial to view this content.
| Name | Company | Catalog Number | Comments |
|---|---|---|---|
| Institutions; codes I-01 to I-32 | Study team | N/A | Locked before random selection and used for institution-level randomization. |
| Institutional screening log | Study team | N/A | Documented institutional eligibility criteria, source documents, eligibility decisions, and institution codes. |
| Internet Gaming Disorder Scale | Lemmens, Valkenburg, and Gentile (2015), The Internet Gaming Disorder Scale, Psychological Assessment, 27(2), 567–582. doi:10.1037/pas0000062 | N/A | 9-item scale aligned with DSM-5 criteria and used as a continuous self-reported IGD symptom measure rather than as a clinical diagnosis. |
| Mediation model output | Study team | Model 4 output | Output for the mediation model with PR as X, SSB as M, and HOT as Y. |
| Moderated mediation model output | Study team | Model 59 output | Output for the moderated mediation model with IGD moderating the PR → SSB, PR → HOT, and SSB → HOT paths. |
| Online questionnaire platform | Wenjuanxing / Questionnaire Star | N/A | Web-based survey platform used for electronic informed consent, online questionnaire administration, forced-response settings, and survey-data export. |
| Pilot-check record | Study team | N/A | 30-student pilot-check record used to assess item clarity, comprehension, completion burden, and platform function. Pilot participants were not included in the final analytic sample. |
| Psychological Resilience Scale | Hu and Gan revision based on the Connor-Davidson framework | N/A | 25-item scale used to measure psychological resilience. Responses were scored on a 5-point Likert scale and computed as mean scores. |
| Psychological Sense of School Membership Scale | Chinese revised version based on Goodenow’s school-membership framework | N/A | 18-item scale used to measure school belonging. Items 3, 6, 9, 12, and 16 were reverse-scored before mean-score computation. |
| Randomization procedure | Study team | Random seed: 20241007 | Used for institution-level and student-level random selection through a seed-based random-number procedure. |
| Raw survey dataset | Study team | Raw_Survey_NEP_2024_800returned_locked.xlsx | Raw exported dataset containing 800 returned questionnaires before response-quality exclusion. |
| Response-quality screening log | Study team | N/A | Documented 24 excluded responses, including duplicate responses, eligibility inconsistencies, completion-time exclusions, straight-line responses, and repeated-pattern responses. |
| Response-quality screening rules | Study team | N/A | Exclusion criteria included duplicate submission, eligibility inconsistency, completion time <360 s, same option selected for ≥85% of Likert items, and repeated alternating patterns across ≥15 consecutive Likert items. |
| Scale reliability output | Study team | N/A | Output reporting Cronbach’s alpha values for PR, HOT, SSB, and IGD. |
| Scoring and coding reference file | Study team | Supplementary Table 2 | Documents item count, response range, reverse-coded items, score direction, mean-score computation, demographic coding, and reliability values. |
| Session administration log | Study team | N/A | Recorded administration date, institution code, class context, counselor identifier, invitation count, returned count, session duration, and deviations. |
| Statistical software | IBM Corp. | IBM SPSS Statistics, version 27.0 | Used for descriptive statistics, correlations, reliability analysis, exploratory factor analysis, regression, mediation, and moderated mediation analyses. |
| Student randomization log | Study team | Random seed: 20241007 | Documented student-level stratified random selection within the three selected institutions. |
| Supplementary Table 1 | Study team | Translation and adaptation record | Documents item source, original wording, forward translation, back translation, final Chinese wording, expert review, pilot feedback, and revision rationale. |
| Supplementary Table 2 | Study team | Scoring and coding rules | Documents scoring rules, reverse coding, demographic coding, variable abbreviations, and reliability values. |
| Translation and adaptation record | Study team | Supplementary Table 1 | Documents forward translation, reconciliation, back translation, expert review, pilot checking, and final Chinese wording. |
| Windows operating system | Microsoft Corp. | Windows 11 Pro, 64-bit | Operating system used for statistical analysis and output generation. |