A subscription to JoVE is required to view this content. Sign in or start your free trial.

Method Article

A Standardized Questionnaire Protocol for Internet Addiction and Emotion-Regulation Assessment in University Students

71 views

⸱

DOI:

10.3791/72210

⸱

September 8th, 2026

In This Article

Summary

This behavioral-science and psychological-assessment protocol standardizes online questionnaire administration, scoring, data-quality screening, and reproducible analysis to assess internet addiction and emotion-regulation difficulty among university students.

Abstract

Internet use is deeply embedded in university life, but problematic internet use cannot be evaluated adequately by exposure time alone. Evidence suggests that maladaptive or compulsive patterns of internet use are associated with difficulty in emotion regulation, yet inconsistencies in questionnaire order, eligibility criteria, screening thresholds, scoring procedures, and analytic reporting continue to limit comparability across studies. This method's article presents a standardized questionnaire protocol for behavioral-science and psychological-assessment studies examining internet addiction and emotion-regulation difficulty among university students. The workflow includes a fixed questionnaire sequence, prespecified eligibility criteria, mandatory-response settings, pilot-based completion-time thresholds, sequential data-quality screening, standardized scoring of the Internet addiction test and the 16-item difficulties in emotion regulation scale, and reproducible descriptive, correlational, and multivariable regression analyses. The protocol also specifies archiving of raw returns, screening logs, README/codebook files, and the final analysis-ready dataset. A representative implementation is reported to demonstrate execution of the protocol rather than to validate the instruments or establish prevalence. In that implementation, 520 students were invited, and 480 questionnaires were returned. After sequential exclusion of duplicate submissions, speeded responses, failed attention checks, patterned responding, logical inconsistency, and missing core data, 452 valid questionnaires were retained. The predefined analytic demonstration examined the association between the Internet addiction test total score and the difficulties in emotion regulation scale total score. The retained sample showed a mean Internet addiction test total score of 51.94 and a mean Difficulties in emotion regulation scale total score of 35.95. Emotion-regulation difficulty increased across internet-addiction severity groups, and the association remained evident after adjustment for demographic and behavioral covariates. This protocol provides a transparent workflow that can be repeated, audited, and adapted for future cross-sectional, repeated-measure, or longitudinal studies in university populations.

Introduction

Internet use has become an ordinary part of university life, including academic work, social communication, entertainment, information seeking, and emotional coping. For this reason, student internet behavior should not be interpreted simply as screen exposure or time online. Earlier evidence showed that problematic internet use was already visible in youth and college populations before the current mobile-platform environment became highly saturated1. More recent university-based studies further indicate that problematic internet use is common enough to require systematic assessment rather than informal description2.

University students represent a particularly relevant population for standardized assessment because academic pressure, social transition, independent living, and increased autonomy often occur at the same developmental stage. These demands are frequently managed through the same digital devices and platforms that may also become difficult to regulate. A meta-analytic review showed that problematic internet use among students is associated with multiple mental-health outcomes, supporting its interpretation as a broader behavioral and psychological concern rather than a narrow technology-use problem3. Perceived stress has also been linked to internet-addiction patterns among college students, suggesting that emotional and contextual pressures should be considered when designing questionnaire-based studies in this field4.

The present protocol uses the term “internet addiction” when referring specifically to the construct measured by the Internet addiction test and its established score categories. The broader term “problematic internet use” is used when discussing the wider literature on maladaptive, excessive, or functionally impairing internet-related behavior. “Compulsive internet use” is used only when the cited literature emphasizes loss of control, urges, or repetitive use despite negative consequences. These terms are therefore related but not treated as fully interchangeable. When the protocol is implemented with the Internet Addiction Test, “internet addiction” is retained as the instrument-specific terminology; when alternative or revised instruments are used, terminology should be aligned with the construct labels and diagnostic assumptions of the selected measure.

Emotion regulation provides a plausible psychological entry point for understanding why some students move from frequent internet use to maladaptive internet use. A one-year prospective study showed that difficulty in emotion regulation was relevant to both later occurrence and remission of internet addiction among college students5. This finding is important for protocol design because emotion regulation is not merely an additional correlate; it may influence how students use the internet to avoid, reduce, or manage distress. At the same time, social functioning remains relevant. Problematic internet use has been associated with social skills among university students, indicating that interpersonal and emotional factors should be assessed alongside digital-use variables6. During the COVID-19 period, problematic internet use also co-occurred with broader psychological difficulties among Chinese university students, further supporting the need for structured assessment in university settings7.

A further challenge is that digital behavior is heterogeneous. Students may use digital platforms for study, social contact, entertainment, health information, or temporary emotional relief, and not all high-frequency use is harmful. A systematic review of mental health-related digital use by university students showed that digital engagement can serve multiple psychological purposes8. The field, therefore, needs procedures that distinguish ordinary high-frequency use from problematic or dysregulated use. Recent evidence on problematic smartphone use in university students similarly suggests that risk depends on behavioral pattern, function, and context rather than duration alone9. For this reason, the present protocol combines internet-use duration, late-night use, primary online activity, and standardized symptom scoring instead of relying on a single exposure indicator.

Measurement is another major source of inconsistency. The Internet addiction test remains one of the most widely used instruments for assessing internet-addiction symptoms, but its dimensionality and interpretation have varied across settings. Systematic psychometric evidence indicates that the instrument has been used extensively while continuing to raise questions about factor structure and scoring interpretation10. Similar concerns have been reported in college-student samples, where widespread use of the scale did not fully resolve uncertainty about the construct being measured11. Validation studies in Spanish and Peruvian university populations also show that the instrument can perform adequately, but that its psychometric behavior should be considered within the target population where it is applied12,13.

The protocol is therefore designed to be stable in workflow but adaptable in instrument selection. The Internet addiction test is used here because of its historical use, available thresholds, and comparability with prior university-student research. However, the protocol does not require the Internet addiction test to remain the preferred instrument indefinitely. If diagnostic frameworks evolve or if newer instruments become more appropriate for a specific population, the same workflow can be retained while replacing the scale-specific module, score range, severity thresholds, codebook entries, and README documentation. Any such replacement should be made before formal data collection begins and should be reported as a protocol modification rather than an ad hoc analytic change.

The methodological problem addressed by this article is not simply that studies of internet addiction and emotion regulation reach different conclusions. Rather, many studies differ in questionnaire sequence, eligibility criteria, survey-platform settings, duplicate-response handling, attention-check procedures, completion-time thresholds, missing-data rules, scoring verification, and reporting of analysis-ready files. These differences make results difficult to compare, reproduce, and include in later evidence synthesis. The present protocol responds to this gap by fixing the administration sequence, screening logic, scoring structure, and analytic pathway in a way that can be repeated, audited, and modified transparently. Its contribution is therefore protocol-oriented: it provides a reproducible workflow for observational behavioral-science and psychological-assessment studies in university populations, rather than proposing a new psychological construct or presenting a prevalence study as the main outcome.

Access restricted. Please log in or start a trial to view this content.

Protocol

The study, entitled “A Standardized Questionnaire Protocol for Internet Addiction and Emotion Regulation Assessment in University Students,” was reviewed and approved by the Ethics and Academic Committee of Zhengzhou University of Economics and Business under Approval Number 20260113004 before participant recruitment began14. The study used a cross-sectional, anonymous online questionnaire design involving full-time university students aged 18–24 years and was conducted in accordance with institutional ethical requirements and the Declaration of Helsinki. Electronic informed consent was obtained before questionnaire access. Participants received an electronic information sheet describing the study purpose, procedures, voluntary nature of participation, and data-protection measures, and they were free to withdraw at any time without penalty. No directly identifiable personal information, including name, student identification number, exact address, telephone number, personal email address, or social-media account, was collected in the main survey file. Platform-generated identifiers were used only for duplicate-response screening and were removed before dataset analysis. All data were stored securely and analyzed in de-identified form. This questionnaire workflow was not prospectively registered before participant recruitment. However, all core protocol components, including the locked questionnaire version, README/codebook, screening log, scoring rules, analysis syntax, and analysis-ready workflow files, were archived and are provided as supplementary workflow materials to support reproducibility and auditability.

Platform-generated response identifiers and device- or account-limited technical identifiers were used only for duplicate-response screening and were removed from the final anonymized analytical dataset. The core variables and scoring rules are summarized in Table 1, and the complete variable dictionary is provided in Supplementary Table 1. The questionnaire files, codebook, screening log, output plan, and analysis-ready workflow materials are provided in Supplementary File 1.

DomainVariableCoding/ScoringRole in protocol
EligibilityAgeYears; eligible range 18–24Eligibility variable and covariate
DemographicsSex1 = male; 2 = female; 3 = prefer not to sayDescriptive variable and regression covariate
DemographicsAcademic year1 = first year; 2 = second year; 3 = third year; 4 = fourth year or above; 5 = postgraduateDescriptive variable
DemographicsDiscipline category1 = humanities and social sciences; 2 = science and engineering; 3 = business and management; 4 = arts and design; 5 = otherDescriptive variable
DemographicsResidence type1 = on-campus dormitory; 2 = off-campus rental; 3 = family home; 4 = otherDescriptive variable
DemographicsMonthly living expenses1 = <1,000 CNY; 2 = 1,000–1,999 CNY; 3 = 2,000–2,999 CNY; 4 = ≥3,000 CNYDescriptive variable
Internet-use behaviorWeekday internet use1 = <2 h; 2 = 2–3.9 h; 3 = 4–5.9 h; 4 = ≥6 hBehavioral covariate
Internet-use behaviorWeekend internet use1 = <2 h; 2 = 2–3.9 h; 3 = 4–5.9 h; 4 = ≥6 hBehavioral covariate
Internet-use behaviorPrimary online activity1 = study; 2 = social media; 3 = gaming; 4 = entertainment/video; 5 = shopping; 6 = mixed use; 7 = otherDescriptive variable
Internet-use behaviorPrimary access device1 = smartphone; 2 = tablet; 3 = laptop/desktop; 4 = mixed devicesDescriptive variable
Internet-use behaviorLate-night use after 23:001 = never; 2 = less than once per week; 3 = 1–2 nights/week; 4 = 3–5 nights/week; 5 = almost every nightBehavioral covariate and logical-consistency screening variable
Core scaleIAT total scoreSum of 20 items; each item scored 1–5; total range 20–100Primary independent variable
Core scaleIAT severity group20–39 = normal use; 40–69 = problematic use; 70–100 = severe problematic useGrouping variable
Core scaleDERS-16 total scoreSum of 16 items after required reverse coding; total range 16–80Primary dependent variable
Core scaleDERS-16 subscalesComputed according to the locked DERS-16 scoring keyDescriptive emotion-regulation outcomes
CovariateSleep duration1 = <6 h; 2 = 6–6.9 h; 3 = 7–7.9 h; 4 = ≥8 hAdjustment variable
CovariateWeekly physical activity0 = none; 1 = 1–2 sessions; 2 = 3–4 sessions; 3 = ≥5 sessionsAdjustment variable
CovariateAcademic stress1 = low; 2 = moderate; 3 = highAdjustment variable
Quality controlAttention check1 = pass; 0 = failExclusion criterion
Quality controlCompletion timeCompletion duration in secondsTiming-based screening variable
Quality controlLong-string response countMaximum run length of identical responses across the 36 scored scale itemsPatterned-response screening variable
Quality controlWithin-person SDWithin-person standard deviation across the 36 scored scale itemsInvariant-response screening variable
Quality controlLogical-consistency flag0 = no inconsistency; 1 = inconsistency detectedLogical-consistency screening variable

Table 1: Core variables, coding structure, and scoring rules used in the standardized questionnaire protocol. This table summarizes the core eligibility, demographic, internet-use, scale, covariate, and quality-control variables used in the main workflow. It includes the coding values, score ranges, scoring rules, and roles of the main variables used for questionnaire administration, screening, scoring, and analysis. Abbreviations: IAT = internet addiction test; DERS-16 = 16-item difficulties in emotion regulation scale. Please click here to download this Table.

1. Set up the study population, questionnaire structure, and survey flow

  1. Define the target population and valid sample
    1. Recruit full-time undergraduate and postgraduate students aged 18–24 years who can complete the questionnaire independently on a mobile phone or computer. Record the questionnaire language version and use scale versions that have been validated or appropriately adapted for the target student population.
    2. Document any accessibility or language modification before data collection when international students, students with disabilities, or multilingual student groups are included.
    3. Restrict participation to one completed response per participant. Use the survey platform’s device restriction, account restriction, cookie restriction, or authenticated-link function when available.
      NOTE: When the same participant account generates responses from multiple devices, identify and reconcile those records during duplicate screening using the account-limited identifier, timestamp, questionnaire status, and response-pattern similarity.
    4. Set the minimum final valid sample at 450 questionnaires and continue recruitment until the cleaned dataset remains above this threshold after screening.
      NOTE: When severe problematic internet use or another small subgroup is a primary analysis target, set a larger recruitment target before data collection begins.
    5. Record the number invited, the number returned, the number excluded at each prespecified screening step, and the final number retained so that the participant flow can later be summarized in Figure 1.
  2. Construct the questionnaire in a fixed order
    1. Arrange the questionnaire in the following sequence: informed consent, demographic information, internet-use behavior, Internet Addiction Test, Difficulties in emotion regulation scale short form, sleep duration, weekly physical activity, and perceived academic stress. Keep this order unchanged for all participants. Do not randomize the order of the core scales.
    2. Record age, sex, academic year, discipline category, residence type, and monthly living expenses using closed-ended response categories. Mark all demographic items as mandatory.
      ​NOTE: For sex, include male, female, and prefer not to say. Retain “prefer not to say” in descriptive analyses. In regression analyses, code sex using indicator variables with male as the reference category, including separate indicators for female and prefer not to say. Do not delete participants solely because they select “prefer not to say.”
    3. Record weekday internet-use duration, weekend internet-use duration, primary online activity, primary access device, and late-night internet use after 23:00. Code late-night use as 1 = never, 2 = less than once per week, 3 = 1–2 nights per week, 4 = 3–5 nights per week, and 5 = almost every night.
    4. Record the academic period during which the questionnaire is administered. In the representative implementation, the survey was administered during a regular teaching semester, outside final examination weeks, specifically during semester weeks 6–7.
  3. Administer and score the core instruments
    1. Administer the 20-item Internet addiction test as a mandatory scale and score each item from 1 to 5. Sum all 20 items to obtain a total score ranging from 20 to 100, then classify 20–39 as normal use, 40–69 as problematic use, and 70–100 as severe problematic use15.
    2. Use “internet addiction” when reporting IAT-based scores and severity groups. Use “problematic internet use” only when referring to the broader literature or non-IAT constructs.
    3. Administer the 16-item Difficulties in emotion regulation scale short form immediately after the internet addiction test and score each item from 1 to 5. Reverse-code Items 1, 6, and 8 before summation, then calculate a total score ranging from 16 to 80, with higher scores indicating greater difficulty in emotion regulation16.
    4. Generate five subscale scores for nonacceptance, goals, impulse, strategies, and clarity after reverse coding has been verified.
    5. Recheck the coding direction of all reversed items before calculating the total and subscale scores. Use the same DERS-16 scoring key for every participant and document the scoring key in the README/codebook.
    6. When a revised or alternative internet-addiction instrument is used, replace the scale-specific module before data collection begins and update the item names, score range, severity thresholds, scoring syntax, README/codebook, questionnaire screenshots, and Table of Materials.
  4. Add covariates and one attention-check item
    1. Record sleep duration as <6 h, 6–6.9 h, 7–7.9 h, and ≥8 h. Record weekly physical activity frequency as 0, 1–2, 3–4, and ≥5 sessions. Record perceived academic stress as low, moderate, or high. Define one physical-activity session as ≥20 min of moderate or vigorous activity.
    2. Insert one directed-response attention-check item in the behavioral section and require the participant to select one specified response option. The attention-check item used in the representative implementation was: “To confirm that you are reading carefully, please select ‘3 = sometimes’ for this item”. Mark any questionnaire that fails this item for exclusion during cleaning17.
      CRITICAL STEP: Do not change item wording, response anchors, scale order, exclusion thresholds, survey-platform settings, coding rules, or statistical-analysis rules after formal data collection begins.
      NOTE: Summarize the core variables, coding values, score ranges, and scoring rules in Table 1. Provide the complete variable dictionary, file-status fields, screening flags, technical identifier fields, dataset-tracking variables, file names, and software versions in Supplementary Table 1 and the README/codebook.

Survey response filtration process flowchart; steps include duplicates, speed, and attention checks.
Figure 1: Questionnaire flow for recruitment, screening, exclusion, and final analytic retention. This flow diagram shows the progression from invited students to returned questionnaires, through sequential data-quality screening and exclusion by prespecified criteria, to final retention of valid questionnaires for analysis. The figure presents the number of invited students, returned questionnaires, excluded records at each screening step, and the final analytic sample. Please click here to view a larger version of this figure.

2. Pilot-test the questionnaire and lock the final field version

  1. Pilot-test the full questionnaire
    1. Administer the full questionnaire to 20–30 students who satisfy the formal inclusion criteria but are not retained in the final dataset.
    2. Record completion time and written feedback on clarity, response burden, technical access, item order, attention-check comprehension, and any ambiguity in demographic or behavioral response options.
    3. Record the pilot sample size, median completion time, interquartile range, minimum and maximum completion time, and all wording changes made after pilot testing.
    4. In the representative implementation, the pilot included 25 students, the median completion time was 540 s, and the expected completion time was set at 6–8 min.
    5. Revise ambiguous wording, duplicated meaning, unclear response options, or software-display problems identified during pilot testing, then freeze the final questionnaire version before formal release.
      NOTE: If the study includes multilingual students, older adults, adolescents, or students with disabilities, conduct additional cognitive testing or subgroup pilot testing before formal release.
  2. Fix the operational settings and export rules
    1. Create a new survey project in the selected online survey platform. Enter the consent page as the first page and set the consent item as a required branching item.
    2. Configure the survey so that participants who do not provide consent exit the survey automatically without seeing the questionnaire body.
    3. Enter all demographic, internet-use, IAT, DERS-16, covariate, and attention-check items using the locked wording and response anchors. Set all core items as mandatory.
    4. Activate automatic recording of start time, end time, completion duration, response status, and platform-generated response identifier.
    5. Enable one-response-per-participant controls when available, including authenticated survey links, device restriction, cookie-based repeat prevention, account-based repeat prevention, or duplicate-response review settings. Record the enabled controls in the README/codebook.
    6. Disable collection of unnecessary direct identifiers. If the platform records IP address by default, disable IP storage or replace it with a non-identifying duplicate-screening field when permitted by institutional policy.
      NOTE: When IP addresses or device metadata are temporarily retained for duplicate screening, store them only in the encrypted raw file, restrict access to the study analyst, and remove them before producing the final analytical dataset.
    7. Specify whether pause-and-resume is permitted. In this protocol, a formal save-and-return function across different sessions is not enabled. Participants may pause only within the same open browser session, and the recorded completion time includes the full elapsed time.
    8. Export the raw return file in both spreadsheet and comma-separated-value formats at survey closure18. Also export a survey-to-document file or PDF/A copy containing the final questionnaire wording, item order, branching settings, mandatory-item settings, and coding structure. Save these files with version-controlled names.
    9. Calculate the pilot median completion time and set the minimum valid completion threshold at approximately one-third of that value. Fix the final lower threshold at 180 s and apply it uniformly during formal screening.
    10. Because this cutoff is derived from the pilot sample, re-establish the threshold when the protocol is implemented in a substantially different population, platform, language version, or institutional setting.
      NOTE: Archive the final questionnaire screenshots, final questionnaire export, README/codebook, pilot log, attention-check wording, screening-log template, export settings, and statistical syntax as supplementary or audit files.

3. Release the questionnaire and preserve the raw dataset

  1. Recruit participants through fixed channels
    1. Distribute one standardized invitation through student communication groups, class channels, or institutional mailing lists during a fixed 14-day collection window.
    2. State the study purpose, expected completion time of 6–8 min, anonymous handling of data, voluntary participation, and the absence of academic penalty or reward for nonparticipation in both the invitation and the consent page.
    3. Display the consent page before any questionnaire item appears and require active agreement before entry. Do not permit access to the questionnaire body without an affirmative consent response.
    4. State on the consent page that participants may stop before final submission and that incomplete responses will not be used in the final analysis.
    5. Use the same locked questionnaire version across all recruitment channels. If several recruitment channels are used, record the channel only when it is prespecified as a study variable.
  2. Preserve the raw return file
    1. Retain all returned records, including incomplete and later-excluded submissions, in the raw export file. Export the full dataset immediately after survey closure and store it as raw_returns_YYYYMMDD.csv and raw_returns_YYYYMMDD.xlsx.
    2. Preserve the original submission time, completion duration, response status, platform-generated response identifier, and device-limited or account-limited technical identifier in the raw file. Do not overwrite these fields during later cleaning.
    3. Save one read-only raw-data copy before screening begins. Store the raw file, screening log, and final analytic dataset in separate folders. Restrict access to the raw file containing technical identifiers to authorized study personnel only.
      CAUTION: Do not collect directly identifying information, such as full name, student identification number, exact dormitory address, personal telephone number, personal email address, or social media account, in the main survey file.
      NOTE: Pause the workflow after raw export, save one read-only copy of the raw dataset, and restart cleaning only from that preserved copy.

4. Screen returned questionnaires and generate the final analytic dataset

  1. Apply the screening sequence in a fixed order
    1. Sort all returned records by device-limited identifier, account-limited identifier when available, timestamp, questionnaire status, and response similarity. Identify duplicate submissions first. Retain the earliest complete record when two or more submissions originate from the same participant within the same collection cycle.
    2. If multiple submissions are detected from the same authenticated account but different devices, treat them as duplicate submissions from the same participant. Retain the earliest complete record and exclude later complete records. If the earliest record is incomplete and a later record is complete, retain the earliest complete record.
    3. Remove records with completion time <180 s, review records completed in 180–240 s, and remove records that fail the directed-response attention-check item fourth. Document the number removed at each step in screening_log_v1.xlsx19.
    4. For records completed in 180–240 s, conduct manual review using the attention-check result, long-string responding flag, within-person standard deviation, and logical-consistency flag.
    5. Retain a borderline-speed record only when no additional data-quality flag is present. Record every borderline-speed decision in the screening log.
  2. Remove patterned, inconsistent, or incomplete records
    1. Remove all questionnaires showing long-string responding, defined as 18 or more consecutive identical responses across the 36 scored scale items, or a within-person standard deviation ≤0.25 across those items.
    2. Remove any questionnaire showing impossible behavioral combinations. Define “the highest response category on nearly all Internet addiction test items” as a score of 5 on at least 18 of the 20 IAT items.
      NOTE: The logical-inconsistency rule is triggered when a respondent reports both weekday and weekend internet use in the lowest duration category (<2 h per day), late-night internet use coded as “almost every night,” and a score of 5 on at least 18 of the 20 IAT items. Apply this rule only after duplicate, completion-time, attention-check, and patterned-response screening have been completed.
    3. Remove all questionnaires with missing values in any IAT item, any DERS-16 item, or any prespecified covariate.
      NOTE: This complete-case rule is used because the online survey uses mandatory core items and because the representative regression model requires a fixed covariate set. When missing covariate data exceed 5%, use a prespecified alternative missing-data method, such as multiple imputation.
    4. Assign one anonymous study ID to each retained record and save the remaining file as analytic_dataset_v1.csv and analytic_dataset_v1.xlsx.
    5. Remove platform-generated response identifiers, device-limited identifiers, account-limited identifiers, IP addresses if retained during screening, timestamps, and free-text review notes from the final analytic dataset. Keep only the anonymous study ID and analysis variables.
      CRITICAL STEP: Apply the screening sequence in the same order to every record and do not re-enter previously excluded cases at later stages. Assign the first triggered exclusion criterion as the primary exclusion reason and record secondary flags only as screening-log notes.
      NOTE: Summarize the final exclusion counts by reason in Table 2, and keep those counts identical to the participant flow reported later in Figure 1.
Screening orderScreening itemOperational ruleScreening actionDocumentation rule
Step 1Raw export preservationExport all returned records immediately after survey closure and save them as raw_returns_YYYYMMDD.csv and raw_returns_YYYYMMDD.xlsxPreserve one read-only copy before any cleaning beginsArchive in raw-data folder
Step 2Consent and access checkIdentify records without active electronic informed consent before questionnaire accessExclude records without consent from the analytic workflowLog excluded or inaccessible records in screening_log_v1.xlsx when retained in the platform export
Step 3Duplicate screeningIdentify records sharing the same device-limited identifier or account-limited identifier within the same collection cycle and matching on sex, age, academic year, and at least 80% identical questionnaire responsesRetain the earliest complete record and exclude all later duplicatesLog excluded count and affected raw_record_id values in screening_log_v1.xlsx; assign primary exclusion_reason = 1
Step 4Multiple-device duplicate reconciliationIdentify multiple complete submissions from the same authenticated participant account across different devicesTreat these records as duplicate submissions; retain the earliest complete recordLog the account-limited identifier and retained raw_record_id in screening_log_v1.xlsx; assign later records primary exclusion_reason = 1
Step 5Completion-time screeningIdentify all questionnaires with completion time <180 sExclude all such records automaticallyLog excluded count in screening_log_v1.xlsx; assign primary exclusion_reason = 2
Step 6Borderline-speed reviewIdentify all questionnaires with completion time 180–240 sReview each record manually using attention-check, long-string, within-person SD, and logic flags; retain only if no additional flag is presentRecord each case as retained_after_manual_review = 1 or excluded_after_manual_review = 1 in screening_log_v1.xlsx
Step 7Attention-check screeningIdentify all records failing the directed-response attention-check itemExclude all failed records not already excluded at an earlier stepLog excluded count in screening_log_v1.xlsx; assign primary exclusion_reason = 3
Step 8Patterned-response screeningIdentify records with 18 or more consecutive identical responses across the 36 scored scale items, or within-person SD ≤0.25 across those itemsExclude all such records not already excluded at an earlier stepLog excluded count in screening_log_v1.xlsx; assign primary exclusion_reason = 4
Step 9Logical-consistency screeningIdentify records showing the prespecified impossible behavioral combination: weekday_internet_use and weekend_internet_use both coded as <2 h, late_night_use coded as almost every night, and a score of 5 on at least 18 of the 20 IAT itemsExclude all such records not already excluded at an earlier stepLog excluded count and review note in screening_log_v1.xlsx; assign primary exclusion_reason = 5
Step 10Core-missingness screeningIdentify records with any missing value in IAT_1–IAT_20, DERS_1–DERS_16, age, sex, weekday_internet_use, weekend_internet_use, sleep_duration, physical_activity, or academic_stress; “prefer not to say” for sex is treated as a valid response, not as missingExclude all such records not already excluded at an earlier stepLog excluded count in screening_log_v1.xlsx; assign primary exclusion_reason = 6
Step 11Primary exclusion assignmentIdentify records meeting more than one exclusion criterionAssign the first triggered criterion in the prespecified screening sequence as the primary exclusion reasonRecord secondary flags in review notes only; do not assign multiple primary reasons
Step 12Technical identifier removalIdentify platform-generated response identifiers, device-limited identifiers, account-limited identifiers, timestamps, and any temporarily retained technical metadata in the cleaned fileRemove these fields from the final analytic dataset after screening is completeDocument removal in screening_log_v1.xlsx
Step 13Final retentionRetain all records that pass all prior screening stepsAssign one anonymous study ID to each retained recordSave as analytic_dataset_v1.csv and analytic_dataset_v1.xlsx
Step 14Screening summaryCount the number removed at each step and the final number retainedSummarize the final counts for manuscript reportingKeep the counts in Table 2 identical to Figure 1
Step 15Audit trail preservationPreserve the raw file, screening log, and final analytic dataset as separate filesDo not overwrite, merge, or manually edit archived source filesStore in raw-data, screening, and analytic folders separately

Table 2: Prespecified screening sequence, exclusion thresholds, screening actions, and documentation rules for questionnaire cleaning. This table summarizes the fixed screening order used to clean returned questionnaires, including consent and access checks, duplicate screening, multiple-device reconciliation, completion-time screening, borderline-speed review, attention-check failure, patterned responding, logical inconsistency, core missingness, technical identifier removal, final retention, and audit-trail preservation. Abbreviations: IAT = internet addiction test; DERS-16 = 16-item difficulties in emotion regulation scale. Please click here to download this Table.

5. Score variables, verify reliability, and prepare the analysis-ready file

  1. Generate total scores, subscale scores, and derived categorical variables
    1. Sum the 20 IAT item scores to generate the total internet addiction score, then store both the continuous score and the three-level severity class in the analysis-ready file.
    2. Reverse-code DERS-16 Items 1, 6, and 8, calculate the total score and five subscale scores, and append all derived variables to the same participant-level dataset.
    3. Run a range check before score calculation. Confirm that all IAT and DERS-16 item values fall within 1–5, all reverse-coded values fall within 1–5, IAT total scores fall within 20–100, and DERS-16 total scores fall within 16–80. Record the range-check output in the scoring log.
  2. Recode covariates into fixed analytic categories
    1. Recode weekday and weekend internet-use duration as <2 h, 2–3.9 h, 4–5.9 h, and ≥6 h. Recode late-night internet use as never, <1 night/week, 1–2 nights/week, 3–5 nights/week, and almost every night.
    2. Recode sleep duration, physical activity frequency, and perceived academic stress using the prespecified category rules defined in Section 1.4 and store the recoded values under fixed variable names in the same dataset.
    3. Recode sex for regression using two indicator variables: female versus male and prefer not to say versus male. Report the coding in the table footnote and README/codebook.
  3. Verify scoring integrity and internal consistency
    1. Calculate Cronbach’s alpha for the IAT total score and the DERS-16 total score before inferential analysis. Recheck item coding, reverse coding, and impossible item ranges if either alpha is <0.7020. Report the Cronbach’s alpha values in the Representative Results section.
    2. Calculate item-total correlations or alpha-if-item-deleted values if either scale shows unexpectedly low internal consistency. Do not remove scale items from the primary analysis unless item removal was prespecified or the study is explicitly designed as a psychometric validation study.
    3. Save the final analysis-ready dataset together with a README file listing variable names, coding rules, exclusion thresholds, file names, software versions, questionnaire version, scoring syntax, regression model specification, and procedures required to regenerate the same dataset.

6. Analyze the data and preserve reproducible outputs

  1. Generate descriptive statistics and group comparisons
    1. Report continuous variables as mean ± standard deviation and categorical variables as frequency and percentage. Summarize demographic characteristics, internet-use behavior, and scale scores using the predefined output structure.
    2. Report the sample size used for every analysis. Use the retained analytic sample as the denominator unless a table clearly states otherwise.
    3. Compare DERS-16 total and subscale scores across the three IAT severity groups and use two-sided testing with α = 0.05 for the primary analyses. Report standardized effect sizes where appropriate.
      ​NOTE: For group comparisons, report η2 or partial η2 for analysis of variance, or an equivalent nonparametric effect size if a nonparametric test is used. Interpret severe problematic-use subgroup comparisons cautiously when the subgroup is small.
    4. Calculate the Pearson correlation between IAT total score and DERS-16 total score when both variables show acceptable distributional behavior; otherwise, use Spearman correlation as a sensitivity analysis. Report n, r or ρ, 95% confidence interval if generated by the statistical software, p value, and interpretation of magnitude.
  2. Fit the adjusted regression model and archive outputs
    1. Use the DERS-16 total score as the dependent variable and the IAT total score as the primary independent variable. Enter age, sex, weekday internet use, weekend internet use, sleep duration, physical activity, and perceived academic stress as covariates. This model is the predefined analytic demonstration of the standardized workflow.
    2. Before interpreting the adjusted regression model, evaluate regression assumptions and model stability. Inspect residual-versus-fitted plots for linearity and homoscedasticity, inspect a Q-Q plot or normality test for residual distribution, and calculate variance inflation factors to assess multicollinearity.
    3. Report these diagnostics in the Representative Results section or supplementary analysis output.
    4. If residual heteroscedasticity is detected, report heteroscedasticity-robust standard errors as a sensitivity analysis.
    5. If influential observations are present, report whether the primary coefficient for the IAT total score remains materially unchanged after influence diagnostics. Do not remove influential observations unless a prespecified data-quality rule is met.
    6. Report unstandardized coefficients, standard errors, standardized coefficients, p values, model R2, adjusted R2, model F statistic, and VIF range for the adjusted model. Include the sample size in the table title or table footnote.
    7. If interactions, subgroup effects, or mediation pathways are tested, specify those analyses before data collection or label them as exploratory. The core protocol does not require interaction testing unless subgroup differences are a predefined study aim.
    8. Save all statistical syntax, output tables, residual plots, VIF output, reliability output, and generated figures under version-controlled file names. Regenerate all reportable outputs directly from analytic_dataset_v1 rather than from manually edited files.
      NOTE: Keep the protocol text focused on workflow replication. Present the detailed representative statistics, subgroup figures, regression diagnostics, multicollinearity assessment, and model outputs in the Representative Results section.

Access restricted. Please log in or start a trial to view this content.

Results

Study flow and final analytic retention

The results demonstrate the execution of the standardized questionnaire workflow rather than independent validation of the Internet addiction test or the DERS-16. During the 14-day survey window, 520 university students were invited to participate, and 480 questionnaires were returned. Screening was conducted in the prespecified order. First, 8 duplicate submissions were removed, followed by 9 questionnaires with a completion time of les...

Access restricted. Please log in or start a trial to view this content.

Discussion

The main contribution of this article is the standardized questionnaire workflow rather than the representative association observed between internet addiction and emotion-regulation difficulty. The implementation showed that a fixed sequence of electronic consent, demographic items, internet-use behavior, IAT scoring, DERS-16 scoring, covariate collection, sequential data-quality screening, and reproducible regression analysis can be executed in a university-student sample. This procedural emphasis is important because ...

Access restricted. Please log in or start a trial to view this content.

Disclosures

The author has nothing to disclose.

Acknowledgements

This work was supported by the 2025 Henan Province Soft Science Project, “Research on the Impact and Optimization Path of Changes in School Age Population on the High Quality Development of Private Higher Education in Henan Province” (Project No. 252400410490), and the 2025 Doctoral Research Fund Project of Zhengzhou University of Economics and Business, “Research on the Formation Mechanism and Public Sentiment Guidance Mechanism of College Students’ Network Cluster Behavior.” The author thanks Zhengzhou University of Economics and Business for institutional support.

Access restricted. Please log in or start a trial to view this content.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
Analysis-ready datasetStudy-specific internal documentanalytic_dataset_v1.csv and analytic_dataset_v1.xlsxFinal anonymized dataset used for all reportable descriptive, reliability, correlation, and regression analyses
Analysis syntaxStudy-specific internal documentanalysis_syntax_v1.R or equivalent script fileUsed to reproduce scoring verification, reliability checks, descriptive statistics, correlation analysis, regression modeling, VIF calculation, and diagnostic output
Attention-check item wordingStudy-specific internal documentattention_check_v1.txtLocked wording of the directed-response attention-check item used during questionnaire administration
DERS-16 questionnaireOriginal scale source or authorized/adapted questionnaire version16-item Difficulties in Emotion Regulation Scale short formUsed to assess emotion-regulation difficulty; scoring follows the locked DERS-16 scoring key documented in the codebook
Electronic information sheet and consent pageStudy-specific internal documentconsent_form_v1.pdf or platform consent pageUsed to provide study information and obtain electronic informed consent before questionnaire access
File naming convention sheetStudy-specific internal documentfile_naming_convention_v1.xlsxUsed to standardize names for raw, cleaned, analytic, screening-log, codebook, and output files
Final questionnaire screenshotsStudy-specific internal documentquestionnaire_screenshots_v1.pdfUsed to document the locked survey display, item order, response anchors, and mandatory-item settings
Integrated development environmentPositRStudio DesktopUsed to manage scripts, logs, and reproducible analysis workflows
Internet Addiction Test questionnaireOriginal scale source or authorized/adapted questionnaire version20-item Internet Addiction TestUsed to assess internet-addiction symptoms and classify normal use, problematic use, and severe problematic use
Online survey platformQualtricsXM Platform; institutional or licensed accountUsed to build the questionnaire, enforce mandatory items, manage consent-based access, restrict repeated submissions where enabled, and export response data
Optional menu-driven statistical packageIBMSPSS StatisticsUsed when a GUI-based analysis workflow is required for descriptive statistics, reliability checks, or regression analysis
README/codebook fileStudy-specific internal documentREADME_v1.txt or codebook_v1.xlsxUsed to document variable names, coding rules, score ranges, reverse-coding rules, exclusion thresholds, file names, and software versions
Read-only archival copyPortable document formatPDF/A or institution-approved archival PDFUsed to preserve the locked survey instrument, consent page, and protocol-supporting documents
Screening log workbookStudy-specific internal documentscreening_log_v1.xlsxUsed to document duplicate screening, completion-time screening, attention-check failures, patterned responding, logical inconsistency, missingness, manual review decisions, and final retained counts
Spreadsheet softwareMicrosoftMicrosoft Excel workbook format (.xlsx)Used for screening logs, variable dictionary, manual review records, and supplementary workbook preparation
Statistical computing environmentR Foundation / CRANR 4.5.3Used for scoring verification, descriptive statistics, reliability checks, correlation analysis, regression analysis, VIF calculation, and diagnostic output
Supplementary File 1Study-specific supplementary fileSupplementary File 1.xlsxContains questionnaire workflow materials, codebook, screening log, output plan, and analysis-ready workflow materials
Supplementary Table S1Study-specific supplementary tableSupplementary Table S1Provides the complete variable dictionary, file presence, coding structure, technical identifier fields, screening variables, and dataset-tracking fields
Survey export documentQualtricsSurvey-to-Word export or PDF exportUsed to archive the final questionnaire wording, item order, branching settings, mandatory-item settings, and response coding
Survey export formatQualtricsCSV exportUsed for raw return preservation and analysis-ready data export

References

  1. Moreno MA, et al. Problematic internet use among US youth: a systematic review. Arch Pediatr Adolesc Med. 2011;165:797-805.
  2. Ramón-Arbués E, et al. Prevalence and factors associated with problematic internet use in a population of Spanish university students. Int J Environ Res Public Health. 2021;18:7620.
  3. Cai Z, et al. Associations between problematic internet use and mental health outcomes of students: a meta-analytic review. Adolesc Res Rev. 2023;8:45-62.
  4. Gong Z, Wang L, Wang H. Perceived stress and internet addiction among Chinese college students: mediating effect of procrastination and moderating effect of flow. Front Psychol. 2021;12:632461.
  5. Tsai JK, et al. Relationship between difficulty in emotion regulation and internet addiction in college students: a one-year prospective study. Int J Environ Res Public Health. 2020;17:4766.
  6. Romero-López M, Pichardo C, De Hoces I, García-Berbén T. Problematic internet use among university students and its relationship with social skills. Brain Sci. 2021;11:1301.
  7. Xie X, et al. Problematic internet use was associated with psychological problems among university students during COVID-19 outbreak in China. Front Public Health. 2021;9:675380.
  8. Montagni I, et al. Mental health-related digital use by university students: a systematic review. Telemed J E Health. 2020;26:131-146.
  9. Candussi CJ, Kabir R, Sivasubramanian M. Problematic smartphone usage, prevalence and patterns among university students: a systematic review. J Affect Disord Rep. 2023;14:100643.
  10. Moon SJ, Hwang JS, Kim JY, Shin AL, Bae SM, Kim JW. Psychometric properties of the Internet Addiction Test: a systematic review and meta-analysis. Cyberpsychol Behav Soc Netw. 2018;21:473-484.
  11. Jelenchick LA, Becker T, Moreno MA. Assessing the psychometric properties of the Internet addiction test in US college students. Psychiatry Res. 2012;196:296-301.
  12. Tafur-Mendoza AA, Acosta-Prado JC, Zárate-Torres RA, Ramírez-Ospina DE. Assessing the psychometric properties of the Internet addiction test in Peruvian university students. Int J Environ Res Public Health. 2020;17:5782.
  13. Fernández-Villa T, Molina AJ, García-Martín M, Llorca J, Delgado-Rodríguez M, Martín V. Validation and psychometric analysis of the Internet addiction test in Spanish among college students. BMC Public Health. 2015;15:953.
  14. World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013;310:2191-2194.
  15. Wei Z, Hassan NC, Hassan SA, Ismail N, Gu X, Dong J. Psychometric validation of Young’s Internet addiction test among Chinese undergraduate students. PLoS One. 2025;20:e0320641.
  16. Bjureberg J, et al. Development and validation of a brief version of the Difficulties in emotion regulation scale : the DERS-16. J Psychopathol Behav Assess. 2016;38:284-296.
  17. Muszyński M. Attention checks and how to use them: review and practical recommendations. ASK: Research and Methods. 2023;32:3-38.
  18. Broman KW, Woo KH. Data organization in spreadsheets. Am Stat. 2018;72:2-10.
  19. Leiner DJ. Too fast, too straight, too weird: non-reactive indicators for meaningless data in internet surveys. Surv Res Methods. 2019;13:229-248.
  20. Taber KS. The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ. 2018;48:1273-1296.
  21. Gioia F, Rega V, Boursier V. Problematic Internet use and emotional dysregulation among young people: a literature review. Clin Neuropsychiatry. 2021;18:41-54.
  22. Chen M, Zhang X. Factors influencing internet addiction among university students: the mediating roles of self-control and anxiety. Acta Psychol (Amst). 2024;250:104535.
  23. Akbari M, Seydavi M, Sheikhi S, Spada MM. Problematic smartphone use and sleep disturbance: the roles of metacognitions, desire thinking, and emotion regulation. Front Psychiatry. 2023;14:1137533.
  24. Wang S, Cheng Y, Yang Y, Lu B. The impact of physical activity on internet addiction among college students: the chain mediation role of rumination and mindfulness. BMC Public Health. 2025;25:3643.
  25. Struminskaya B, Sakshaug JW. Ethical considerations for augmenting surveys with auxiliary data sources. Public Opin Q. 2023;87:619-633.
  26. Yin J, et al. Associations between both smartphone addiction and objectively measured smartphone use and sleep quality and duration among university students: a cross-sectional study. JMIR Ment Health. 2025;12:e77796.
  27. Hainagiu SM, Neagu SN. Caught in the Web—emotional regulation difficulties and internet addiction among Romanian medical and technical university students: a pilot cross-sectional study. Healthcare (Basel). 2025;13:2528.
  28. Guo C, Chen M, Ji X, Li J, Ma Y, Zang S. Association between internet addiction and sleep quality in medical students: a longitudinal study. Front Psychol. 2025;16:1517590.
  29. Barker M, Chue Hong NP, Katz DS, Lamprecht AL, Martinez-Ortiz C, Psomopoulos F, et al. Introducing the FAIR Principles for research software. Sci Data. 2022;9:622.
  30. Nosek BA, Alter G, Banks GC, Borsboom D, Bowman SD, Breckler SJ, et al. Promoting an open research culture. Science. 2015;348:1422-1425.

Access restricted. Please log in or start a trial to view this content.

Reprints and Permissions

Explore More Articles

Behavioral AssessmentPsychological AssessmentInternet Addiction TestEmotion Regulation ScaleData Quality ScreeningRegression Analysis