This protocol describes an anonymous, cross-sectional questionnaire procedure for assessing university teachers’ professional development motivation, teaching self-efficacy, engagement, and reflective practice.
A subscription to JoVE is required to view this content. Sign in or start your free trial.
Method Article
This protocol describes an anonymous, cross-sectional questionnaire procedure for assessing university teachers’ professional development motivation, teaching self-efficacy, engagement, and reflective practice.
University teachers participate in professional development under different institutional, disciplinary, and motivational conditions. Participation records alone cannot explain whether professional development translates into meaningful professional learning. This article presents a reproducible, anonymous, cross-sectional survey protocol for assessing psychological need satisfaction, autonomous and controlled motivation, teaching self-efficacy, professional development engagement, and reflective practice from a self-determination theory perspective. The protocol specifies eligibility screening, stratified convenience sampling, questionnaire construction, expert review, pilot testing, online administration, anonymization, response-quality screening, scale scoring, reliability estimation, correlation analysis, hierarchical regression, and sensitivity analyses. It also clarifies scale adaptation, permission verification, construct scoring, and the interpretation of highly reliable scales as potential indicators of item redundancy. Representative results were obtained from one completed implementation of the protocol, in which 326 submitted records were exported and 313 valid responses were retained after prespecified screening. The results showed that autonomy, competence, and relatedness need satisfaction were positively associated with autonomous motivation, and that autonomous motivation and teaching self-efficacy were associated with professional development engagement. The protocol is suitable for standardized, multi-institutional, survey-based studies of the motivational and professional belief correlates of professional development engagement. It is less suitable for causal inference, longitudinal change estimation, direct behavioral outcomes, or institution-level program evaluation unless repeated measurements, observation, qualitative inquiry, or administrative data are added.
Teacher professional development is widely used to support teaching quality, instructional improvement, and professional learning, but its effects are difficult to interpret when evaluation is limited to attendance, exposure, or the number of completed training hours1,2. Professional development research requires a clear conceptualization of the mechanisms linking learning activities with teacher change because participation does not necessarily indicate engagement, perceived usefulness, or subsequent reflection1. In university settings, teachers work across different disciplines, appointment types, workload conditions, and institutional expectations. A survey protocol that measures psychological and professional belief conditions can therefore complement activity-based monitoring by examining how teachers experience and carry forward professional development. Alternative approaches serve different evaluation purposes. Attendance-based evaluation is efficient for documenting reach, compliance, and program uptake, but it provides limited information about motivation, perceived capability, or engagement quality. Qualitative interviews, focus groups, and reflective narratives provide richer accounts of professional learning experiences, but they are less suitable for standardized measurement across several institutions or larger samples. Longitudinal designs are preferable for estimating change over time, temporal ordering, or delayed teaching outcomes. Institution-level evaluation frameworks are useful for monitoring program delivery, resource allocation, and organizational accountability. The present protocol is most appropriate when the aim is to conduct an anonymous, cross-sectional, multi-institutional survey using reproducible scoring, cleaning, and analysis procedures.
The protocol treats professional development as a professional learning process rather than as a single institutional event. Opfer and Pedder conceptualized teacher professional learning as a complex process shaped by interactions among individual, workplace, and learning-activity systems3. This perspective is relevant to university teachers because the same activity may be experienced differently depending on perceived choice, instructional confidence, collegial support, workload pressure, and disciplinary relevance. The protocol therefore assesses psychological need satisfaction, professional development motivation, teaching self-efficacy, professional development engagement, and reflective practice, in addition to participation background. Self-determination theory provides the motivational basis for the protocol. The theory distinguishes autonomous motivation, in which behavior is experienced as personally endorsed or meaningful, from controlled motivation, in which behavior is driven mainly by pressure, obligation, or external demand4. It also identifies autonomy, competence, and relatedness as basic psychological needs that support self-endorsed action and sustained engagement5. In university teachers’ professional development, autonomy refers to perceived choice and professional discretion in selecting or using development activities; competence refers to perceived growth in teaching capability; and relatedness refers to collegial connection, professional belonging, and constructive exchange. These constructs allow the protocol to examine why teachers participate and how the professional development environment is experienced.
Teaching self-efficacy is included because motivation alone does not determine whether teachers feel able to apply professional development content in teaching practice. Teacher self-efficacy refers to teachers’ beliefs about their capability to organize and perform teaching-related actions, and it has been linked to instructional behavior, persistence, enthusiasm, and student-related outcomes6. Guskey’s model of teacher change further suggests that professional development becomes meaningful when teachers can connect new practices with evidence of improvement7. In this protocol, teaching self-efficacy is treated as a professional belief variable that may help explain whether professional development is carried into classroom, online, laboratory, studio, clinical, or supervisory teaching contexts. Professional development engagement is defined as active involvement in professional development activities, attention to the learning process, effort to connect professional development content with teaching, continued learning after the activity, and willingness to participate in future professional learning. This construct is related to the broader engagement literature, where vigor, dedication, and absorption describe sustained involvement in work-related activities8. However, professional development engagement is not treated as identical to general work engagement or as a count of professional development participation. It is measured as a narrower professional-learning response that captures how teachers participate in, process, and continue to use professional development experiences. Reflective practice is included as a brief indicator of post-activity review, evaluation of teaching usefulness, revision of teaching strategies, and documentation or discussion of learning outcomes9.
A survey protocol also requires prespecified response-quality and measurement procedures. Anonymous online questionnaires can produce short-duration responses, missed items, attention-check failures, and invariant response patterns. Careless-response screening is more defensible when multiple indicators are combined rather than when a single exclusion rule is used10. The protocol therefore specifies completion-time thresholds, instructed-response attention checks, missingness rules, invariant-response screening, and traceable exclusion coding before scale scoring. Internal consistency is estimated using Cronbach’s alpha and McDonald’s omega because alpha alone can be misleading under some measurement conditions11. Very high reliability values are interpreted cautiously because they may indicate item redundancy rather than stronger measurement. The primary analysis treats each construct as an observed scale score for descriptive statistics, reliability estimation, correlation analysis, hierarchical regression, and sensitivity analyses. Studies using this protocol for scale development, cross-cultural comparison, or high-stakes measurement should add exploratory or confirmatory factor analysis before interpreting structural associations, especially when construct correlations are high or translated items are used. The cross-sectional design can estimate associations among psychological need satisfaction, motivation, teaching self-efficacy, professional development engagement, and reflective practice, but it cannot establish temporal order, causal effects, or behavioral change. Because all main variables are self-reported by the same respondents, social desirability and common-method bias remain possible despite anonymity, neutral wording, response-quality screening, and sensitivity analyses12. The protocol is therefore less suitable for causal inference, longitudinal change estimation, direct assessment of teaching behavior, or institution-level program evaluation unless repeated measurements, qualitative inquiry, classroom observation, teaching artifacts, or administrative program data are added. Within its intended scope, the protocol provides a standardized method for examining the motivational and professional belief constructs associated with university teachers’ professional development engagement and reflective professional learning13.
Access restricted. Please log in or start a trial to view this content.
The study protocol was reviewed and approved by the Universiti Malaya Research Ethics Committee (Non-Medical) on 7 August 2025 (Reference No. UM.TNC(P&I)/UMREC_4864). Local administrative permission was obtained from each participating university before recruitment when required. Electronic informed consent was collected before eligibility screening and questionnaire administration. No names, staff identification numbers, telephone numbers, institutional email addresses, Internet Protocol addresses, geolocation data, device identifiers, exact department names, or open-text identifiers were collected. Submitted responses were assigned anonymous respondent codes and stored in encrypted institutional storage according to the approved data-retention procedure.
This protocol standardizes an anonymous, cross-sectional questionnaire procedure for assessing university teachers’ professional development motivation, basic psychological need satisfaction, teaching self-efficacy, professional development engagement, and reflective practice. The protocol uses self-determination theory to distinguish autonomous motivation from controlled motivation in professional development participation14.
1. Study design and workflow
2. Participant eligibility and sampling plan
3. Questionnaire structure and construct map
4. Construct measurement and item allocation
5. Expert review and item refinement
6. Translation and language verification
7. Pilot testing
8. Online survey setup
9. Recruitment procedure
10. Data export and anonymization
11. Response-quality screening
12. Missing-data handling and scale scoring
13. Statistical software setup and script execution
14. Reliability and item diagnostics
15. Descriptive and correlation analysis
16. Regression analysis
17. Sensitivity analysis and reproducibility check
Access restricted. Please log in or start a trial to view this content.
Participant flow and status of the representative dataset
The representative results reported here were generated from one completed implementation of the protocol. The dataset was collected through the anonymous, cross-sectional questionnaire procedure described above and was not drawn from the pilot test or an illustrative dataset. A total of 326 submitted questionnaire records were exported from the online survey platform. After the prespecified consent, eligibility, respon...
Access restricted. Please log in or start a trial to view this content.
The representative results indicate that the protocol can be used to examine university teachers’ professional development beyond attendance, training hours, or completion records. Autonomy, competence, and relatedness need satisfaction were all positively associated with autonomous motivation, and these associations remained after background variables were entered into the model. This finding is consistent with the self-determination theory assumption that self-endorsed motivation is supported when individuals exp...
Access restricted. Please log in or start a trial to view this content.
The authors declare that they have no competing financial or non-financial interests related to this work.
The authors thank the university teachers who participated in this study for their time and willingness to share their professional development experiences. No specific funding was received for this work.
Access restricted. Please log in or start a trial to view this content.
| Name | Company | Catalog Number | Comments |
|---|---|---|---|
| Adobe Acrobat Pro | Adobe Inc., San Jose, CA, USA | Adobe Acrobat Pro 2024 | Used to review the final questionnaire PDF, participant information sheet, consent form, exported figures, and submitted supplementary files. |
| Analysis script | Prepared by the research team | analysis_script.R | Runs data import, anonymization checks, response-quality screening, missingness calculation, scale scoring, descriptive statistics, reliability analysis, correlation analysis, regression models, diagnostic checks, sensitivity analyses, table export, figure export, and session-information export. |
| Cleaned Teacher PD Survey CSV | Generated from analysis_script.R | cleaned_teacher_PD_survey.csv | Contains de-identified retained and excluded records with inclusion status, exclusion reason, screening variables, and cleaned background variables. |
| Codebook | Prepared by the research team | codebook.xlsx | Defines variable names, item codes, response coding, missing-value coding, scale-score formulas, inclusion status, exclusion reasons, table variables, and output file names. |
| Desktop computer | Windows 11 Pro | Not Applicable; Institutional research computer: 16 GB RAM and full-disk encryption enabled. | Used for survey programming, data export, script execution, table generation, figure export, and secure file archiving. |
| Ethics approval document | Institutional human research ethics committee | ethics_approval.pdf | Documents ethics approval before recruitment, including approval number, approval date, approved study title, investigator information, and approved recruitment and data-handling conditions. |
| Institutional permission records | Participating universities | institutional_permission_records.pdf | Contains written permission records from participating universities for teacher recruitment through approved institutional channels. |
| Microsoft Excel | Microsoft Corporation, Redmond, WA, USA | Microsoft Excel 365 | Used to inspect exported datasets, prepare the codebook, review screening logs, and check exported table files. The analysis dataset was not manually edited after script-based cleaning. |
| Participant information sheet and consent form | Prepared by the research team and approved by the ethics committee | participant_information_and_consent. | Provides study purpose, eligibility criteria, voluntary participation statement, anonymity statement, risks and benefits, data-retention information, investigator contact details, ethics information, and electronic consent wording. |
| Questionnaire file | Prepared by the research team | questionnaire.pdf | Contains the locked questionnaire, item order, item codes, response options, eligibility items, background items, construct items, and attention-check items. |
| R package manifest | Generated from the R environment | package_manifest.txt | Lists the R packages and package versions used for data import, cleaning, scoring, reliability estimation, regression diagnostics, visualization, output generation, and reproducibility checking. |
| R statistical software | R Foundation for Statistical Computing, Vienna, Austria | R 4.3.2 | Used for data cleaning, scale scoring, statistical analysis, diagnostic checking, figure generation, table export, and reproducibility verification. |
| Reproducibility package | Prepared by the research team | reproducibility_package.zip | Contains questionnaire.pdf, codebook.xlsx, cleaned_teacher_PD_survey.csv, scored_teacher_PD_survey.csv, screening_log.xlsx, analysis_script.R, sessionInfo.txt, package_manifest.txt, table outputs, figure outputs, and diagnostic plots. |
| RStudio Desktop IDE | Posit Software, PBC, Boston, MA, USA | RStudio Desktop 2023.12.1 | Used to run, document, and review analysis_script.R. |
| Scored Teacher PD Survey CSV | Generated from analysis_script.R | scored_teacher_PD_survey.csv | Contains included responses and calculated scale scores, including AUT_MEAN, COM_MEAN, REL_MEAN, AM_MEAN, CM_MEAN, TSE_MEAN, PDE_MEAN, and RP_MEAN. |
| Screening log | Generated from analysis_script.R and reviewed by the research team | screening_log.xlsx | Records consent, eligibility, completion-time screening, attention-check outcomes, missingness, invariant-response flags, exclusion reasons, recoding decisions, and final inclusion status. |
| Secure institutional storage | Participating university information-technology service | Encrypted institutional research drive | Used to store raw data, cleaned data, scored data, codebook, screening log, questionnaire, analysis script, ethics documents, permission records, table outputs, figure outputs, and the reproducibility package. Access was restricted to approved research personnel. |
| Session information file | Generated from R | sessionInfo.txt | Records R version, operating system, attached packages, package versions, and reproducibility environment. |
| Table and figure outputs | Generated from analysis_script.R | outputs_tables_figures folder | Contains participant-flow output, descriptive tables, reliability tables, correlation matrix, regression tables, sensitivity-analysis tables, construct-score figures, and diagnostic plots. |
| Wenjuanxing / Questionnaire Star online survey platform | Changsha Ranxing Information Technology Co., Ltd., Changsha, China | Wenjuanxing web survey project | Used for electronic consent, anonymous questionnaire administration, eligibility branching, attention-check items, completion-time recording, one-response-per-browser setting, and export of questionnaire records. |
Access restricted. Please log in or start a trial to view this content.