A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Summary

This protocol presents the step-by-step method for using a writing-based, valid, and reliable application designed for kindergarten-level education. It operates as a curriculum-based assessment tool, specifically focusing on evaluating early writing skills in young learners.

Abstract

Kindergarten writing involves acquiring fundamental skills, such as letter formation, phonemic awareness, and the gradual use of written language to express ideas. In this context, tablet-based curriculum assessments present new opportunities for teaching and evaluating these early writing abilities. To the best of our knowledge, there is currently no tool with these features available for Spanish-speaking children. Therefore, the primary objective of this study was to present a tablet-based protocol for screening at-risk young writers. This tablet-based protocol is specifically designed for kindergarten-level education and serves as a curriculum-based assessment tool that focuses on evaluating early writing skills in young learners. This user-friendly application incorporates interactive tasks and exercises, including assessments of phonological awareness, name writing, alphabet letter copying fluency, and oral narrative skills. These comprehensive evaluations cover various aspects of writing. This application is meticulously aligned with kindergarten curriculum objectives, ensuring that assessments adhere to educational standards. By providing educators with a digital platform to assess and enhance students' writing skills, this tool empowers them to make data-driven decisions for effective instruction during the early stages of writing development. Moreover, it functions as a curriculum-based measurement (CBM), offers valuable support for identifying potential writing challenges in young learners and continuously monitoring their progress. This feature enables early intervention and tailored instruction to optimize writing skill development.

Introduction

The primary aim of this study is to introduce a multimedia assessment protocol for kindergarten students aimed at identifying potential writing difficulties and exploring its internal structure and diagnostic accuracy.

At the kindergarten level, writing marks the beginning of a child's literacy journey. It goes beyond scribbles and shapes, representing the foundation for communication and creative expression. The acquisition of writing skills is a matter of paramount concern because it requires the attention of parents, educators, children, and scholars alike. The World Health Organization (WHO)¹ (2001) designated writing difficulties as a significant impediment to school participation, a pivotal component in a child's normative developmental trajectory. Writing, serving as an indispensable medium, empowers children to articulate their knowledge and thoughts, enabling their participation across a spectrum of academic endeavors². However, this deceptively elementary undertaking is far from simplistic and encompasses many intricate processes. Children must invest time and diligence to acquire and refine this nuanced skill. The transition from ideation to orthographic representation necessitates the orchestration of cognitive, linguistic, and motor processes.

Numerous national reports have shed light on the prevalence of students failing to attain the requisite proficiency levels in writing. For instance, in Spain, the Instituto Nacional de Evaluación Educativa [National Institute for Quality and Evaluation] (INEE) unveiled the results of its assessment conducted during the 1999-2000 academic year for Primary and Secondary Education³. The evaluation revealed that students' performance in writing not only fell below the expected standards but also underscored substantial shortcomings in classroom instruction and pedagogical preparation. Additionally, Spain's Ministry of Education issued a General Diagnostic Assessment Report in 2009, which further underscored the levels of foundational skills among fourth-year primary education students⁴. In Article 20.3 of Organic Law 2/2006, dated May 3, pertaining to Education (LOE), which was subsequently amended by Organic Law 8/2013, enacted on December 9, aimed at enhancing educational quality (LOMCE), the introduction of a diagnostic assessment for third-year primary education was established⁵. This legislative provision stipulated that 'educational institutions shall administer an individualized evaluation for all students upon completing the third year of primary education.' The primary objective of this assessment was to ascertain the extent of proficiency in skills, competencies, and abilities encompassing oral and written expression, comprehension, calculation, and problem-solving. This evaluation was conducted to evaluate the acquisition of competence in linguistic communication and mathematical proficiency. The formulation of the General Framework for this assessment was a collaborative effort involving the active engagement of 14 educational authorities and the Ministry of Education, Culture, and Sport (MECD). In 2010, in the comprehensive diagnostic assessment for secondary education (ESO), concerning the processes of written expression, a low score was obtained in the presentation of written work. It also underscored a disquieting educational landscape in Spain, particularly concerning language proficiency⁶.

Mastering the art of writing is a formidable challenge that demands intricate cognitive processing. There are two models of writing that have received significant conceptual support: The simple view of writing model (SVW)^7,8 and the not-so-simple view of the writing model (NSVW)^9,10. The latter, a revision of the previous one, postulates that transcription skills, such as handwriting fluency and spelling, collaborate with self-regulatory functions, including attention, goal setting, and revision, in addition to working memory, in the nuanced process of text generation. This process involves the dual tasks of idea generation and transforming those ideas into linguistic propositions intricately linked with oral language skills. Both transcription skills^11,12 and oral language proficiency^13,14,15 are robustly acknowledged as predictive factors in the early development of writing. Due to the intricate nature of writing, certain students encounter difficulties in attaining proficiency. Writing disabilities not only detrimentally impact self-efficacy and academic motivation but can also persist into adulthood, negatively influencing future workplace experiences and emotional well-being^16,17. The DSM-V defines learning disabilities in writing as follows: With impairment in written expression (315.2 F81.81): skills in spelling, grammar, punctuation, clarity, and organization of written expression are affected. Additionally, the DSM-V specifies that in this disorder, the individual may add, delete, or substitute vowels or words. As a result, written work is often illegible or difficult to read. An impairment in writing skills significantly interferes with academic achievement or activities of daily living that require the composition of written text (APA, 2013)¹⁸.

The assessment protocol targets key components such as alphabet copying, phonological awareness, name writing, expressive vocabulary, and oral narrative skills. Alphabet copying is defined as the process of having children reproduce letter forms by tracing, copying, or writing over models of individual alphabet letters. This task relies predominantly on motor reproduction skills rather than long-term memory, with enhanced performance correlating with the automation of motor reproduction routines¹⁹. Phonological awareness, on the other hand, assesses children's understanding of the sound structure of language. Specifically, it involves the explicit knowledge that words can be segmented into a sequence of phonemes and that phonemes can be blended into words²⁰. Name writing, according to Puranik and Lonigan²¹, is defined as the ability to reproduce one's own name in writing, which is considered an important developmental milestone in early literacy and the first step toward mastering the alphabetic principle. Expressive vocabulary refers to the words a child can use to communicate their thoughts, feelings, and ideas through spoken language. It is a crucial aspect of language development in early childhood²². Finally, oral narrative skills encompass the ability of young children to understand, produce, and convey stories through spoken language. This involves sequencing events in a logical order, providing relevant details, and using appropriate language structures to recount personal experiences or fictional tales²³. These skills are typically assessed by having children retell stories or generate narratives based on picture prompts, with measures evaluating elements such as story structure, use of evaluative language, temporal and causal connections, and overall coherence²⁴.

Early assessment protocols are crucial for detecting students at risk of writing disabilities before the problem develops. Extensive research has shown that early detection leads to a better prognosis. In the context of the Response to Intervention (RTI) model, Curriculum-Based Measurements (CBMs) are often used for universal screening and progress monitoring because they are quick, practical, reliable, valid, accurate, and sensitive to the time of measurement^25,26,27. The CBM process involves evaluation at three distinct points during the course (normally in autumn, winter, and spring). This process allows us to identify students at risk and decide whether the intervention should be modified or if the progress is acceptable. However, there is limited scientific literature on early detection tools for the writing processes compared to other academic areas, such as reading or mathematics²⁸.

Technological advances in education
The use of touchscreen tablets among young children is increasing in the home and early childhood education centers²⁹. A review of the most recent scientific literature highlights the relevance and advantages of CBMs generated through the use of digital means (i.e., tablets)³⁰. In recent years, the usability and applicability of CBMs have garnered significant attention. This is associated with inquiries into the successful implementation of progress monitoring tools within educational practice³¹. In this context, the significance of modern digital media in the educational domain is gaining recognition³². A curriculum-based assessment tool with the dual purpose of screening and progress monitoring utilizing tablet technology would offer numerous advantages for educators^33,34,35. With this type of digital medium (i.e., tablets), the advantages outweigh the disadvantages of conducting assessments aimed at early detection of learning difficulties (i.e., screening) in the core academic areas of reading, writing, and mathematics, as well as assessments designed to monitor students' learning progress in these academic domains. This is attributed to the fact that digital assessments (whether conducted via computers or tablets) lead to increased time efficiency. Particularly concerning assessment data collection, presentation, and documentation tasks typically performed by teachers, these processes can be automated and executed far more efficiently in terms of resource utilization³⁶. Moreover, providing support for data interpretation becomes much more straightforward. In addition, research indicates that tablet-based assessments are well received by teachers and result in greater learning gains^37,38. In contrast, despite the potential advantages of tablet-based assessments, researchers have highlighted several drawbacks that should be considered. Bremer and Tillmann³⁹ emphasize the significant costs associated with acquiring and maintaining tablets, as well as concerns about exacerbating existing inequalities in access to technology. Additionally, tablets often have limited processing power, storage capacity, and input capabilities compared to laptops, which can hinder their functionality for demanding computational tasks or extended typing³⁹. These limitations may impact the effectiveness of tablet-based assessments, particularly in scenarios requiring advanced data analysis or extensive written responses. Furthermore, technical challenges such as reduced processing power, storage constraints, input difficulties, small screen size, connectivity issues, battery limitations, and compatibility concerns with assessment software or platforms can hinder their usability^40,41. Moreover, engagement and distraction risks pose significant concerns, as digital assessments may struggle to maintain children's focus during testing⁴². Careful consideration of these factors is crucial when utilizing tablets for educational evaluation.

Overall, in light of the information presented in this report, the feasibility of CBMs utilizing tablets in the classroom appears promising and is increasingly needed in a digital society. This assertion is further substantiated by findings indicating that many children are gaining access to tablets both at school and at home⁴³. In recent years, several tablet-based apps have been developed for the assessment of early literacy skills^44,45,46. Neumann et al.⁴⁶evaluated the psychometric properties of tablet-based literacy assessments, focusing on both validity and reliability. They tested an app designed to assess expressive and receptive literacy skills in a sample of 45 children aged 3 to 5 years. The children used the app on a tablet to complete assessments related to alphabet and word recognition skills. The results indicated that tablet-based assessments utilizing both expressive and receptive response formats offer a valid and reliable way to measure early literacy skills in young children. The purpose of the study conducted by Chu and Krishnan⁴⁴ was to develop and determine the validity of a computerized tool called the Quantitative Assessment of Prewriting Skills (QAPS) for assessing the pattern of children's copying to measure their visual-motor skills. The authors demonstrated that the QAPS is feasible and adequate for measuring and distinguishing the drawing skills of typically developing children and children with visual motor deficits. Similarly, Dui et al.⁴⁵ designed a novel tablet-based app, Play Draw Write, which was tested among healthy children with mastered handwriting (third graders) and those at a preliterate age (kindergartners). Their findings provide evidence for the effectiveness of tablet technology in quantitatively evaluating handwriting production. Additionally, they propose that a tablet-based application holds the potential for identifying handwriting difficulties at an early stage. Nevertheless, it is worth noting that none of these studies have evaluated the diagnostic accuracy required for identifying children at risk of writing-related learning disabilities. Therefore, there is a need for precise classification data to validate the effectiveness of such a screening tool. The classification accuracy of a screening tool is determined by how well it identifies students as at risk or not at risk compared to a later writing outcome. Researchers often report the area under the curve (AUC), a measure of overall classification accuracy. The AUC serves as a diagnostic performance index by combining sensitivity and specificity into a single measure. It classifies students as at-risk or not at-risk, using their performance on another standardized test as the criterion. The following intervals were used to interpret the AUC: high, AUC > .90; good, AUC > .80-.90; moderate, AUC = .70-.79; and low, AUC= .50-.69⁴⁷.

Screening tools and their respective cutoff scores for risk determination must balance sensitivity and specificity, meaning that increasing sensitivity tends to decrease specificity and vice versa. Sensitivity represents the proportion of students identified as at risk on the screening tool and at risk on the outcome measure (true positives) from all students who scored at risk on the outcome measure (true positives plus false negatives). Essentially, a high sensitivity value indicates that fewer students at risk are missed during the screening process. If the screening tool lacks sensitivity and fails to identify these students, they will not receive the necessary intervention. Conversely, specificity represents the proportion of students accurately identified as not at risk by both the screening tool and the outcome measure (true negatives) among all students classified as not at risk by the outcome measure (including true negatives and false positives). Increased specificity leads to a reduction in false positives. Schools prioritize minimizing false-positive identifications during screening because excessive identification of students as at risk³⁹ (i.e., identifying a large number of false positives) strains resources allocated for intervention services. Although there is no universally agreed-upon standard for acceptable values of these indices, achieving high sensitivity values in universal screening is paramount importance^48,49.

Over the past few years, various paper-and-pencil screening instruments have been designed to assess writing proficiency among Spanish-speaking students at the kindergarten and elementary school levels. Specifically, the Indicadores de Progreso de Aprendizaje en Escritura (IPAE) serves a tailored CBM for elementary grades⁵⁰. In contrast, the Early Grade Writing Assessment in Kindergarten (EGWA-K) specifically targets kindergarten students, providing a Spanish standardized test that assesses fundamental literacy skills. It includes tasks such as transcribing words from images, segmenting pseudowords into phonemes, writing freely chosen words, and narrating a story based on a drawing. These diverse tasks demonstrate high reliability and validity in evaluating early writing abilities⁵¹.

However, to our knowledge, no technology-based CBM tools have yet been developed for Spanish language assessment for screening and monitoring learning progress in early-age writing. Recognizing the importance of identifying young children who may struggle with writing and the lack of computerized tools for the Spanish-speaking population, this study aimed to introduce a multimedia assessment protocol for kindergarten students and explore its internal structure and diagnostic accuracy.

Protocol

The protocol presented here was conducted in accordance with the guidelines provided by the Comité de Ética de la Investigación y Bienestar Animal (Research Ethics and Animal Welfare Committee, CEIBA), Universidad de La Laguna. The data were collected at three different time points, capturing information exclusively from students whose parents, administrations, and schools provided consent.

NOTE: The app used in the protocol is Tablet App Indicadores de Progreso de Aprendizaje en Escritura para Educación Infantil [Basic Early Writing Skills for Kindergarteners] (T-IPAE-K). It includes five tasks: 1) Copying Alphabet Letters, 2) Name Writing, 3) Expressive Vocabulary, 4) Phonological Awareness, and 5) Oral Narrative. A pedagogical agent provides instructions for each task, along with one or two trials (depending on the task) and a demonstration before the testing phase begins. An example of the application protocol for each task is provided below:

1. Experimental setup

1. Use the following inclusion criteria: Ensure that students belong to the last year of kindergarten and are native Spanish speakers. Ensure they can follow instructions properly.
2. Use the following exclusion criteria: Exclude children with special educational needs (i.e., those who require support and specific educational attention due to their sensory impairment or acquired neurological problems, among others; these are traditionally used as exclusionary criteria for learning disabilities or severe behavioral disorders, either temporarily or throughout their schooling).
3. Install the application on the children's tablets. This application is installed on tablets using a single file with the .APK extension, which is the type of file used by Android to distribute and install applications
   NOTE: The file contains an automated installer that allows the user to select the location of the installation. The installer detects previous versions of the tool and warns the user of possible updates. These updates do not delete the saved data of the previous versions.
   1. Upon initial access to the application, users encounter a menu presenting several options: 1) Evaluar [initiate the game], 2) Corregir [rectify assignments], 3) Modificar [update student data], and 4) Nuevo [include new students]
   2. Initiate the process by creating the student profile. Enter essential details like 'Student Code,' [codigo] 'Date of Birth,'[Fecha de Nacimiento] 'Application Date,' [Fecha de aplicación] 'School Name,' [Nombre del colegio] etc. Click Save [guardar] to finalize the new student profile and update the information later in the 'modify' [Modificar] section if necessary (see Figure 1).
   3. Before starting tasks, check that everything is working. Click Examiner, then Check Peripherals to confirm touch screen, keyboard, voice key, and recorder functionality. Save the configuration by clicking OK.
      NOTE: Each task is highlighted within a green box. The tasks are the following: Copia de letras [Copying alphabet letters], Vocabulario expresivo [Expressive vocabulary], Escritura del nombre [Name writing 1st part, 2nd part], Conciencia fonológica aislar [Phonological awareness], and Narrativa oral [Oral narrative].
   4. Perform each task highlighted in green. Upon task completion, ensure that the Menu returns to the task section and the box changes to red, signaling to both the examiner and the student that the task has been completed (see Figure 2).
   5. Examine children in the last year of kindergarten in a single session of approximately 25 min. Administer the task in a quiet room. Use the external keyboard to either correct after completing the task or to record hits and misses while performing the task, depending on the task.
      NOTE: No headsets are needed, as instructions can be heard using the tablet's built-in speakers. The program itself can be recorded through the tablet.
   6. Perform the task.
      1. Provide oral instruction about the task and demonstrate the procedure with the help of an in-built pedagogical agent.
      2. Ensure that the pedagogical agent provides initial instruction to the students on what the game is about and how to play it.
      3. When the pedagogical agent asks the students if they have understood the task, ensure that the student clicks the green tick if the answer is 'yes' or the red cross if the answer is 'no' (see Figure 3).
      4. Depending on the answer, execute the task with the help of the pedagogical agent on the students. Ensure they perform the task independently without any help.
         NOTE: The pedagogical agent is not present when the student is performing the task.
4. Once the task has been completed, ensure the pedagogical agent provides the correct feedback.
5. Repeat the initial instructions if the task is not understood.
   NOTE: When a student clicks the "I did not understand" option for the second time, the assignment gets coded in the database as "the student was not able to perform the task" and the task will be marked as completed.

Figure 1: CBM main and new student menu Please click here to view a larger version of this figure.

Figure 2: Tasks before and after completion of the alphabetic copying letter task Please click here to view a larger version of this figure.

Figure 3: "Did you understand?" screen Please click here to view a larger version of this figure.

2. Tasks

Figure 4: Demonstration of a student's performance in the alphabetic copying letter task Please click here to view a larger version of this figure.

1. Copying the alphabet
   1. To access the task, click Evaluation [Evaluar] and select Copying the letters [Copia de letras].
   2. Let the pedagogical agent provide instructions and model the task. An example is shown in Figure 4.
   3. Press the Continue key on the external keyboard to proceed.
   4. Ask the student if he/she understood the task and ask them to click Yes or No accordingly. Guide if needed.
   5. Begin the task: Ask the student to reproduce vowels as presented on the screen within 1 min, presented sequentially.
   6. Use the external keyboard's Continue key after completing each letter.
   7. After finishing the task, press the Exit door as directed by the pedagogical agent.
   8. Open the Correct [corrección] section of the main menu and click on Copying the letters" [copia de letras].
   9. Record both correct and incorrect letters on the screen.
   10. Click on the box to be filled and use the external keyboard to enter the number of letters typed, correct letters, or errors (misalignment, omission, addition, or inversion)
   11. Using the external keyboard, identify and note the correct and incorrect letters. Also note alignment, total or partial inversions, and the addition or omission of strokes in the corresponding section.
       NOTE: A letter is considered correct if its free of errors presented in step 2.1.10. Also, add the type of pencil grip the student used. The examiner uses images of different types of grips to identify which one the child uses while writing. There are no specific citations for the type of grip as it is based on visual assessment by the examiner.
   12. Once the correction is finished, click Save [guardar].
   13. Calculate the number of correct letters (maximum score: 5) and note any errors in alignment, inversions, additions, or omissions (see Figure 5).
       ​NOTE: Correct letters are defined as those without the following errors: misalignment, reversals, added strokes, and missing strokes. Misalignment refers to the distance between where a letter is intended to be positioned on the baseline and where it is placed. Reversals occur when a letter or part of it is reversed or rotated incorrectly (e.g., e/ǝ/, a/ɒ, u/n). Added strokes are any strokes not belonging to the original letter from the template while missing strokes refer to the absence of any stroke in the original letter on the answer sheet⁵².

Figure 5: Example of a student's performance correction in the alphabetic copying letter task Please click here to view a larger version of this figure.

2. Expressive vocabulary
   1. To access the task, click Evaluation [Evaluar] and then, select Expressive Vocabulary [Vocabulario expresivo].
   2. Ensure that the pedagogical agent provides instructions to the student, followed by the modeling section (refer to Figure 6). Two example items will be presented.
   3. React to the student's performance using the Correct or Incorrect keys on the external keyboard.
   4. If the student obtains examples wrong, offer corrective feedback by showing the correct answer.
   5. Ask the student if they have understood the task by pressing the Yes or No button on the display. If necessary, guide their answer.
   6. Once the final step is completed, ensure that the task starts. Images will appear individually for each of the ten items. Record the correct hits (through the Correct key) and misses (through the Incorrect key) using an external keyboard. Synonyms associated with the image names are also considered correct.
   7. After completing the task, press the Exit door as directed by the pedagogical agent.
      NOTE: The tablet automatically calculates the total number of hits, with 10 being the maximum score.

Figure 6: An example item of the expressive vocabulary Please click here to view a larger version of this figure.

3. Name writing
   1. To access the task, click on Evaluation [Evaluar] and then select Name Writing [Escritura del nombre].
   2. The first part of the task begins first. Let the pedagogical agent offer the student the instruction and modeling part. In the first part, the pedagogical agent says, "Let's do an example; I am going to write my name", and the examiner accompanying the child must write his/her name as an example (refer to Figure 7).
   3. Then, ask the student if they have understood the task by clicking the Yes or No button on the screen. Provide guidance if necessary.
   4. During the first part of the task execution, students write their names within the given guidelines in less than 1 min.
   5. After completing the first part, proceed to the second part following the same procedure. In this second part, the pedagogical agent explains the task and gives an example.
   6. In the second part, students write the names they know within the given guideline in less than 3 min.
   7. After completion, the pedagogical agent asks students about the names they have written. Note the names beneath the written responses.
   8. Press the Exit door as directed by the pedagogical agent.
   9. To correct, open Correct [Corregir] in the main menu and select Names Writing [Escritura del nombre].
   10. Use the external keyboard to enter the total number of correct letters and correctly spelled names in both parts.
   11. Enter the total number of correct letters and correctly spelled names for both parts using the external keyboard. To move to the second part, press the Grey box (second part) [segunda parte]. Also, add the pencil grip the student used for both parts.
   12. Choose one of the following 12 grip types that the student used for both parts: Radial cross palmar, palmar supinate, digital pronation, brush, graps with extended fingers, cross thumb, static tripod, four finger, lateral tripod, dynamic tripod, dynamic quadrupod or lateral quadruped.⁵³
   13. Click Save [Guardar] when the correction is complete.
       NOTE: A name is considered correct when written with all its corresponding letters, including homophones. Common mistakes include omission, addition, substitution, or letter translation. A letter is considered correct when it is roughly recognizable. Incorrect spellings of homophonic letters (e.g., writing the letter /b/ instead of /v/) will not be considered.

Figure 7: Example of a student's performance correction in the name writing task Please click here to view a larger version of this figure.

4. Phonological awareness
   1. To access the task, click on Evaluation [Evaluar] and then select Phonological Awareness - Isolate [Conciencia fonológica aislar].
   2. Allow the pedagogical agent to provide the student with instructions and task modeling. Two example items will be presented. If the student makes mistakes in the examples, the pedagogical agent will provide feedback by revealing the correct answer.
   3. Allow the pedagogical agent to check the student's understanding of the task by prompting the students to press the Yes or No button on the screen.
   4. Ensure the student understands the task and provide additional guidance, if needed.
   5. Complete this final step, and the task will begin.
   6. Present 18 items associated with this task.
   7. Using the external keyboard, mark as 'hit' when the student articulates the sound of the phoneme that needs to be isolated. Mark it as a 'partial hit' when the student names the letter and mark it as 'incorrect' for any other answer.
   8. When the task is completed, instruct students to follow the pedagogical agent's instructions, i.e., to press the Exit door and leave the task.
   9. Display an image of an icon of a person emitting sound to indicate accurate reaction time recording (see Figure 8).
      NOTE: No corrections are required after the task is completed. The student is awarded 2 points for each correct response, 1 point for each partial correct response, and 0 points for each error. The tablet automatically calculates the total number of hits, both total and partial, with 36 being the maximum score achievable.

Figure 8: An example item related to phonological awareness. A pedagogical agent says the word aloud, and the vocal key appears in the upper left corner when the student responds Please click here to view a larger version of this figure.

5. Oral narrative
   1. To access the task, click on Evaluation [Evaluar] and then select Oral Narrative [Narrativa oral].
   2. Have the pedagogical agent offer instructions to the student.
   3. Ask the student if they understand the task and have them respond with 'yes' or 'no'.
   4. Give the student 30 s to think about their stories ( Figure 9).
   5. Start a countdown and begin the task once the countdown is finished.
   6. Allow the student up to 5 min to narrate their stories based on the provided topic.
   7. Record the student's narrative on the tablet for later correction.
   8. Instruct the student to press the End button when finished.
   9. Display the Exit door to leave the task.
   10. For corrections, open Correct [Corregir] in the main menu, select Oral Narrative, [Narrativa oral] and Review stories using the media player tool.
   11. Press the play button to replay the student's story which was recorded during his performance by the same software( Figure 10).
   12. Use the external keyboard to note the total number of words, unique words, word sequences, and T-units (i.e., A T-unit consists of a main sentence plus any dependent or relative clauses directly connected to it).
   13. Click Save [Guardar] when correction is complete

Figure 9: An example of a prompt in the narrative oral task: "One day I wake up and I can fly" Please click here to view a larger version of this figure.

Figure 10: Correction menu for the oral narrative task Please click here to view a larger version of this figure.

3. Student evaluation

1. Following completion of the assessment by all students, evaluate the assignments and subsequently upload data to a server managed by the research team.
2. Import, merge, and meticulously clean the data in preparation for subsequent analysis.
3. To evaluate learning during the school year, ask students to perform the tasks and assess using Form A (fall), Form B (winter), and Form C (spring).
4. Generate data for Form A of the application at the beginning of the academic year (fall).
5. Generate data for Form B of the application, midyear (winter).
6. Generate data for Form C of the application, at the end of the academic year (summer).
7. Assess the appropriateness of the data for exploratory factor analysis (EFA) by analyzing the correlations between variables to ensure they are sufficiently intercorrelated⁵⁴.
8. Use Bartlett's test to verify that your population correlation matrix differs from an identity matrix, indicating that your variables are not independent⁵⁵.
9. Apply the Kaiser-Meyer-Olkin (KMO) test to evaluate the sampling adequacy for including each variable in the EFA⁵⁶.
10. Examine the determinant of the correlation matrix to check for multicollinearity.
11. Determine the number of factors to extract by retaining variables with eigenvalues of 1 or greater and examining the scree plot to identify factors with a sharp decline in eigenvalues, especially in samples over 200 participants ^57,58.
12. Incorporate parallel analysis in addition to these commonly used criteria, as it is regarded as the most precise method for determining the number of factors to retain⁵⁹.
13. Perform Exploratory factor analysis to find the correlation between different variables obtained⁶⁰.
14. Compare the results with the EGWA-K and Teacher rating scale performed on the same set of students at the end of the school year.
    NOTE: Teachers rated students' language, communication, and representation skills, including oral language, phonological awareness, communicative abilities, and initial writing, on a scale of 1 to 4, where 1 is "poor" and 4 is "excellent." These ratings (Teacher Rating Scale) reflect teachers' perceptions of students' academic competence and progress throughout the academic year.

Results

For this study, 336 Spanish kindergarten students (boys = 163, girls = 173; M_age = 5.3 years (63.6 months), SD = 0.29) were recruited from state and private schools in urban and suburban regions of Santa Cruz de Tenerife. Children with special educational needs were excluded. This included children with sensory impairments, acquired neurological conditions, or other issues traditionally deemed exclusionary criteria for learning disabilities. This information was sourced from th...

Discussion

This study investigated the framework of a CBM in Spanish kindergarten students using a literature-informed model, examining how transcription skills and oral narrative abilities impact observable indicators throughout the academic year. The study highlights the lack of technology-driven CBM tools tailored for Spanish, hindering early writing progress assessment. To address this gap and emphasize the importance of identifying potential writing difficulties in young learners, a multimedia assessment protocol for kindergar...

Materials

List of materials used in this article

Name	Company	Catalog Number	Comments
Indicadores de Progreso de Aprendizaje en Escritura para Educación Infantil (T-IPAE-EI)“	Universidad de La Laguna	®Copyrigth, 2023	C826ED53A500DC82D7A7CD0F 03C136CDB8F5A8E41D4175 0052469CA4CC0E11F8