The proposed method has undergone iterative refinement for the lateral ventricle choroid plexus, involving extensive testing on a cohort of 169 healthy controls and 340 patients with clinically high risk for psychosis30. Using the technique described above, the authors obtained high intra-rater accuracy and reliability with a DC = 0.89, avgHD = 3.27 mm3, and single-rater ICC = 0.9730, demonstrating the strength of the protocol described herein.
Handling quality control issues and 3D Slicer settings
Before starting the segmentation process, it is necessary to check the quality of the brain scan to ensure that there is no head motion or artifacts that interfere with manual segmentation (Figure 1A). Next, brightness and contrast may be adjusted to assist with better visualization of the choroid plexus. Some brain scans may have head motion, and it is important to determine whether the artifact would adversely impact the delineation of the choroid plexus (Figure 1B). Additionally, images with brightness and contrast artifacts make it difficult to distinguish the borders of the choroid plexus (Figure 1C,D). In this case, try adjusting the brightness and contrast until it is suitable for manual segmentation. Ensure that brain scans that cannot be easily segmented for the choroid plexus are excluded.
Lateral ventricle choroid plexus segmentation
As shown in Figure 2, five main parts are used to load and display the images (part 1), select different 3D slicer functions (part 2), tools for segmenting the lateral choroid plexus (part 3), visualizing the axial, coronal, and sagittal images (part 4), calculating the volume of the lateral ventricle choroid plexus (part 5), and saving the results from the manual segmentation. The T1w brain scan can be uploaded using the Welcome to Slicer interface by downloading sample data from MRHead dataset in 3D Slicer (Figure 3) or importing the NIFTI or DICOM file from an existing dataset (Figure 4A,B). There is also an option in this panel to edit the brightness and contrast of the image (Figure 4C). After loading the T1w brain scan, it will be displayed in the slice view interface and prepared for lateral ventricle choroid plexus segmentation. Manual segmentation is created using the Segment Editor module (Figure 5A), and the master volume name can be confirmed in Figure 5B. In Figure 5C, the labels for the right and left lateral ventricle choroid plexus can be added and labeled in different colors (Figure 5C), and the region of interest itself can be delineated by using the Draw or Paint Tool (Figure 5D). Figure 6 labels the lateral ventricle choroid plexus and its surrounding brain structures, such as the caudate nucleus, hippocampus, fornix, and the third ventricle, which provides landmarks for the segmentation of the lateral ventricle choroid plexus in some of the more complex regions. To generate and extract choroid plexus volume data from the manual segmentations, select the Segment Statistics module (Figure 7A). There are a few options to select from for outputting the data (Figure 7B). The new files containing the calculated lateral ventricle choroid plexus volume can now be saved by pressing the Save button (Figure 7C).
Third and fourth ventricle choroid plexus segmentation
As seen in Figure 8, the 3rd ventricle choroid plexus can be easily viewed in the lower left panel depicting the sagittal plane. Notably, the Foramen of Monro can be observed arching below the corpus callosum, with the choroid plexus highlighted within the third ventricle in green. The third ventricle and the third ventricle choroid plexus can also be viewed in the axial and coronal planes (upper left and lower right panels of Figure 8, respectively). Finally, a 3D rendering of the third ventricle choroid plexus is shown in the upper right panel of Figure 8. Figure 9 labels the third ventricle choroid plexus and its surrounding brain structures, including the corpus callosum, fornix, thalamus, internal cerebral vein, and third ventricle, which provides landmarks for the segmentation of the third ventricle choroid plexus in some of the more complex regions.
The fourth ventricle choroid plexus is harder to view and can be seen in Figure 10. The sagittal and coronal planes (lower left and lower right panels of Figure 10) allow for the best viewing of its structure. Care must be taken to ensure that parts of the cerebellum or the fourth ventricle itself are not delineated as choroid plexus. Figure 11 labels the fourth ventricle choroid plexus and its surrounding brain structures, including the medulla, pons, superior cerebella peduncle, inferior medullary velum, and fourth ventricle, which provides landmarks for the segmentation of the 4th ventricle choroid plexus in some of the more complex regions.
Segmentation accuracy, similarity, and agreement
Segmentation of neuroanatomical structures can be directly compared in an image viewer, but the similarity is sometimes difficult to be assessed visually. Therefore, quantitative measures such as the DC52, measuring percent overlap, and the avgSD53, measuring distances between the boundary surfaces of the delineated structures, are used to compare predictions with ground truth or manual segmentations across or within raters to assess reliability. As depicted in Figure 12A, the DC for two 3D segmentations G and P is simply the volume of the overlap (intersection) divided by the average volume53:

where | . | represents volume. It measures overlap on a scale between 0 and 1, where a value of 1 indicates exact agreement and 0 disjoint segmentations and is often multiplied by 100 to represent a percent overlap. The average surface distance (ASD) measures the average distance (in mm) between all points x on the boundary of G ( bd(G) ) to the boundary of P and vice-versa (Figure 12B). It is defined as

with distance
representing the minimum of the Euclidean norm53. In contrast to the DC, a smaller ASD indicates better capture of the segmentation boundaries, with a value of zero being the minimum (perfect match). Note that sometimes also, the maximum distance or the 95th percentile is used instead of the average, where the maximum is highly sensitive to single outliers, while the 95th percentile is robust but may miss small but relevant segmentation errors.
The agreement of volume estimates (not of the segmentations directly) between a set of paired segmentations can be measured using ICC54. This can be accomplished by having multiple participants rated by multiple raters (interclass ICC) or by the same rater (intraclass ICC) (Figure 12C). ICC scores range from 0 (poor reliability) to 1 (excellent reliability). For inter-rater reliability, it is suggested to use ICC1 (one-way fixed-effects model) for datasets where each segmentation is done by a different rater selected at random. Additionally, for datasets where multiple raters, chosen at random, work on the same segmentation, it is recommended to use ICC2 (two-way random-effects model) to test for absolute agreement in the segmentations. Finally, for intra-rater reliability, it is recommended to use ICC3 (two-way mixed effects model) (Figure 12C).

Figure 1: Brain scan quality control. (A) Brain scan with good contrast and brightness, no evidence of artifacts, and no head motion. (B) Brain scan showing head motion (red arrow). (C) Brain scan with high brightness and low contrast or (D) low brightness and high contrast. Please click here to view a larger version of this figure.

Figure 2: The segmentation of the lateral ventricle choroid plexus in 3D Slicer. (1) is used to load the DICOM or NIFTI images and to save the results. (2) consists of a drop-down menu that can be used to enter the Segment Editor module (yellow arrow), which is used to segment the choroid plexus. The Quantification module (blue arrow) can also be selected here to calculate the volume of the choroid plexus. (3) shows the segment toolbar, which includes the draw, paint, and erase tools. (4) demonstrates the choroid plexus in axial, sagittal, and coronal views of the T1w image. The 3D rendering of the choroid plexus is also shown in the upper right corner. (5) displays the volume results from the manual choroid plexus segmentation, calculated using the Segment Statistics module. The final results can be saved using the save button mentioned in (1). Please click here to view a larger version of this figure.

Figure 3: Loading 3D Slicer sample data. This figure demonstrates how to download the sample data from the 3DSlicer interface. First, "Download Sample Data" must be selected, and then "MRHead" must be chosen, which displays the axial, sagittal, and coronal views of the brain scan on the right side of the screen. Please click here to view a larger version of this figure.

Figure 4: Loading the T1w brain scan. This figure demonstrates how to upload the T1w brain scan using either NIFTI (left panel) or DICOM (right panel) files. (A) For NIFTI files, either the "Choose Directory to Add" or "Choose File(s) to Add" must be selected, followed by selecting "OK". (B) For DICOM files, selecting "Add DICOM Data", followed by "Import DICOM files" and then pressing "OK" is needed. These two approaches will display the axial, sagittal, and coronal views of the brain scan on the right side of the screen. (C) To adjust the brightness and contrast of the images, the red button must be selected. Please click here to view a larger version of this figure.

Figure 5: Lateral ventricle choroid plexus segmentation. After the T1w brain scan has been loaded into the 3D Slicer. (A) Selecting the "Segmentation Editor" module. (B) Confirming the module and the master volume for manual segmentation of the lateral ventricle choroid plexus. (C) Creating labels for the right and left lateral ventricle choroid plexus. (D) Using the "draw" and "paint" tools to manually delineate the lateral ventricle choroid plexus. Please click here to view a larger version of this figure.

Figure 6: Adjacent structures to the lateral ventricle choroid plexus. Adjacent brain structures include the fornix, caudate nucleus, hippocampus, and the third ventricle. Please click here to view a larger version of this figure.

Figure 7: Volume calculation. Calculating the volume of the choroid plexus and saving the segments and volume results. (A) Selecting the Segment Statistics module. (B) Selecting for outputting the data. (C) Pressing the Save button to save the new files containing the calculated lateral ventricle choroid plexus volume. Please click here to view a larger version of this figure.

Figure 8: Third ventricle choroid plexus segmentation. Depicted here are the axial, coronal, and sagittal views of the third ventricle choroid plexus that has been manually segmented using the 3D Slicer. The top right corner shows a 3D rendering of the third ventricle choroid plexus. Please click here to view a larger version of this figure.

Figure 9: Adjacent structures to the third ventricle choroid plexus. Adjacent brain structures include the fornix, internal cerebral vein, thalamus, corpus callosum, and 3rd ventricle. Please click here to view a larger version of this figure.

Figure 10: Fourth ventricle choroid plexus segmentation. Depicted here are the axial, coronal, and sagittal views of the fourth ventricle choroid plexus that has been manually segmented using the 3D Slicer. The top right corner shows a 3D rendering of the fourth ventricle choroid plexus. Please click here to view a larger version of this figure.

Figure 11: Adjacent structures to the fourth ventricle choroid plexus. Adjacent brain structures include the medulla oblongata, pons, cerebellum, cerebellar vermis, and cerebellar tonsils. Please click here to view a larger version of this figure.

Figure 12: Determining segmentation accuracy, performance, and agreement. (A) Depicting how the percent overlap is calculated using the Dice Coefficient (DC) score. (B) The average surface distance (avgSD) measures the distances between the boundary surfaces of the delineated structures in order to compare predictions with ground truth, or manual segmentations across or within raters to assess reliability. (C) The Intraclass Correlation Coefficient (ICC) can be used for inter-rater (repeated measurements of the same subject) or intra-rater (multiple measurements from the same raters) reliability analysis. A representative example and output are provided. Please click here to view a larger version of this figure.