$$\rightleftharpoonup{xx}$$
$$\longleftharp{xx}$$,
$$\longrightharp{xx}$$,
Reproducibility comparison between visual estimate grading and ImageJ-assisted quantitative measurement:
SCB thickness in 48 regions of interest (ROI) (24 MFC and 24 MTP), defined from a mid-section of each knee from 24 knees/animals was scored by three independent individuals using the existing 0-3 visual scoring scheme as described in the literature15,23, where 0 = normal (no SCB thickening), 1 = mild, 2 = moderate, and 3 = severe SCB thickening. These images were selected from three different postoperative time points at 2, 8, and 16 weeks after the DMM or sham procedure. Usually, mice with DMM procedure showed visual SCB thickening score 0 at 2 weeks post-operation, scores 1-2 at 8 weeks, and scores 2-3 at 16 weeks. The SCB thickness of these histologic images were then quantitatively measured by three other independent observers using ImageJ software to validate the reproducibility and sensitivity of the new scheme. Representative histologic images with or without an outlined ROI in MFC and MTP for visual grading or quantitative measurements are presented in Figure 2, in which examined images were divided into three groups: sham knee (visual score 0), DMM knee (visual score 0), and DMM knee (visual score 1-3).
Detailed comparative analyses of reproducibility between ImageJ-assisted quantitative measurement and visual estimate grading of SCB thickness are presented in Table 1. Correlation coefficient tests suggest that the quantitative measurement was relatively more reproducible than the visual estimate grading system.
Inter- and intra-observer reproducibility:
Correlation coefficient tests demonstrated high reproducibility of the ImageJ-assisted measurements with inter-observer correlation coefficients of >0.93 between Observer A, B, and C for the average of the first and second measurements in the MTP and MFC regions (Figure 3). Intra-observer variability analysis of the same set of histologic images also showed high reproducibility between the first and second measurement scores for each of the three observers with an intra-observer correlation coefficient of >0.95 for all observers (Figure 4).
Sensitivity:
To assess if the new quantitative SCB measurement system is more sensitive to osteoarthritic SCB thickening changes than the widely used visual grading system, 48 areas of interest of histologic images (24 MFC and 24 MTP) from 24 knees/animals were first assessed by three independent individuals who are experienced in OA histopathology and existing OA grading systems. SCB thickening was graded using a 0-3 visual scoring scheme as described above. ImageJ-assisted quantitative measurement was then performed on the same set of visually graded histologic images by another three individuals who were blinded to the visual OA grading results. SCB thickness of the MFC and MTP of each image was quantitatively measured with ImageJ as described in the Protocol section. The results demonstrated that the average SCB thickness (mm2/1.0 mm2) of the DMM images with visual SCB thickening scores 1-3 was significantly higher than that of the Sham images with a "0" visual thickening score. More importantly, the average SCB thickness of the DMM images with a "0" visual SCB thickening score was also significantly higher than that of the Sham images with a "0" visual score (Figure 5). The data strongly suggest that the ImageJ-assisted quantitative SCB measurement is more sensitive to the early and mild SCB thickening changes than the visual grading method.

Figure 1: Histologic images with Safranin-O and fast green staining from Sham and DMM groups for ImageJ-assisted quantitative SCB measurement. (A) The boxes outlined with a dotted yellow line define the SCB region of interest (ROI). The area of bone substance within the boxes is highlighted in orange. The SCB thickness in the medial femoral condyle (MFC) and medial tibial plateau (MTP) can be quantified using ImageJ software. The exact dimensions of the ROI in MFC and MTP are enlarged to enhance the visibility. (B) SCB thickness of histologic images from far-posterior, mid-posterior, mid-anterior, and far-anterior areas of the MTP at 16 weeks post-DMM was quantified to assess area-specific SCB thickness. N = 6. Please click here to view a larger version of this figure.

Figure 2: Representative histologic images with Safranin-O and fast green staining from Sham and DMM groups for visual SCB grading and quantitative SCB measurement. Upper panels: Photomicrographs of Sham and DMM groups for visual SCB grading. Lower panels: Photomicrographs of Sham and DMM groups for ImageJ-assisted quantitative SCB measurement. The boxes outlined with a dotted yellow line (made with Adobe illustrator) in MFC and MTP define the SCB region of interest. The area of bone substance (excluding bone marrow) within the boxes is highlighted in orange. Please click here to view a larger version of this figure.

Figure 3: Inter-observer variation tests. Correlation coefficient analyses indicate a high reproducibility between three observers (Observers A, B and C) for SCB thickness averaged from the 1st and 2nd measurements in the MTP and MFC regions of interest. Please click here to view a larger version of this figure.

Figure 4: Intra-observer variation tests. Correlation coefficient analyses indicate a high reproducibility between the 1st and 2nd SCB thickness measurements in the MTP and MFC regions of interest for each of Observers A, B, and C. Please click here to view a larger version of this figure.

Figure 5: Comparative sensitivity analyses of visual grading and ImageJ-assisted quantitative measurement of SCB thickness in the MFC and MTP. The histologic images for visual estimate grading were divided to three groups (Sham with "0" SCB thickening score, DMM with "0" SCB thickening score, and DMM with SCB thickening score 1-3). Note: The quantitative SCB thickness values from all three observers for the DMM images with a "0" visual SCB thickening score were significantly higher than that of the Sham images with a "0" visual score, indicating that the quantitative measurement is more sensitive than the visual grading to mild SCB thickening. N = 6. Please click here to view a larger version of this figure.
| Method | Observer/scorer | MTP | MFC |
| Inter-observer correlation coefficient (r) |
| Quantitative measurement | A vs. B | 0.9685 | 0.9421 |
| A vs. C | 0.9413 | 0.9427 |
| B vs.C | 0.9109 | 0.9288 |
| Visual grading | D vs. E | 0.6455 | 0.6031 |
| D vs. F | 0.6 | 0.7419 |
| E vs. F | 0.6454 | 0.603 |
| | Intra-observer correlation coefficient (r) |
| Quantitative measurement | A | 0.9818 | 0.9662 |
| B | 0.9361 | 0.9177 |
| C | 0.9748 | 0.9357 |
| Visual grading | D | 0.4286 | 0.6396 |
| E | 0.5 | 0.7746 |
| F | 0.7071 | 0.6396 |
Table 1: Reproducibility comparison between software-assisted quantitative measurement and visual estimate grading for SCB thickness.