Guidelines and Experience Using Imaging Biomarker Explorer (IBEX) for Radiomics

Summary

We describe IBEX, an open-source tool designed for medical imaging radiomics studies, and how to use this tool. In addition, some published works that have used IBEX for uncertainty analysis and model building are showcased.

Abstract

Imaging Biomarker Explorer (IBEX) is an open-source tool for medical imaging radiomics work. The purpose of this paper is to describe how to use IBEX's graphical user interface (GUI) and to demonstrate how IBEX calculated features have been used in clinical studies. IBEX allows for the import of DICOM images with DICOM radiation therapy structure files or Pinnacle files. Once the images are imported, IBEX has tools within the Data Selection GUI to manipulate the viewing of the images, measure voxel values and distances, and create and edit contours. IBEX comes with 27 preprocessing and 132 feature choices to design feature sets. Each preprocessing and feature category has parameters that can be altered. The output from IBEX is a spreadsheet that contains: 1) each feature from the feature set calculated for each contour in a data set, 2) image information about each contour in a data set, and 3) a summary of the preprocessing and features used with their selected parameters. Features calculated from IBEX have been used in studies to test the variability of features under different imaging conditions and in survival models to improve current clinical models.

Introduction

In medicine, patient disease diagnosis typically incorporates a large number of diagnostic exams such as x-rays, ultrasound, computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET) scans to assist in determining the course of patient care. While physicians use these images to qualitatively assess patient's diagnosis, there may be additional quantitative features that can be extracted to guide patient care. The rationale is that these features may represent proteomic and genomic patterns expressed on the macroscopic scale¹. Combining this quantitative information with the current clinical information, e.g., patient demographics, may allow more individualized patient care. This is the theory behind radiomics: feature analysis of images on a voxel level. The features typically fall into 5 main categories: gray level co-occurrence matrix, gray level run length matrix, neighborhood intensity difference matrix, histogram, and shape.

Imaging Biomarker Explorer (IBEX) is an open-source tool for radiomics work². The graphical user interface (GUI) was developed at MD Anderson Cancer Center with the goal of facilitating the extraction and calculation of quantitative features to assist in decision making in cancer care. A source code³ and a stand-alone⁴ version are available online. IBEX calculates the 5 most common categories of features used in medical radiomics with parameters that can be set for each feature category. The categories are: gray level co-occurrence matrix⁵, gray level run length matrix^6,7, intensity, neighborhood intensity difference matrix⁸, and shape. Since IBEX is open source, it allows for harmonized feature extraction results across institutions to easily compare different radiomics studies. All features within IBEX are described in the initial paper by Zhang et al.²

The purpose of this manuscript is to provide guidance on how to use IBEX and to demonstrate its applications through peer-reviewed published studies from the MD Anderson radiomics group. Since its release to the public in 2015, IBEX has been used to calculate features from CT, PET, and MRI scan images by the MD Anderson radiomics group, typically investigating features to improve clinical survival models^{9,10,11,12,13,14,15,16,17,18,19,20} and by outside institutions^21,22,23,24. Additional guidance on software tools that can be used for the steps in radiomics research that are not included in IBEX can be found in Court et al.²⁵

A general introduction to the workflow of IBEX will help to organize data properly before starting radiomics projects utilizing IBEX. If importing DICOM images, IBEX requires that each patient have their own folder with their DICOM images. DICOM radiation structure set is optional to include in the patient folder, but is recommended instead of using the contouring platform in IBEX. To assist with importing all patients for a specific study, all patient folders can be placed into one folder together so that all data may be imported into IBEX using only one step. If importing patients from Pinnacle, it is best to have the structure set with the patient plan. As patients may have multiple image sets and plans within Pinnacle, it is best to know which image set and plan are correct before importing. If computation time is a concern, reducing the number of image slices for a patient can drastically reduce time. For example, if only the liver is of interest in a study but the patients have full body CT scans, reducing the DICOM slices to only the extent of the area of interest can shorten computation time (e.g., reducing the DICOM from 300 slices to 50 slices can take 1/6th the time). There are different tools available to perform this slice reduction, from manual to semi-automatic.

Protocol

1. Install IBEX

NOTE: To install a source-code version go to step 1.1. Alternatively, to install a stand-alone version go to step 1.2.

1. Source-code version
   1. Go to the IBEX source-code version website³. Download the "IBEX_Source.zip" and "How_to_use.pdf" files. Look in the "How_to_use.pdf" file to find the pre-requisites to use the latest IBEX version.
      NOTE: IBEX works only on 32 bit and 64 bit Matlab versions 2011a and 2014b, respectively.
   2. Once the download is completed, unzip the "IBEX_Source.zip" and add the \IBEX_Source folder to the local path.
      NOTE: Instructions on how to add a path can be found on the software references page for "add path"²⁶.
   3. Type "IBEXMain" in the command window to start IBEX.
2. Stand-alone version
   1. Go to the IBEX stand-alone version website⁴. If installing IBEX for the first time, go to the "Dependencies" folder and download/install the "MCRInstaller.exe," vc2005redist_x86_new.exe," and "vc2012redist_x86.exe" files. From the main page, download the "IBEX.exe," "IBEX.ctf," "IBEX.ini," and "How_to_use.pdf" files to the same folder. Look in the "How_to_use.pdf" file for the pre-requisites to use the latest IBEX version.
   2. Double click "IBEX.exe" to start IBEX.

2. Set the Location

Note: The images are imported to this set location and the data for this study are stored here as well. IBEX uses the most previously applied location as the default location when re-launched.

1. Click on the "Location" icon (Figure 1).
2. Select user or double click "New User" to create a new user folder. If creating a new user folder, enter the name in the new window then click the "OK" button.
3. Select the site within the selected user or double click "New Site" to create a new site folder. If creating a new user folder, enter the name in the new window then click the "OK" button.
4. Click the "OK" button at the bottom.

3. Import Images

1. Click on the "Import" icon (Figure 1).
2. Select DICOM or Pinnacle9 (Pinnacle file version 9) format by clicking on the name of the format. To import DICOM images go to step 3.3.1. To import Pinnacle9 files go to step 3.3.2.
3. Click the "Next" button.
   1. Import DICOM images
      NOTE: To import patients individually go to step 3.3.1.1. To import multiple patients at once go to step 3.3.1.2.
      1. Import each patient individually by selecting the patient folder through the directory.
         1. Click on the "..." button next to the listed directory to select the patient folder that contains the DICOM images and radiation structure set DICOM file (optional).
            NOTE: While it is only optional to import a structure set with the patient files, it is highly recommended to do so. IBEX does have a contouring platform within it, but this is somewhat impractical for large datasets. IBEX can accommodate structure sets from commercial software platforms that are familiar contouring tools for radiation oncologists, which makes the workflow much easier. This is typically how IBEX is used in studies.
         2. Click the "Import" button on the bottom left once IBEX has finished searching the DICOM files, the Patient and Details boxes will be populated.
         3. Repeat steps 3.3.1.1.1 - 2 for each patient.
         4. Click the "Exit" button after all patients are imported.
      2. Import all patients at once by checking the 'Batch Folder' box in the top right corner.
         ​NOTE: All patients must have a separate folder containing their respective DICOM files.
         1. Click on the "..." button next to the listed directory to select the folder that contains all patient folders with their corresponding DICOM images and radiation structure set DICOM file (optional).
         2. Click the "Import" button. Patients will be imported sequentially. Click the "Exit" button after all patients are imported.
   2. Pinnacle files
      1. Configure the Pinnacle Host and Database within the "\IBEX\ImportExport\ImportModule\Pinnacle9\Pinnacle9ImportMain.INI" file. Click the "Config" button before selecting Pinnacle in the import module box.
      2. Select the proper Pinnacle Host and Database.
      3. Enter the Patient MRN, Last Name, or First Name then click elsewhere in the window.
      4. Click the "Query" button.
      5. Select the patient in the new window then click the "Transfer" button.
      6. Click the box of the desired image sets from that patient in the new window and click the "OK" button.
      7. Click the "OK" button in the new window that is labeled "Data successfully imported."
      8. Click the "Exit" button after all patients are imported.

4. Viewing Images and Regions of Interest (ROIs)

1. Click on the "Data" icon (Figure 1). Click on the desired patient file to open in the "Select a patient" section of the GUI (top half).
2. Click on the image set of the desired patient file to open in the "Select image set(s)" section of the GUI (bottom half). Click the "Open" button.
3. Use the arrows beneath the images to scroll through the images, which are shown in the axial, coronal, and sagittal views (from left to right).
4. Zoom in on the image by clicking on the "Zoom" button (Figure 2). Draw a box on the image plane to zoom. Right click to zoom out.
5. Turn on localizers by selecting the "Intersection" button (Figure 2).
   NOTE: The lines that appear show where that slice is located in each plane. These lines move when scrolling using the arrows.
6. Click on the "Ruler" button (Figure 2) to measure distances. Click and hold the left mouse button to measure between the two points of interest. Release the mouse to remove the measured value from the displayed area.
7. Click on the "CT Num" button (Figure 2) to measure the value of a voxel. Click and hold the left mouse button on the voxel of interest, and the value will pop up on the left side of the GUI below the color scale. Release the mouse to remove the measured value from the displayed area.
8. Click on the "W/L" button (Figure 2) to window/level the images. Another window will pop up. Drag the left and right sides to the desired area or manually enter the window/level in the Window and Level boxes at the bottom of the new window. Select different window/levels using the first drop down menu on the left ( Figure 2): there are 8 for CT and 1 for PET.
9. Select different color scales using the second drop down menu on the left (Figure 2): there are 9 options to choose from.
10. Visualize ROIs by clicking on the box next to the ROI to make it visible on the images, or click on the "On All ROIs" button to turn on all patient ROIs.

5. Edit ROI

1. Edit ROIs by clicking on the "Edit ROIs" button in the top left or in the bottom center. Select the contour to edit by clicking the box next to its name.
2. Use the "Nudge Contours" button (Figure 3) to push contours in or out as already drawn. Adjust the size of the circle used in the box labeled "D" next to the Nudge Contours button.
3. Remove a whole contour slice by using the "Cut Contours" button (Figure 3). Click and hold the left mouse button and draw a box around the ROI to be removed.
4. Draw contours
   ​NOTE: Go to step 5.4.1 to draw contours by connecting points. Go to step 5.4.2 to draw contours by free hand.
   1. Connecting Points: Use the "Draw Contours (1)" button (Figure 3) to draw a contour on each slice by clicking points around the contour where the points are connected by straight lines. Complete the ROI for that slice by clicking on the first point drawn.
   2. Free Hand: Use the "Draw Contours (2)" button (Figure 3) to draw a contour by free hand. Hold the left mouse button to draw the contour on the slice. Finish the contour on that slice by coming back to the beginning of the drawn ROI and then releasing the left mouse button.
5. Click on the "Interpolate contours" button (Figure 3) to interpolate ROIs between slices.
6. Click on the "Copy ROI" button to copy the ROI.
7. Merge ROIs by selecting multiple ROIs and then clicking the "Merge ROI" button.
8. Click the "Delete ROI" button to delete the currently selected ROI.
9. Click "Create ROI" to create a new ROI which will cause a window will pop up. Enter the name of the ROI and click the "OK" button. Click the "Save" button. Click the "Exit" button to return to the patient viewer.

6. Contours in the Data Set

1. View contours in the data set
   1. Click the "Show Data Set" button to view contours in the data set. Click on the name of the data set to view. Click the "Open" button. Select patient contours using the box next to their name. Click the "Delete", "Move", or "Copy" button depending on the desired function for that contour. Close the data set window once finished viewing the data set.
2. Add contours to the data set
   1. Select contours to add to a data set by clicking the checkbox next to their name then click the "Add to Data Set" button. Click on the name of the data set to add the contours or click the "New" button for a new data set. If New is selected, enter the name of the data set in the new window. Click the "OK" button.
3. Click the "Import ROIs" button to import a Pinnacle version 9 .roi file if contours were not loaded during Section 3.
   1. Click the " …" button to select the file. Click the "Import" button.
4. Click the "Export ROIs" button to export ROIs.
   1. Click the " …" button to select the directory in which exported ROIs will be placed. Click on the name of the format that is preferred for the exported ROIs. Enter anonymization information if that is preferred. Click the Export button.
      NOTE: The preset is for no anonymization to be performed.
5. Click the "Exit" button to return to the list of patients and scans.

7. Create Feature Set

1. Click on the "Feature" icon.
2. Add preprocessing if desired.
   1. Click on the "Add" button under "Step1: Preprocess". Select the preprocessing option from the drop-down menu in the new window.
   2. Click on the "i" under "Para." to select the preprocessing parameters. Click on the number under the Value column in the new window of the parameter to change it. Type in the new parameter value and click the "OK" button.
   3. Click on the "question mark" button in the upper right corner for a description of the preprocessing method and the preprocessing of specific parameters.
   4. Click the "Add" button. Select the preprocessing step and click the "Delete" button to delete undesired preprocessing steps.
3. Add the features desired.
   1. Select the feature category from the drop-down menu under "Step 2: Features Category:". Repeat steps for multiple categories.
      ​NOTE: Only one category of features can be added at a time. Different combinations of preprocessing and feature categories can be added to the same feature set if desired.
      1. Select the "GrayLevelCooccurenceMatrix25" and the "NeighborIntensityDifference25" feature categories to compute the gray level co-occurrence matrix and neighborhood intensity difference matrix, respectively, in 2.5D, which is done by computing the matrix on each slice individually and then summing all matrices together.
      2. Select the "GrayLevelCooccurenceMatrix3" and the "NeighborIntensityDifference3" feature categories to compute the gray level co-occurrence matrix and neighborhood intensity difference matrix, respectively, in 3D.
   2. Click on the "i" under "Para." for the parameters selected for that preprocessing. Click on the "question mark" button in the upper right corner for a description of the preprocessing method and the parameters.
      1. Type in the new parameter value and click the "OK" button.
   3. Click the "Test" button to view a feature category or specific feature. Click the button next to the feature or category desired.
      1. Select the data set to view the test on and click the "Open" button. Check the box next to the patients from the selected data set to view the test on and click the "Test" button.
   4. Uncheck unwanted features for the category selected; all features are selected after selecting the category. Click the word "Features:" under "Step2: Features" to uncheck all features.
   5. Click the "Add to Feature Set" button to add all selected features with selected preprocessing.
      1. Select the feature set to add features to and click the "Open" button or click the "New" button to add features to a new feature set. If creating a new feature set, enter the name of the feature set in the new window and click the "OK" button.
4. Click the "Show Feature Set" button to view features with corresponding preprocessing techniques to view features in a feature set.
   1. Select the feature set to view and click the "Open" button or click the "New" button to create a new feature set. If creating a new feature set, enter the name of the feature set in the new window and click the "OK" button.
5. Click on the "Show Data Set" button to view current data sets.
   1. Select the data set to view and click the "Open" button or click the "New" button to create a new data set. If creating a new data set, enter the name of the data set in the new window and click the "OK" button.
6. Click the "Exit" button.

8. Output Features

1. Click the "Result" icon. Click on the data set to run the features under "Step 1: Data Set." Click on the feature set to run on the selected data under "Step 2: Feature Set."
2. Click on the "View Data" button to view the selected data set. Click on the "View Feature" button to view the selected feature set.
3. Click the "Compute&Save Result" button. Enter the file name for the results and click the "Save" button.

9. Statistical Model Building

1. Open the saved results file.
   NOTE: This is typically under C:\IBEX\DataIbex\[Selected User in Step 2.2]\[Selected Site in Step 2.3]\1FeatureResultSet_Result, unless otherwise assigned in step 8.4.
2. Use the data from the different tabs in the desired statistical tests or model building in software.
   NOTE: The protocol can be paused at any time. However, it is most convenient after finishing all steps needed for a particular icon, e.g., finishing all of Section 7 which is under the Feature icon.

Results

The output from IBEX is a spreadsheet (see Figure 4) that contains 3 tabs. The "Results" tab contains the feature values for each ROI in the data set (Figure 4A). The "Data Info." tab contains information about the images taken from each ROI in the data set (Figure 4B). The "Feature Info." tab contains a comprehensive list of features used with the parameters selecte...

Discussion

IBEX is a powerful tool for medical imaging radiomics research. It has thus far mostly been used for radiation oncology purposes in studies conducted by the MD Anderson radiomics group. IBEX allows for manipulation of ROIs and calculation of features within 5 main feature categories. The source code version of IBEX allows the user to design applications that are not already part of IBEX, such as gray level zone matrix features.

The main steps involved in IBEX are the import of images, contouri...

Materials

List of materials used in this article

Name	Company	Catalog Number	Comments
Excel	Microsoft Office		Any version of excel should work.
Matlab	MathWorks		Only use IBEX on 32 bit Matlab 2011a or 64 bit Matlab 2014b.