Applications of Machine Learning to Imaging of Spinal Disorders: Current Status and Future Directions

Degenerative Disease

Lumbar degenerative disease is highly prevalent and computer-aided interpretation of MRI scans could streamline care for these patients. A system for segmentation and classification of degenerated intervertebral discs on lumbar MRI T2-weighted images was first published in 2009. ¹⁰ This system made use of classic imaging processing techniques and was validated on a small homogenous dataset. Similarly, Alomari et al ¹¹ published a system for binary classification of lumbar discs as degenerated or normal making use of a probabilistic computer vision model.

While early work tended to use probabilistic computer vision methods, subsequent work tended to make use of ML techniques. Hao et al ¹² made use of a support vector machine (SVM), which relied on disc segmentation followed by automated extraction of shape, intensity, and texture information. Building on this work, Ruiz-España et al, ¹³ developed a classifier that classified lumbar discs into 1 of 5 classes as defined by Pfirrman. ¹⁴ This approach made use of a segmentation algorithm that extracted features relating to the intensity, shape, and texture of the disc, which were passed to a custom classifier that made use of a classical image processing algorithm. The first published report to make use of an artificial neural network (ANN) was the study by Costro-Mateos et al, ¹⁵ which used automated segmentation to extract disc features from a mid-sagittal T2-weighted image and trained an ANN based on these features.

The reports discussed up to this point all made use of an automated segmentation algorithm and relied on a relatively small number of training images, which limited their external validity. The use of a convolutional neural network (CNN) negates the need for a separate segmentation step prior to classification. The study by Jamaludin et al ¹⁶ was innovative for its use of a relatively high number of MRIs when compared with previous studies. This study made use of 12 018 discs from 2009 patients and also made use of a CNN, which negated the need for a separate segmentation step, and allowed automatic extraction of features. This report achieved near human performance at grading lumbar disc degeneration, disc narrowing, upper/lower endplate defects, upper/lower marrow changes, spondylolisthesis, and central canal stenosis. Building on this work, the DeepSPINE framework used a large dataset of 22 796 lumbar disc levels extracted from 4075 patients and trained a CNN to perform classification of central canal stenosis and foraminal stenosis. ¹⁷ These researchers achieved accuracy of 84.5% at grading lumbar spinal stenosis and 89.0% at grading lumbar foraminal stenosis, which exceeded that of any other published studies. In addition, the DeepSPINE framework performed similarly to human raters at detection and grading of lumbar spinal stenosis and foraminal stenosis.

While most work on automated analysis of degenerative spinal imaging has focused on lumbar degenerative disease, some published reports have looked at cervical degenerative disease (Figure 3). Jin et al ¹⁸ made use of diffusion tensor imaging (DTI) metrics in a population of patients undergoing surgery for degenerative cervical myelopathy. They employed ML methods to predict surgical outcome using these DTI metrics, but their predictive performance was limited by a small patient population. Weber et al ¹⁹ made use of a CNN to quantify fatty infiltration in paraspinal musculature and showed clinical correlates of fat infiltration. These authors hypothesized that their metric could be used in the workup of patients with degenerative cervical myelopathy.

OPEN IN VIEWER

Figure 3.

Depiction of an attention map generated by a convolutional neural network (CNN) that has been trained to detect spinal cord compression on a cervical spine magnetic resonance imaging (MRI) scan. The CNN has identified the herniated intervertebral disc as being important to its classification decision.

Due to the aging population, the prevalence of spinal degenerative disease is increasing. ^20,21 The studies summarized here show the potential for ML technology to streamline patient care by providing rapid automated analysis of MRI scans, thereby reducing radiologist workloads. These studies also demonstrate that ML models can rapidly generate quantitative parameters from imaging data, which are time consuming for a radiologist to produce. Future ML models may be able to combine quantitative parameters from a patient’s imaging data, with clinical information such as patient demographics and neurologic exam and provide decision-making support to clinicians. In the future this type of decision-making tool making use of ML technology may be able to identify patients who will benefit most from surgery and may provide assistance with surgical planning.

Spinal Deformity

ML methods have also been applied to automated image analysis in spinal deformity. Initial work in the area focused on applying ML methods to data gathered from non-invasive surface topography scans to classify scoliotic curves. Ramirez et al ²² made use of surface topography data to classify scoliotic patients into 3 categories: mild, moderate, and severe curves. This analysis found that a SVM achieved 85% accuracy in predicting scoliotic curve severity when using radiographs interpreted by radiologists as a gold standard. Seoud et al ²³ used data gathered from trunk surface topography to predict the Lenke class on 97 patients with scoliosis. These researchers achieved an overall accuracy of 72.7% when compared to radiologist classifications derived from radiographs.

More recently, research groups have attempted to automatically extract spinal parameters from spinal radiographs in the setting of scoliosis. Sun et al ²⁴ made use of coronal radiographs and trained an SVM to predict Cobb angles. When compared with human-derived measures, this classifier performed well with a high accuracy of 92.76%. The model had a root mean squared error of 21.6%, which indicates a good model fit to the training data. In a similar vein, Zhang et al ²⁵ used coronal radiographs to train an ANN to estimate Cobb angles. When compared with human-derived measures they achieved absolute errors of 3 degrees.

A comprehensive automated platform for assessment of idiopathic scoliosis was developed by Wu et al. ²⁶ This system, called MVC-Net, makes use of biplanar radiographs to identify each vertebral level and estimates Cobb angle on an anteroposterior and lateral view. This system used 526 images for training and validation and achieved high accuracy when compared with radiographs that were manually annotated by radiologists with a mean absolute error of 4° across the testing samples. Similarly, Galbusera et al ²⁷ developed a system for automated estimation of spinal parameters based on 2-planar radiographs. Their system involved a CNN trained on 493 patients and was able to extract the spatial locations of various landmarks such as endplate centers, hip joint centers, and the S1 endplate angle. From this they were able to derive spinal parameters such as T4-T12 kyphosis, L1-L5 lordosis, Cobb angle of scoliosis, pelvic incidence, sacral slope, and pelvic tilt. While the model-generated parameters showed good correlation to radiologist-derived values, the standard errors of the estimated parameters ranged from 2.7° for pelvic tilt to 11.5° for L1-5 lordosis.

Research to date has focused on automatically generating quantitative spinal parameters such as T4-T12 kyphosis, pelvic incidence, and pelvic tilt from radiographs. Spinal parameters are time consuming to manually annotate and interrater reliability can vary. The above studies demonstrate that a ML learning model could potentially facilitate more rapid and consistent interpretation of spinal radiographs. Future work may make use of larger datasets to compare spinal parameters generated by an ML model to those manually annotated by human raters. In addition, future research may seek to automatically classify adult spinal deformity according to the validated Scoliosis Research Society (SRS)–Schwab system. Ultimately, this line of research may lead to a model that makes use of automatically generated spinal parameters to provide decision-making support to clinicians by predicting patient response to surgery and optimal surgical approach.

Spine Trauma

The clinical management of patients with spine trauma requires rapid and accurate interpretation of volumetric imaging. For this reason, automated image analysis has a special potential to streamline the care of patient with spine trauma.

The majority of work in applying ML methods to automated image analysis in spine trauma has focused on thoracolumbar trauma. Yao et al ²⁸ first developed a fully automated system for detection of thoracolumbar fractures. This system used a segmentation method, followed by a transformation of the 3-dimensional (3D) vertebral body shape onto a 2D space. These researchers trained a committee of SVMs to recognize fracture patterns on the 2D representation. While they made use of a sophisticated method this initial report was limited by a low number of training samples. The same research group expanded this work by applying the same model to a larger dataset of 104 patients. ²⁹ In this dataset, they achieved a sensitivity of 0.81 with a false positive rate of 2.7. This research group later applied their model to detect and classify thoracolumbar osteoporotic fractures based on the Genant classification system. ³⁰ They assembled a cohort of 75 patients with thoracolumbar fractures and 75 matched patients with normal CT scans. They achieved a sensitivity for detection of compression fractures at the patient level of 98.7% and specificity of 77.3%. In addition, for each fracture within their imaging data their model attempted to classify the fracture into 1 of 4 Genant classes. They achieved an accuracy for classification by Genant type of 68%.

Some researchers have attempted to apply a CNN to detect thoracolumbar osteoporotic fractures. Nicolaes et al ³¹ used a training database of 90 CT scans, which were labeled with localizing information by 2 raters. This group made use of a 3D CNN and achieved accuracy similar to previously published reports. Similarly, Baum et al ³² developed a system for automatic detection of osteoporotic fractures in thoracolumbar imaging, which made use of a 2D CNN. The report by Tomita et al ³³ made use of the largest dataset, which included 1432 CT scans with 713 positive and 719 negative images of osteoporotic compression fractures. These researchers labeled mid sagittal images in a location agnostic manner and trained a CNN on their training dataset. This model achieved an accuracy of 89.2% and F1 score of 90.8% on the holdout dataset.

Studies to date have focused on specific fracture types, such as osteoporotic compression fractures and have used smaller datasets. This line of research is in its infancy and no published studies have been able to achieve human-level performance. However, a large volume of CT scans are gathered in an emergency setting and future work could leverage this large volume of data. The goal of this line of research is to produce a machine learning model that is general enough to detect any type of spinal fracture with better-than human-level performance. Such a model, if developed, could reduce workload for radiologists and increase sensitivity for subtle findings.

Spine Oncology

Compared with other aspects of spine surgery, fewer researchers have applied machine learning technology to interpretation of imaging in spinal oncology. Hammon et al ³⁴ made use of images from 114 patients and developed an SVM model to detect spinal metastases on CT scans. Similar work was undertaken by O’Connor et al, ³⁵ but both of these studies were limited by small imaging datasets. A more recent study made use of an innovate approach, which used a segmentation algorithm that identified regions of the image with similar signal characteristics. ³⁶ An SVM was then used to classify the segmented regions to identify areas suspicious for tumor. Again, the algorithm was limited by a small training sample of 49 patients and had a relatively high false positive rate. Wang et al ³⁷ made use of an CNN trained with MRI scans from 26 patients to detect metastatic lesions. In this case, a separate testing sample of images was not available to determine model performance.

Future research in spinal oncology may go beyond tumor detection and focus on automatically generating clinically meaningful parameters from MRI scans such as Bilsky grade and an estimate of spinal instability. In addition, the parameters generated by ML models may be combined with clinical information such as patient demographics, degree of impairment, and oncologic information, to assist clinicians with identifying patients who would benefit from surgery.