Improved medical image modality classification using a combination of visual and textual features
Journal
Computerized Medical Imaging and Graphics
Date Issued
2015-01-01
Author(s)
Džeroski, Sasho
Abstract
In this paper, we present the approach that we applied to the medical modality classification tasks at the ImageCLEF evaluation forum. More specifically, we used the modality classification databases from the ImageCLEF competitions in 2011, 2012 and 2013, described by four visual and one textual types of features, and combinations thereof. We used local binary patterns, color and edge directivity descriptors, fuzzy color and texture histogram and scale-invariantfeature transform (and its variant opponentSIFT) as visual features and the standard bag-of-words textual representation coupled with TF-IDF weighting. The results fromthe extensive experimental evaluationidentify the SIFT andopponentSIFT features as the best performing features for modality classification. Next, the low-level fusion of the visual features improves the predictive performance of the classifiers. This is because the different features are able to capture different aspects of an image, their combination offering a more complete representation of the visual content in an image. Moreover, adding textual features further increases the predictive performance.
Finally, the results obtained with our approach are the best results reported on these databases so far.
Finally, the results obtained with our approach are the best results reported on these databases so far.
Subjects
File(s)![Thumbnail Image]()
Loading...
Name
2015-DimitrovskiEtAl-CMIG.pdf
Size
3.13 MB
Format
Adobe PDF
Checksum
(MD5):936489754f3f12e35c3002856c2c6ffe