Human Papilloma Virus (HPV) is a major risk factor for the development of oropharyngeal cancer. Automatic detection of HPV in digitized pathology tissues using in situ hybridisation (ISH) is a difficult task due to the variability and complexity of staining patterns as well as the presence of imaging and staining artefacts. This paper proposes an intelligent image analysis framework to determine HPV status in digitized samples of oropharyngeal cancer tissue micro-arrays (TMA). The proposed pipeline mixes handcrafted feature extraction with a deep learning for epithelial region segmentation as a preliminary step. We apply a deep central attention learning technique to segment epithelial regions and within those assess the presence of regions representing ISH products. We then extract relevant morphological measurements from those regions which are then input into a supervised learning model for the identification of HPV status. The performance of the proposed method has been evaluated on 2009 TMA images of oropharyngeal carcinoma tissues captured with a ×20 objective. The experimental results show that our technique provides around 91% classification accuracy in detecting HPV status when compared with the histopatholgist gold standard. We also tested the performance of end-to-end deep learning classification methods to assess HPV status by learning directly from the original ISH processed images, rather than from the handcrafted features extracted from the segmented images. We examined the performance of sequential convolutional neural networks (CNN) architectures including three popular image recognition networks (VGG-16, ResNet and Inception V3) in their pre-trained and trained from scratch versions, however their highest classification accuracy was inferior (78%) to the hybrid pipeline presented here.
Bibliographical noteFunding Information:
The research reported in this paper was supported by the Engineering and Physical Sciences Research Council ( EPSRC ), UK through funding under grant EP/M023869/1 ‘Novel context-based segmentation algorithms for intelligent microscopy.
- Deep learning
- Human papilloma virus
- In situ hybridisation
- Machine learning
ASJC Scopus subject areas
- Radiological and Ultrasound Technology
- Radiology Nuclear Medicine and imaging
- Computer Vision and Pattern Recognition
- Health Informatics
- Computer Graphics and Computer-Aided Design