Hanna Råhnängen and Sally Vizins will present their master's thesis 

Virtual H&E Staining of Skin Tissue Using Neural Networks - An Investigation of the Benefits of Point Light Source Illumination Images in Generating H&E-stained Images of Skin Tissue

Thursday 11/1 at 10:15 in MH:333 and on Zoom 
https://lu-se.zoom.us/j/65835772225?pwd=U0FmTTZxVHRZSThoSlFYdHUxZ2pnQT09 

Abstract:
Histopathological examination, crucial in diagnosing diseases such as cancer, traditionally relies on time- and resource-consuming, poorly standardized chemical staining for tissue visualization. This thesis presents a novel digital alternative using generative neural networks and a point light source (PLS) microscope to transform unstained skin tissue images into their stained counterparts. Building upon the successful virtual staining of white blood cells, this approach utilizes PLS microscopy's unique illumination angles, providing more structural information about a sample and thereby enhancing a neural network's ability to produce accurate, virtually stained images. Two matched datasets, each containing paired unstained and chemically stained tissue images, were used for supervised training of the networks. One dataset comprised healthy tissue, while the other, in addition to healthy tissue, included basal and squamous cell carcinomas. Given the limited scope of this master's thesis, which constrained data acquisition, these datasets were relatively small, potentially impacting the generalizability of the model. The project explored the virtual staining capabilities of UNet and DenseUNet architectures, focusing on network depth and input channels. Variations in activation functions, upsampling blocks, and attention gates were tested, alongside the development of Relativistic Generative Adversarial Network (RGAN) models. Quantitative evaluation using standard metrics and qualitative assessment by pathologists demonstrated the potential of PLS microscopy in virtual staining. The final model, based on RGAN, achieved superior staining accuracy with a structural similarity (SSIM) score of 0.799, significantly outperforming traditional bright field imaging (SSIM 0.631). However, the limited diversity and size of the datasets may have inflated these scores and highlight the need for caution in interpreting the results. Pathologists found virtually stained images indistinguishable from their chemically stained counterparts, with average stain quality ratings of 6.40 out of 10 for virtual images, which did not differ significantly from the rating of 6.41 for chemically stained ones. The pathologists were also able to identify 90.90% of all images containing diseased tissue as such. In conclusion, virtual staining using PLS microscopy holds considerable promise, offering a more standardized and sustainable approach compared to chemical staining. This method has the potential to speed up diagnosis and facilitate further analysis using image analysis algorithms. Future research could expand this technique beyond skin tissues, enhancing its applicability across a broader range of histopathological examinations.

Supervisors:
Ida Arvidsson, Centre for Mathematical Sciences
Håkan Wieslander, CellaVision
Jonna Stålring Westerberg, CellaVision

Examiner:
Niels Christian Overgaard, Centre for Mathematical Sciences