Fiber enhancement and 3D orientation analysis in label-free two-photon fluorescence microscopy

Fluorescence microscopy can be exploited for evaluating the brain’s fiber architecture with unsurpassed spatial resolution in combination with different tissue preparation and staining protocols. Differently from state-of-the-art polarimetry-based neuroimaging modalities, the quantification of fiber tract orientations from fluorescence microscopy volume images entails the application of specific image processing techniques, such as Fourier or structure tensor analysis. These, however, may lead to unreliable outcomes as they do not isolate myelinated fibers from the surrounding tissue. In this work, we describe a novel image processing pipeline that enables the computation of accurate 3D fiber orientation maps from both grey and white matter regions, exploiting the selective multiscale enhancement of tubular structures of varying diameters provided by a 3D implementation of the Frangi filter. The developed software tool can efficiently generate orientation distribution function maps at arbitrary spatial scales which may support the histological validation of modern diffusion-weighted magnetic resonance imaging tractography. Despite being tested here on two-photon scanning fluorescence microscopy images, acquired from tissue samples treated with a label-free technique enhancing the autofluorescence of myelinated fibers, the presented pipeline was developed to be employed on all types of 3D fluorescence images and fiber staining.