Improved in vivo optical coherence tomography imaging of animal peripheral nerves using a prism nerve holder

SIGNIFICANCE: Modern optical volumetric imaging modalities, such as optical coherence tomography (OCT), provide enormous information about the structure, function, and physiology of living tissue. Although optical imaging achieves lateral resolution on the order of the wavelength of light used, and OCT achieves axial resolution on a similar micron scale, tissue optical properties, particularly high scattering and absorption, limit light penetration to only a few millimeters. In addition, in vivo imaging modalities are susceptible to significant motion artifacts due to cardiac and respiratory function. These effects limit access to artifact-free optical measurements during peripheral neurosurgery to only a portion of the exposed nerve without further modification to the procedure. AIM: We aim to improve in vivo OCT imaging during peripheral neurosurgery in small and large animals by increasing the amount of visualized nerve volume as well as suppressing motion of the imaged area. APPROACH: We designed a nerve holder with embedded mirror prisms for peripheral nerve volumetric imaging as well as a specific beam steering strategy to acquire prism and direct view volumes in one session with minimal motion artifacts. RESULTS: The axially imaged volumes from mirror prisms increased the OCT signal intensity by [Formula: see text] over a 1.25-mm imaging depth in tissue-mimicking phantoms. We then demonstrated the new imaging capabilities in visualizing peripheral nerves from direct and side views in living rats and minipigs using a polarization-sensitive OCT system. Prism views have shown nerve fascicles and vasculature from the bottom half of the imaged nerve which was not visible in direct view. CONCLUSIONS: We demonstrated improved OCT imaging during neurosurgery in small and large animals by combining the use of a prism nerve holder with a specifically designed beam scanning protocol. Our strategy can be applied to existing OCT imaging systems with minimal hardware modification, increasing the nerve tissue volume visualized. Enhanced imaging depth techniques may lead to a greater adoption of structural and functional optical biomarkers in preclinical and clinical medicine.