An intelligent workflow for sub-nanoscale 3D reconstruction of intact synapses from serial section electron tomography

BACKGROUND: As an extension of electron tomography (ET), serial section electron tomography (serial section ET) aims to align the tomographic images of multiple thick tissue sections together, to break through the volume limitation of the single section and preserve the sub-nanoscale voxel size. It could be applied to reconstruct the intact synapse, which expands about one micrometer and contains nanoscale vesicles. However, there are several drawbacks of the existing serial section ET methods. First, locating and imaging regions of interest (ROIs) in serial sections during the shooting process is time-consuming. Second, the alignment of ET volumes is difficult due to the missing information caused by section cutting and imaging. Here we report a workflow to simplify the acquisition of ROIs in serial sections, automatically align the volume of serial section ET, and semi-automatically reconstruct the target synaptic structure. RESULTS: We propose an intelligent workflow to reconstruct the intact synapse with sub-nanometer voxel size. Our workflow includes rapid localization of ROIs in serial sections, automatic alignment, restoration, assembly of serial ET volumes, and semi-automatic target structure segmentation. For the localization and acquisition of ROIs in serial sections, we use affine transformations to calculate their approximate position based on their relative location in orderly placed sections. For the alignment of consecutive ET volumes with significantly distinct appearances, we use multi-scale image feature matching and the elastic with belief propagation (BP-Elastic) algorithm to align them from coarse to fine. For the restoration of the missing information in ET, we first estimate the number of lost images based on the pixel changes of adjacent volumes after alignment. Then, we present a missing information generation network that is appropriate for small-sample of ET volume using pre-training interpolation network and distillation learning. And we use it to generate the missing information to achieve the whole volume reconstruction. For the reconstruction of synaptic ultrastructures, we use a 3D neural network to obtain them quickly. In summary, our workflow can quickly locate and acquire ROIs in serial sections, automatically align, restore, assemble serial sections, and obtain the complete segmentation result of the target structure with minimal manual manipulation. Multiple intact synapses in wild-type rat were reconstructed at a voxel size of 0.664 nm/voxel to demonstrate the effectiveness of our workflow. CONCLUSIONS: Our workflow contributes to obtaining intact synaptic structures at the sub-nanometer scale through serial section ET, which contains rapid ROI locating, automatic alignment, volume reconstruction, and semi-automatic synapse reconstruction. We have open-sourced the relevant code in our workflow, so it is easy to apply it to other labs and obtain complete 3D ultrastructures which size is similar to intact synapses with sub-nanometer voxel size. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12915-023-01696-x.