Individual identification of endangered amphibians using deep learning and smartphone images: case study of the Japanese giant salamander (Andrias japonicus)

Information obtained via individual identification is invaluable for ecology and conservation. Physical tags, such as PIT tags and GPS, have been used for individual identification; however, these methods could impact on animal behavior and survival rates, and the tags may become lost. Although non-invasive methods that do not affect the target species (such as manual photoidentification) are available, these techniques utilize stripes and spots that are unique to the individual, which requires training, and applying them to large datasets is challenging. Many studies that have applied deep learning for identification have focused on species-level identification, but few have addressed individual-level identification. In this study, we developed an image-based identification method based on deep learning that uses the head spot pattern of the Japanese giant salamander (Andrias japonicus), an endemic and endangered species in Japan. We trained and evaluated a dataset collected over two days from 11 individuals in captivity, which included 7075 images taken by a smartphone camera. Individuals were photographed three times a day at approximately 11:00 (morning), 15:00 (afternoon), and 18:00 (evening). As a result, individual identification by our method, which used the EfficientNetV2 achieved 99.86% accuracy, kappa coefficient of 0.99, and an F1 score of 0.99. Performance was lower for the evening model than for the morning and afternoon models, which were trained and evaluated using photographs taken at the corresponding time of the day. The proposed method does not require direct contact with the target species, and the effect on the animals is minimal; moreover, individual-level information can be obtained under natural conditions. In the future, smartphone images can be applied to citizen science surveys and individual-level big data collection, which is difficult using current methods.