Tape Storage and CRC Protection

Over 100 Petabytes of data is stored on several kind of physical support, namely disks and tapes. Data on any physical support or traveling on a data link (network, fibre channel...) can be subject to silent data corruption. A possible improvement is introducing end-to-end data integrity from the filesystem down to the tape layer. For the tape back-end it can be done by using Logical Block Protection, which computes and compares CRC checksum of every single block of data. During my work, I improved on-the-fly CRC calculation for the tape storage system, which was achieved by introducing a multithreaded implementation - a technique applicable to arbitrary CRC algorithm. Finally, I performed several benchmark measurements of these improvements. That proved usability in a production context.