Image‐based real‐time feedback control of magnetic digital microfluidics by artificial intelligence‐empowered rapid object detector for automated in vitro diagnostics

In vitro diagnostics (IVD) plays a critical role in healthcare and public health management. Magnetic digital microfluidics (MDM) perform IVD assays by manipulating droplets on an open substrate with magnetic particles. Automated IVD based on MDM could reduce the risk of accidental exposure to contagious pathogens among healthcare workers. However, it remains challenging to create a fully automated IVD platform based on the MDM technology because of a lack of effective feedback control system to ensure the successful execution of various droplet operations required for IVD. In this work, an artificial intelligence (AI)‐empowered MDM platform with image‐based real‐time feedback control is presented. The AI is trained to recognize droplets and magnetic particles, measure their size, and determine their location and relationship in real time; it shows the ability to rectify failed droplet operations based on the feedback information, a function that is unattainable by conventional MDM platforms, thereby ensuring that the entire IVD process is not interrupted due to the failure of liquid handling. We demonstrate fundamental droplet operations, which include droplet transport, particle extraction, droplet merging and droplet mixing, on the MDM platform and show how the AI rectify failed droplet operations by acting upon the feedback information. Protein quantification and antibiotic resistance detection are performed on this AI‐empowered MDM platform, and the results obtained agree well with the benchmarks. We envision that this AI‐based feedback approach will be widely adopted not only by MDM but also by other types of digital microfluidic platforms to offer precise and error‐free droplet operations for a wide range of automated IVD applications.