Quantitative digital microscopy with deep learning

Benjamin Midtvedt, Saga Helgadottir, Aykut Argun, Jesus Pineda, Daniel Midtvedt, and Giovanni Volpe.

Applied Physics Reviews (2021)

Abstract

Video microscopy has a long history of providing insight and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time-consuming, and computationally expensive. Recently, alternative data-driven approaches using deep learning have greatly improved quantitative digital microscopy, potentially offering automatized, accurate, and fast image analysis. However, the combination of deep learning and video microscopy remains underutilized primarily due to the steep learning curve involved in developing custom deep-learning solutions. To overcome this issue, we introduce software, DeepTrack 2.0, to design, train, and validate deep-learning solutions for digital microscopy. We use this software to exemplify how deep learning can be employed for a broad range of applications, from particle localization, tracking, and characterization, to cell counting and classification. Thanks to its user-friendly graphical interface, DeepTrack 2.0 can be easily customized for user-specific applications, and thanks to its open-source, object-oriented programing, it can be easily expanded to add features and functionalities, potentially introducing deep-learning-enhanced video microscopy to a far wider audience.