Overview: Computer Vision and Machine Learning for Microstructural Characterization and Analysis

Abstract Microstructural characterization and analysis is the foundation of microstructural science, connecting materials structure to composition, process history, and properties. Microstructural quantification traditionally involves a human deciding what to measure and then devising a method for doing so. However, recent advances in computer vision (CV) and machine learning (ML) offer new approaches for extracting information from microstructural images. This overview surveys CV methods for numerically encoding the visual information contained in a microstructural image using either feature-based representations or convolutional neural network (CNN) layers, which then provides input to supervised or unsupervised ML algorithms that find associations and trends in the high-dimensional image representation. CV/ML systems for microstructural characterization and analysis span the taxonomy of image analysis tasks, including image classification, semantic segmentation, object detection, and instance segmentation. These tools enable new approaches to microstructural analysis, including the development of new, rich visual metrics and the discovery of processing-microstructure-property relationships