A deep learning-based method for segmentation and quantitative characterization of microstructures in weathering steel from sequential scanning electron microscope images
1 Beijing Advanced Innovation Center for Materials Genome Engineering, Central Iron & Steel Research Institute, Beijing 100081, China 2 Qingdao NCS Testing & Corrosion Protection Technology Co., Ltd., Qingdao 266071, Shandong, China 3 Beijing Key Laboratory of Metal Materials Characterization, Central Iron & Steel Research Institute, Beijing 100081, China
A deep learning-based method for segmentation and quantitative characterization of microstructures in weathering steel from sequential scanning electron microscope images
1 Beijing Advanced Innovation Center for Materials Genome Engineering, Central Iron & Steel Research Institute, Beijing 100081, China 2 Qingdao NCS Testing & Corrosion Protection Technology Co., Ltd., Qingdao 266071, Shandong, China 3 Beijing Key Laboratory of Metal Materials Characterization, Central Iron & Steel Research Institute, Beijing 100081, China
摘要 Microstructural classification is typically done manually by human experts, which gives rise to uncertainties due to subjectivity and reduces the overall efficiency. A high-throughput characterization is proposed based on deep learning, rapid acquisition technology, and mathematical statistics for the recognition, segmentation, and quantification of microstructure in weathering steel. The segmentation results showed that this method was accurate and efficient, and the segmentation of inclusions and pearlite phase achieved accuracy of 89.95% and 90.86%, respectively. The time required for batch processing by MIPAR software involving thresholding segmentation, morphological processing, and small area deletion was 1.05 s for a single image. By comparison, our system required only 0.102 s, which is ten times faster than the commercial software. The quantification results were extracted from large volumes of sequential image data (150 mm2, 62,216 images, 1024 × 1024 pixels), which ensure comprehensive statistics. Microstructure information, such as three-dimensional density distribution and the frequency of the minimum spatial distance of inclusions on the sample surface of 150 mm2, were quantified by extracting the coordinates and sizes of individual features. A refined characterization method for two-dimensional structures and spatial information that is unattainable when performing manually or with software is provided. That will be useful for understanding properties or behaviors of weathering steel, and reducing the resort to physical testing.
Microstructural classification is typically done manually by human experts, which gives rise to uncertainties due to subjectivity and reduces the overall efficiency. A high-throughput characterization is proposed based on deep learning, rapid acquisition technology, and mathematical statistics for the recognition, segmentation, and quantification of microstructure in weathering steel. The segmentation results showed that this method was accurate and efficient, and the segmentation of inclusions and pearlite phase achieved accuracy of 89.95% and 90.86%, respectively. The time required for batch processing by MIPAR software involving thresholding segmentation, morphological processing, and small area deletion was 1.05 s for a single image. By comparison, our system required only 0.102 s, which is ten times faster than the commercial software. The quantification results were extracted from large volumes of sequential image data (150 mm2, 62,216 images, 1024 × 1024 pixels), which ensure comprehensive statistics. Microstructure information, such as three-dimensional density distribution and the frequency of the minimum spatial distance of inclusions on the sample surface of 150 mm2, were quantified by extracting the coordinates and sizes of individual features. A refined characterization method for two-dimensional structures and spatial information that is unattainable when performing manually or with software is provided. That will be useful for understanding properties or behaviors of weathering steel, and reducing the resort to physical testing.
Bing Han,Wei-hao Wan,Dan-dan Sun, et al. A deep learning-based method for segmentation and quantitative characterization of microstructures in weathering steel from sequential scanning electron microscope images[J]. Journal of Iron and Steel Research International, 2022, 29(5): 836-845.