A froth velocity measurement method based on improved U-Net++ semantic segmentation in flotation process

Yiwei Chen; Degang Xu; Kun Wan

doi:10.1007/s12613-023-2787-2

Volume 31 Issue 8

Aug. 2024

Turn off MathJax

Article Contents

Article Navigation > International Journal of Minerals, Metallurgy and Materials > 2024 > 31(8): 1816-1827

Yiwei Chen, Degang Xu, and Kun Wan, A froth velocity measurement method based on improved U-Net++ semantic segmentation in flotation process, Int. J. Miner. Metall. Mater., 31(2024), No. 8, pp. 1816-1827. https://doi.org/10.1007/s12613-023-2787-2

Cite this article as:

Yiwei Chen, Degang Xu, and Kun Wan, A froth velocity measurement method based on improved U-Net++ semantic segmentation in flotation process, Int. J. Miner. Metall. Mater., 31(2024), No. 8, pp. 1816-1827. https://doi.org/10.1007/s12613-023-2787-2

Citation:

PDF( 4592 KB)

Research Article

A froth velocity measurement method based on improved U-Net++ semantic segmentation in flotation process

+ Author Affiliations

Corresponding author:
Degang Xu E-mail: dgxu@csu.edu.cn
Received: 12 August 2023; Revised: 6 November 2023; Accepted: 17 November 2023; Available online: 21 November 2023

Abstract

Abstract

During flotation, the features of the froth image are highly correlated with the concentrate grade and the corresponding working conditions. The static features such as color and size of the bubbles and the dynamic features such as velocity have obvious differences between different working conditions. The extraction of these features is typically relied on the outcomes of image segmentation at the froth edge, making the segmentation of froth image the basis for studying its visual information. Meanwhile, the absence of scientifically reliable training data with label and the necessity to manually construct dataset and label make the study difficult in the mineral flotation. To solve this problem, this paper constructs a tungsten concentrate froth image dataset, and proposes a data augmentation network based on Conditional Generative Adversarial Nets (cGAN) and a U-Net++-based edge segmentation network. The performance of this algorithm is also evaluated and contrasted with other algorithms in this paper. On the results of semantic segmentation, a phase-correlation-based velocity extraction method is finally suggested.
- froth flotation;
- froth segmentation;
- froth image;
- data augmentation;
- velocity extraction;
- image features

FullText(HTML)

Supplements(0)

References(43)

References

[1]	Y.L. Lu, D.W. Liu, X.D. Jia, J.J. Yuan, and D.Y. Shi, A review on flotation process of scheelite, Adv. Mater. Res., 962-965(2014), p. 388. doi: 10.4028/www.scientific.net/AMR.962-965.388
[2]	Z.Y. Chang, S.S. Niu, Z.C. Shen, L.C. Zou, and H.J. Wang, Latest advances and progress in the microbubble flotation of fine minerals: Microbubble preparation, equipment, and applications, Int. J. Miner. Metall. Mater., 30(2023), No. 7, p. 1244. doi: 10.1007/s12613-023-2615-8
[3]	D.W. Moolman, C. Aldrich, J.S.J.Van Deventer, and W.W. Stange, Digital image processing as a tool for on-line monitoring of froth in flotation plants, Miner. Eng., 7(1994), No. 9, p. 1149. doi: 10.1016/0892-6875(94)00058-1
[4]	D.W. Moolman, J.J. Eksteen, C. Aldrich, and J.S.J. van Deventer, The significance of flotation froth appearance for machine vision control, Int. J. Miner. Process., 48(1996), No. 3-4, p. 135. doi: 10.1016/S0301-7516(96)00022-1
[5]	D.W. Moolman, C. Aldrich, J.S.J. Van Deventer, and D.J. Bradshaw, The interpretation of flotation froth surfaces by using digital image analysis and neural networks, Chem. Eng. Sci., 50(1995), No. 22, p. 3501. doi: 10.1016/0009-2509(95)00190-G
[6]	W. Wang, F. Bergholm, and B. Yang, Froth delineation based on image classification, Miner. Eng., 16(2003), No. 11, p. 1183. doi: 10.1016/j.mineng.2003.07.014
[7]	W.X. Wang and O. Stephansson, A robust bubble delineation algorithm for froth images, [in] Proceedings of the Second International Conference on Intelligent Processing and Manufacturing of Materials. IPMM'99, Honolulu, 2002, p. 471.
[8]	A. Jahedsaravani, M. Massinaei, and M.H. Marhaban, An image segmentation algorithm for measurement of flotation froth bubble size distributions, Measurement, 111(2017), p. 29. doi: 10.1016/j.measurement.2017.07.023
[9]	J. Zhang, Z.H. Tang, M.X. Ai, and W.H. Gui, Nonlinear modeling of the relationship between reagent dosage and flotation froth surface image by Hammerstein-Wiener model, Miner. Eng., 120(2018), p. 19. doi: 10.1016/j.mineng.2018.01.018
[10]	J.M. Hargrave and S.T. Hall, Diagnosis of concentrate grade and mass flowrate in tin flotation from colour and surface texture analysis, Miner. Eng., 10(1997), No. 6, p. 613. doi: 10.1016/S0892-6875(97)00040-X
[11]	C. Marais and C. Aldrich, Estimation of platinum flotation grades from froth image data, Miner. Eng., 24(2011), No. 5, p. 433. doi: 10.1016/j.mineng.2010.12.006
[12]	K. Popli, A. Afacan, Q. Liu, and V. Prasad, Development of online soft sensors and dynamic fundamental model-based process monitoring for complex sulfide ore flotation, Miner. Eng., 124(2018), p. 10. doi: 10.1016/j.mineng.2018.04.006
[13]	J. Zhang, Z.H. Tang, Y.F. Xie, M.X. Ai, and W.H. Gui, Convolutional memory network-based flotation performance monitoring, Miner. Eng., 151(2020), art. No. 106332. doi: 10.1016/j.mineng.2020.106332
[14]	Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, Gradient-based learning applied to document recognition, Proc. IEEE, 86(1998), No. 11, p. 2278. doi: 10.1109/5.726791
[15]	A. Krizhevsky, I. Sutskever, and G.E. Hinton, ImageNet classification with deep convolutional neural networks, Commun. ACM, 60(2017), No. 6, p. 84. doi: 10.1145/3065386
[16]	K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, [in] International Conference on Learning Representations, San Diego, 2015.
[17]	K.M. He, X.Y. Zhang, S.Q. Ren, and J. Sun, Deep residual learning for image recognition, [in] 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR ), Las Vegas, 2016, p. 770.
[18]	H. Noh, S. Hong, and B. Han, Learning deconvolution network for semantic segmentation, [in] 2015 IEEE International Conference on Computer Vision (ICCV ), Santiago, 2015, p. 1520.
[19]	W.G. Baxt, Use of an artificial neural network for the diagnosis of myocardial infarction, Ann. Intern. Med., 115(1991), No. 11, p. 843. doi: 10.7326/0003-4819-115-11-843
[20]	R. Girshick, J. Donahue, T. Darrell, and J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, [in] 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, 2014, p. 580.
[21]	D. Forsyth, Object detection with discriminatively trained part-based models, Computer, 47(2014), No. 2, p. 6. doi: 10.1109/MC.2014.42
[22]	J. Wang, Y. Yang, J.H. Mao, Z.H. Huang, C. Huang, and W. Xu, CNN-RNN: A unified framework for multi-label image classification, [in] 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR ), Las Vegas, 2016, p. 2285.
[23]	A. Garcia-Garcia, S. Orts-Escolano, S.O. Oprea, V. Villena-Martinez, and J. Garcia-Rodriguez, A review on deep learning techniques applied to semantic segmentation, 2017. https://arxiv.org/abs/1704.06857v1.
[24]	J. Long, E. Shelhamer, and T. Darrell, Fully convolutional networks for semantic segmentation, [in] 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR ), Boston, 2015, p. 3431.
[25]	L.C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A.L. Yuille, DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs, IEEE Trans. Pattern Anal. Mach. Intell., 40(2018), No. 4, p. 834. doi: 10.1109/TPAMI.2017.2699184
[26]	J.P. Liu, Q.Q. Gao, Z.H. Tang, et al., Online monitoring of flotation froth bubble-size distributions via multiscale deblurring and multistage jumping feature-fused full convolutional networks, IEEE Trans. Instrum. Meas., 69(2020), No. 12, p. 9618. doi: 10.1109/TIM.2020.3006629
[27]	B.K. Gharehchobogh, Z.D. Kuzekanani, J. Sobhi, and A.M. Khiavi, Flotation froth image segmentation using Mask R-CNN, Miner. Eng., 192(2023), art. No. 107959. doi: 10.1016/j.mineng.2022.107959
[28]	O. Ronneberger, P. Fischer, and T. Brox, U-Net: Convolutional networks for biomedical image segmentation, [in] N. Navab, J. Hornegger, W.M. Wells, and AF. Frangi, eds., Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, Part III, Munich, 2015, p. 234.
[29]	Z.W. Zhou, M.M.R. Siddiquee, N. Tajbakhsh, and J.M. Liang, UNet++: A nested U-Net architecture for medical image segmentation, [in] D. Stoyanov, Z. Taylor, G. Carneiro, et al., eds., Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support (DLMIA 2018 , ML-CDS 2018 ), Granada, 2018, p. 3.
[30]	A. Dosovitskiy, P. Fischer, J.T. Springenberg, M. Riedmiller, and T. Brox, Discriminative unsupervised feature learning with exemplar convolutional neural networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(2016), No. 9, p. 1734. doi: 10.1109/TPAMI.2015.2496141
[31]	Z.X. Jiang, H. Zhang, Y. Wang, and S.B. Ko, Retinal blood vessel segmentation using fully convolutional network with transfer learning, Comput. Med. Imag. Graph., 68(2018), p. 1. doi: 10.1016/j.compmedimag.2018.04.005
[32]	I.J. Goodfellow, J. Pouget-Abadie, M. Mirza, et al., Generative adversarial networks, Commun. ACM, 63(2020), No. 11, p. 139. doi: 10.1145/3422622
[33]	X. Yi, E. Walia, and P. Babyn, Generative adversarial network in medical imaging: A review, Med. Image Anal., 58(2019), art. No. 101552. doi: 10.1016/j.media.2019.101552
[34]	M. Mirza and S. Osindero, Conditional generative adversarial nets, 2014. https://arxiv.org/abs/1411.1784
[35]	A. Radford, L. Metz, and S. Chintala, Unsupervised representation learning with deep convolutional generative adversarial networks, 2015. https://arxiv.org/abs/1511.06434
[36]	C. Szegedy, W. Liu, Y.Q. Jia, et al., Going deeper with convolutions, [in] 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR ), Boston, 2015, p. 1.
[37]	N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, Dropout: A simple way to prevent neural networks from overfitting, J. Mach. Learn. Res., 15(2014), No. 1, p. 1929.
[38]	A. Painsky and G. Wornell, On the universality of the logistic loss function, [in] 2018 IEEE International Symposium on Information Theory (ISIT ), Vail, 2018, p. 936.
[39]	P. Ramachandran, B. Zoph, and Q.V. Le, Searching for activation functions, 2017. http://arxiv.org/abs/1710.05941
[40]	J.M. Hargrave, N.J. Miles, and S.T. Hall, The use of grey level measurement in predicting coal flotation performance, Miner. Eng., 9(1996), No. 6, p. 667. doi: 10.1016/0892-6875(96)00054-4
[41]	A. Jahedsaravani, M.H. Marhaban, and M. Massinaei, Prediction of the metallurgical performances of a batch flotation system by image analysis and neural networks, Miner. Eng., 69(2014), p. 137. doi: 10.1016/j.mineng.2014.08.003
[42]	M. Massinaei, A. Jahedsaravani, E. Taheri, and J. Khalilpour, Machine vision based monitoring and analysis of a coal column flotation circuit, Powder Technol., 343(2019), p. 330. doi: 10.1016/j.powtec.2018.11.056
[43]	Y.L. Zhou and H.W. Li, The analysis of gas-liquid two-phase flow patterns based on variation coefficient of image connected regions and line-correlation algorithm, Energy Procedia, 17(2012), p. 933. doi: 10.1016/j.egypro.2012.02.190