Noise removal from images using the proposed three-term conjugate gradient algorithm
- Authors: Khudhur H.M.1, Halil I.H.2
-
Affiliations:
- Mosul University
- University of Kirkuk
- Issue: Vol 16, No 4 (2024)
- Pages: 841-853
- Section: NUMERICAL METHODS AND THE BASIS FOR THEIR APPLICATION
- URL: https://ogarev-online.ru/2076-7633/article/view/306590
- DOI: https://doi.org/10.20537/2076-7633-2024-16-4-841-853
- ID: 306590
Cite item
Full Text
Abstract
Conjugate gradient algorithms represent an important class of unconstrained optimization algorithms with strong local and global convergence properties and simple memory requirements. These algorithms have advantages that place them between the steep regression method and Newton’s algorithm because they require calculating the first derivatives only and do not require calculating and storing the second derivatives that Newton’s algorithm needs. They are also faster than the steep descent algorithm, meaning that they have overcome the slow convergence of this algorithm, and it does not need to calculate the Hessian matrix or any of its approximations, so it is widely used in optimization applications. This study proposes a novel method for image restoration by fusing the convex combination method with the hybrid (CG) method to create a hybrid three-term (CG) algorithm. Combining the features of both the Fletcher and Revees (FR) conjugate parameter and the hybrid Fletcher and Revees (FR), we get the search direction conjugate parameter. The search direction is the result of concatenating the gradient direction, the previous search direction, and the gradient from the previous iteration. We have shown that the new algorithm possesses the properties of global convergence and descent when using an inexact search line, relying on the standard Wolfe conditions, and using some assumptions. To guarantee the effectiveness of the suggested algorithm and processing image restoration problems. The numerical results of the new algorithm show high efficiency and accuracy in image restoration and speed of convergence when used in image restoration problems compared to Fletcher and Revees (FR) and three-term Fletcher and Revees (TTFR).
Keywords
About the authors
Hisham M.. Khudhur
Mosul University
Author for correspondence.
Email: hisham892020@uomosul.edu.iq
Isam H.. Halil
University of Kirkuk
Email: isam.h.halil@uokirkuk.edu.iq
References
- S. Aji, A. B. Abubakar, A. I. Kiri, A. Ishaku, “A spectral conjugate gradient-like method for convex constrained nonlinear monotone equations and signal recovery”, Nonlinear Convex Analysis and Optimization, 1:1 (2022), 1–23.
- Z. Aminifard, S. Babaie-Kafaki, “Dai–Liao extensions of a descent hybrid nonlinear conjugate gradient method with application in signal processing”, Numerical Algorithms, 89:3 (2022), 1369–1387.
- S. Babaie-Kafaki, N. Mirhoseini, Z. Aminifard, “A descent extension of a modified Polak–Ribièr–Polyak method with application in image restoration problem”, Optimization Letters, 17:2 (2023), 351–367.
- Y. H. Dai, “New conjugacy conditions and related nonlinear conjugate gradient methods”, Applied Mathematics and Optimization, 43:1 (2001), 87–101.
- Z. Dai, H. Zhu, X. Zhang, “Dynamic spillover effects and portfolio strategies between crude oil, gold and Chinese stock markets related to new energy vehicle”, Energy Economics, 109 (2022), 105959.
- M. A. Elhamid, H. M. Khudhur, “A globally convergent of two conjugate gradient methods with application to image restoration problems”, Numerical Algebra, Control and Optimization, 2024.
- R. Fletcher, “Function minimization by conjugate gradients”, The Computer Journal, 7:2 (1964), 149–154.
- R. Fletcher, Practical methods of optimization, v. 1, Unconstrained optimization, Wiley, Chichester, UK, 1980. https://books.google.iq/books?id=igc8AQAAMAAJ
- W. W. Hager, H. Zhang, “A survey of nonlinear conjugate gradient methods”, Pacific Journal of Optimization, 2:1 (2006), 35–58. http://www.math.lsu.edu/~hozhang/papers/cgsurvey.pdf
- B. A. Hassan, H. A. Alashoor, “On image restoration problems using new conjugate gradient methods”, Indonesian Journal of Electrical Engineering and Computer Science, 29:3 (2023), 1438–1445.
- B. A. Hassan, H. Sadiq, “Efficient new conjugate gradient methods for removing impulse noise images”, European Journal of Pure and Applied Mathematics, 15:4 (2022), 2011–2021.
- A. Hassan Ibrahim, P. Kumam, B. A. Hassan, A. Bala Abubakar, J. Abubakar, “A derivative-free three-term Hestenes–Stiefel type method for constrained nonlinear equations and image restoration”, International Journal of Computer Mathematics, 99:5 (2021), 1041–1065.
- M. R. Hestenes, E. Stiefel, “Methods of conjugate gradients for solving linear systems”, Journal of Research of the National Bureau of Standards, 49:6 (1952), 409–436.
- Y. Ismail Ibrahim, H. Mohammed Khudhur, “Modified three-term conjugate gradient algorithm and its applications in image restoration”, Indonesian Journal of Electrical Engineering and Computer Science, 28:3 (2022), 1510–1517.
- X. Jiang, W. Liao, J. Yin, J. Jian, “A new family of hybrid three-term conjugate gradient methods with applications in image restoration”, Numerical Algorithms, 91:1 (2022), 161–191.
- X. Jiang, H. Yang, J. Yin, W. Liao, “A three-term conjugate gradient algorithm with restart procedure to solve image restoration problems”, Journal of Computational and Applied Mathematics, 424 (2023), 115020.
- H. M. Khudhur, A. A. M. Fawze, “An improved conjugate gradient method for solving unconstrained optimisation and image restoration problems”, International Journal of Mathematical Modelling and Numerical Optimisation, 13:3 (2023), 313–325.
- H. M. Khudhur, B. A. Hassan, S. Aji, “Superior formula for gradient impulse noise reduction from images”, International Journal of Applied and Computational Mathematics, 10:1 (2024), 4.
- H. M. Khudhur, H. H. Mohammed, “A new three-term conjugate gradient method for unconstrained optimisation and its applications in image restoration”, International Journal of Mathematics in Operational Research, 28:2 (2024), 253–273.
- Y. Laylani, B. A. Hassan, H. M. Khudhur, “A new class of optimization methods based on coefficient conjugate gradient”, European Journal of Pure and Applied Mathematics, 15:4 (2022), 1908–1916.
- Y. Laylani, H. M. Khudhur, E. M. Nori, K. K. Abbo, “A hybridization of the Hestenes–Stiefel and Dai–Yuan conjugate gradient methods”, European Journal of Pure and Applied Mathematics, 16:2 (2023), 1059–1067.
- G. Li, C. Tang, Z. Wei, “New conjugacy condition and related new conjugate gradient methods for unconstrained optimization”, Journal of Computational and Applied Mathematics, 202:2 (2007), 523–539.
- J. K. Liu, Y. X. Zhao, X. L. Wu, “Some three-term conjugate gradient methods with the new direction structure”, Applied Numerical Mathematics, 150 (2020), 433–443.
- Y. Liu, C. Storey, “Efficient generalized conjugate gradient algorithms. Part 1: Theory”, Journal of Optimization Theory and Applications, 69:1 (1991), 129–137.
- Y. Narushima, H. Yabe, J. A. Ford, “A three-term conjugate gradient method with sufficient descent property for unconstrained optimization”, SIAM Journal on Optimization, 21:1 (2011), 212–230.
- E. Polak, G. Ribière, “Note sur la convergence de méthodes de directions conjuguées”, Revue Française d’informatique et de Recherche Opérationnelle. Série Rouge, 3:16 (1969), 35–43.
- M. J. D. Powell, “A survey of numerical methods for unconstrained optimization”, SIAM Review, 12:1 (1970), 79–97.
- B. Sellami, Y. Laskri, R. Benzine, “A new two-parameter family of nonlinear conjugate gradient methods”, Optimization, 64:4 (2015), 993–1009.
- C. Souli, R. Ziadi, A. Bencherif-Madani, H. M. Khudhur, “A hybrid CG algorithm for nonlinear unconstrained optimization with application in image restoration”, Journal of Mathematical Modeling, 12:2 (2024), 301–317.
- X. Wang, Y. Tian, L. Pang, “A class of three-term derivative-free methods for large-scale nonlinear monotone system of equations and applications to image restoration problems”, Journal of Applied Mathematics and Computing, 69:1 (2023), 1269–1296.
- G. Yuan, T. Li, W. Hu, “A conjugate gradient algorithm for large-scale nonlinear equations and image restoration problems”, Applied Numerical Mathematics, 147 (2020), 129–141.
- L. Zhang, W. Zhou, D. Li, “Global convergence of a modified Fletcher–Reeves conjugate gradient method with Armijo-type line search”, Numerische Mathematik, 104:4 (2006), 561–572.
- L. Zhang, W. Zhou, D. Li, “Some descent three-term conjugate gradient methods and their global convergence”, Optimization Methods and Software, 22:4 (2007), 697–711.
- L. Zhang, W. Zhou, D. H. Li, “A descent modified Polak–Ribièr–Polyak conjugate gradient method and its global convergence”, IMA Journal of Numerical Analysis, 26:4 (2006), 629–640.
- G. Zoutendijk, “Nonlinear programming, computational methods”, Integer and Nonlinear Programming, North-Holland, Amsterdam, 1970, 37–86.
Supplementary files
