Composite Anderson acceleration method with two window sizes and optimized damping

Composite Anderson acceleration method with two window sizes and optimized damping

Chen, K. (TU Delft Numerical Analysis; Nanjing University of Information Sciences and Technology)
Vuik, Cornelis (TU Delft Delft Institute of Applied Mathematics)

2022

In this article, we propose and analyze a set of fully nonstationary Anderson acceleration (AA) algorithms with two window sizes and optimized damping. Although AA has been used for decades to speed up nonlinear solvers in many applications, most authors are simply using and analyzing the stationary version of AA (sAA) with fixed window size and a constant damping factor. The behavior and potential of the nonstationary version of AA methods remain an open question. Most efficient linear solvers however use composable algorithmic components. Similar ideas can be used for AA to solve nonlinear systems. Thus in the present work, to develop nonstationary AA algorithms, we first propose a systematic way to dynamically alternate the window size (Formula presented.) by the multiplicative composite combination, which means we apply sAA((Formula presented.)) in the outer loop and apply sAA((Formula presented.)) in the inner loop. By doing this, significant gains can be achieved. Second, to make AA to be a fully nonstationary algorithm, we need to combine these strategies with our recent work on the nonstationary AA algorithm with optimized damping (AAoptD), which is another important direction of producing nonstationary AA and nice performance gains have been observed. Moreover, we also investigate the rate of convergence of these nonstationary AA methods under suitable assumptions. Finally, our numerical results show that some of these proposed nonstationary AA algorithms converge faster than the stationary sAA method and they may significantly reduce the storage and time to find the solution in many cases.

Anderson acceleration
fixed-point iteration
nonstationary

http://resolver.tudelft.nl/uuid:ae78e3c4-b42f-4aa4-a67b-1ae32c0e6ff1

https://doi.org/10.1002/nme.7096

2023-02-12

0029-5981

International Journal for Numerical Methods in Engineering, 123 (23), 5964-5985

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Institutional Repository

journal article

© 2022 K. Chen, Cornelis Vuik