The Arnoldi process generates an orthonormal basis for the Krylov subspace explored by GMRES. Orthonormality gives the method a structured set of directions for constructing successive approximations, while the expanding subspace allows the solution estimate to incorporate increasingly relevant information from the linear system. This basis-building step is central to applying GMRES without forming a matrix inverse.
The residual measures the discrepancy remaining after an approximate solution is substituted into the linear system. GMRES selects the approximation with the smallest residual norm among the candidates in its current Krylov subspace. This criterion provides a direct measure for choosing each iterate and helps the method target an approximation that better satisfies the original equations.
Preconditioning transforms the linear system into a more favorable form before or during the iterative solution process. The goal is to make the transformed problem easier for GMRES to handle, which can improve convergence. In engineering computations, this can be important because better convergence may reduce the computation time and resources required for large sparse systems.
GMRES is particularly appropriate when the system matrix is sparse or nonsymmetric, conditions that commonly arise in large computational models. Its iterative strategy avoids explicitly calculating a matrix inverse, while the Krylov-subspace approach builds approximations from the system's matrix information. These characteristics make it useful when direct handling of a large matrix would be computationally demanding.
A typical workflow begins with the linear system and, when appropriate, a preconditioned form that has more favorable behavior. GMRES then applies the Arnoldi process to construct an orthonormal Krylov-subspace basis. At each iteration, it evaluates candidate approximations in that subspace and selects the one with the smallest residual norm, continuing this process as the approximation improves.
Engineering applications include computational problems in fluid flow, structural analysis, and electromagnetics. These areas can produce large linear systems whose sparse or nonsymmetric structure makes iterative treatment valuable. By avoiding explicit matrix inversion and potentially benefiting from preconditioning, GMRES can help reduce memory use and computation time when solving demanding models.