Gradient (CG) Overview of Reduced-Rank Conjugate Gradient Algorithm Let Rx = b with R ∈ CN×N and b, x ∈ CN×1. Basic steps of CG Algorithm for i ∈ [1, D] Direction update: di = di−1 + βi di−1 Solution update: xi = xi−1 + αi di Residual update: ri = ri−1 − αi Rdi end for If D = N, then x is the exact solution which belongs in the Krylov space KN = span{d1, d2, . . . , dN } (14) If D < N, then the solution lies in the Krylov sub-space