6.18 Adaptive Sampling Configuration Interaction Method

6.18.2 Theory

If we have a wave function Ψ=iCiDi (where {Di} are Slater determinants with coefficients Ci) as an eigenstate of the Hamiltonian, then

Ci=jiHijCj(Hii-E), (6.56)

where Hij=Di𝐇Dj is the Hamiltonian matrix element between determinants i and j, and E is the energy of the eigenstate Ψ. This exact relationship can be generalized to a metric to predict the expected weight of a determinant Di in a CI expansion, by how it connects to other determinants in an approximate trial wave function. This metric is also used in Epstein-Nesbet Perturbation theory as coefficients for the determinants in the first order wave function.

In the ASCI method, all determinants Di that are single or double excitations away from the most important determinants (as ranked by magnitude of coefficients) in the trial wave function ψk are assigned an estimated importance Ai given as

Ai=DjψkHijCj(Hii-Ek), (6.57)

where Ek is the energy of the trial wave function ψk. The search and selection is only done in the space spanned by determinants connected to the top c determinants in ψk because unimportant determinants are unlikely to be the sole generator for a top ranked determinant, and this pruning of the search space greatly accelerates the algorithm. The top t determinants (as ranked by magnitude of Ai) connected to ψk are used to form the new wave function ψk+1 by exact diagonalization within that Hilbert subspace.

Once several cycles of ASCI has been completed, the wave function will contain all (or very nearly all) of the largest weight determinants in the FCI wave function and the remaining determinants not included should be of small weight. The effect of these many small remaining determinants are estimated by second order Epstein-Nesbet perturbation theory (PT2).Epstein:1926, Nesbet:1955 This final PT2 correction gives extremely accurate results, often within a kcal/mol of the absolute FCI energies even when only a tiny fraction of the Hilbert space is included in the ASCI wave function.Tubman:2016 An extrapolation of the variational energy against the PT2 correction (to the FCI limit of of zero PT2 correction) can also be carried out to generate more accurate estimates, and predict a metric for error in the final estimate. Indeed, it has been shown that linear or quadratic fits are quite accurate for extrapolation of SCI energies against the PT2 correction.Hait:2019, Holmes:2017, Loos:2018 We observe essentially linear behavior in the case of ASCI.

ASCI may be used as the full-CI solver for a CASSCF calculation, permitting the extension of CASSCF to active spaces of 50 electrons in 50 orbitals. The resulting method is termed ASCI-SCF Levine:2020. See section 6.17 for details on CASSCF job control.