[Paper Review] On the $K$-sat model with large number of clauses

Dmitry Panchenko|arXiv (Cornell University)|Aug 22, 2016

Topological and Geometric Data Analysis17 references3 citations

TL;DR

This paper establishes a precise asymptotic formula for the expected minimum fraction of unsatisfied clauses in the $K$-sat model with $\alpha N$ clauses as $\alpha \to \infty$, showing it is $\frac{\alpha}{2^K} - \frac{\sqrt{\alpha}}{2^K} \mathbb{E}M_N + o(\sqrt{\alpha})$, where $\mathbb{E}M_N$ is the expected normalized maximum energy of a mixed $p$-spin spin glass. The result rigorously confirms the Leuzzi-Parisi formula derived via the non-rigorous replica method.

ABSTRACT

We show that in the $K$-sat model with $N$ variables and $αN$ clauses, the expected ratio of the smallest number of unsatisfied clauses to the number of variables is $α/2^K - \sqrtα c_*(N)/2^K$ up to smaller order terms $o(\sqrtα)$ as $α o\infty$ uniformly in $N$, where $c_*(N)$ is the expected normalized maximum energy of some specific mixed $p$-spin spin glass model. The formula for the limit of $c_*(N)$ is well known in the theory of spin glasses.

Motivation & Objective

• To derive a precise asymptotic expression for the expected minimum fraction of unsatisfied clauses in the $K$-sat model when the number of clauses $\alpha N$ is large.
• To establish the leading-order correction term in the asymptotic expansion of the optimal clause satisfaction ratio, showing it scales as $-\frac{\sqrt{\alpha}}{2^K} \mathbb{E}M_N$.
• To connect the $K$-sat model's behavior in the large $\alpha$ regime to the well-understood mixed $p$-spin spin glass model via the Guerra-Toninelli interpolation method.
• To provide a rigorous foundation for the Leuzzi-Parisi formula, previously derived using non-rigorous replica methods, by linking it to the Parisi formula for spin glasses.

Proposed method

• The authors employ the Guerra-Toninelli interpolation technique to relate the $K$-sat Hamiltonian to a mixed $p$-spin spin glass model with covariance structure $\mathbb{E}H(\sigma^1)H(\sigma^2) = N\xi(R_{1,2})$, where $\xi(x) = (1+x)^K - 1$.
• They define a time-dependent Hamiltonian $H(t, \sigma)$ interpolating between the $K$-sat model at $t=0$ and the mixed $p$-spin model at $t=1$, and analyze the derivative of the free energy $\varphi(t) = \frac{1}{N} \mathbb{E} \log \sum_{\sigma} \exp H(t, \sigma)$.
• By choosing the interpolation parameter $\beta = \frac{\sqrt{\alpha}(1 - e^{-\delta})}{2^K}$, they cancel the leading overlap-dependent term in $\varphi'(t)$, isolating the correction term involving $\mathbb{E}M_N$.
• They bound the remainder terms in the interpolation expansion using Taylor expansion and moment estimates, showing $|\mathrm{III}| = O(\alpha \delta^3)$ for small $\delta$.
• By setting $\delta = \alpha^{-1/3}$, they balance the error terms and derive the final asymptotic formula for $\mathbb{E}M_{N,\alpha}$.
• The proof relies on known results on the Parisi formula for mixed $p$-spin models, particularly the zero-temperature limit of the free energy, which gives $\mathbb{E}M_N$.

Experimental results

Research questions

• RQ1 What is the precise asymptotic behavior of the expected minimum fraction of unsatisfied clauses in the $K$-sat model as $\alpha \to \infty$?
• RQ2 How does the correction term to the leading $\alpha / 2^K$ term depend on the structure of the $K$-sat instance?
• RQ3 Can the non-rigorous Leuzzi-Parisi formula for the $K$-sat model be rigorously derived using spin glass theory?
• RQ4 What is the role of the mixed $p$-spin spin glass model in understanding the typical behavior of the $K$-sat model at large clause density?
• RQ5 How do remainder terms in the Guerra-Toninelli interpolation affect the accuracy of the asymptotic expansion?

Key findings

• The expected minimum fraction of unsatisfied clauses in the $K$-sat model with $\alpha N$ clauses is asymptotically $\frac{\alpha}{2^K} - \frac{\sqrt{\alpha}}{2^K} \mathbb{E}M_N + R(\alpha)$, where $|R(\alpha)| \leq L \alpha^{1/3}$ for $\alpha \geq L$.
• The correction term is proportional to $\sqrt{\alpha}$, with the coefficient $\mathbb{E}M_N$ being the expected normalized maximum energy of a mixed $p$-spin spin glass model with $\xi(x) = (1+x)^K - 1$.
• The formula confirms the Leuzzi-Parisi formula derived via the replica method, providing a rigorous derivation of the $\sqrt{\alpha}$ correction term.
• The result holds uniformly in $N$ as $\alpha \to \infty$, and the remainder term is smaller than the correction term only when $\alpha \gg (2^K)^6$, which is well beyond the $K$-sat phase transition.
• The Parisi formula for the mixed $p$-spin model provides the exact value of $\mathbb{E}M_N$ in the zero-temperature limit, which is known rigorously due to recent advances in spin glass theory.
• The proof demonstrates that the key challenge in extending the result to finite $\alpha$ lies in controlling the multi-overlap terms $Q_{1,\ldots,n}$ in the interpolation, which are conjectured to be continuous functions of the overlaps $R_{\ell,\ell'}$.