A D V E R T |
I S E M E N T |
| Math Sites: lean ages 13-∞ readme referees parents | >>> MAITH GAMES <<< | all 372 compute stand |
|
LEVEL 1 OF 1 · Sharp homogeneous depth-five complexity of matrix products
Homogeneous depth-five lower bounds for iterated matrix multiplication
expertly designed by an internal OpenAI model · released 2026-09-25
· original PDF
IntroductionWe study how many gates are needed to compute iterated matrix multiplication with five homogeneous arithmetic layers. For integers \(w,d\geq 1\), let \(X^{(1)},\ldots,X^{(d)}\) be \(w\times w\) matrices whose entries are distinct commuting variables. Define \[ \operatorname{IMM}_{w,d} =\bigl(X^{(1)}\cdots X^{(d)}\bigr)_{1,1} =\sum_{i_1,\ldots,i_{d-1}\in[w]} x^{(1)}_{1,i_1}x^{(2)}_{i_1,i_2}\cdots x^{(d)}_{i_{d-1},1}. \tag{1}\] For \(d=1\), the expression means \(x^{(1)}_{1,1}\). The first index denotes matrix width and the second denotes degree. We retain all \(dw^2\) matrix-entry variables as ambient variables, including entries absent from the polynomial. Our target is \(\operatorname{IMM}_{n,n}\), of degree \(n\) in \(n^3\) ambient variables. Circuit model and main resultAn arithmetic circuit over a field \(K\) is a finite directed acyclic graph. Its leaves are variables or elements of \(K\). A sum gate computes a \(K\)-linear combination of its inputs, and a product gate computes their product. Fan-in and fan-out are arbitrary and finite. Gates may be shared, and a gate may occur repeatedly among another gate’s inputs; repeated occurrences at a product gate are counted with their multiplicities. Scalar coefficients on sum inputs are part of the circuit and do not require additional gates. A \(\Sigma\Pi\Sigma\Pi\Sigma\) circuit has five computational layers, listed from output to leaves, with respective gate types \(+,\times,+,\times,+\) and a single output gate. Edges between computational gates join consecutive layers, and the bottom sums read leaves. Unary gates are allowed. In particular, no bound is placed on the number of variables in a bottom linear form. The circuit is syntactically homogeneous if it has the following formal-degree assignment: variables have degree \(1\), constants have degree \(0\), product gates add their input degrees with multiplicity, and all inputs of a sum gate have the same degree, which is assigned to that gate. Empty sums and products, if present, compute \(0\) and \(1\) and have formal degree \(0\). Thus a zero polynomial at a gate still carries its assigned formal degree; cancellation does not reset that degree. All computations and equalities below concern formal polynomials. We define size to be the number of vertices, including leaves. The number of computational gates excludes leaves, whereas wire size counts input occurrences. These quantities are not identified: our lower bound is on gates, and the circuit analysis also bounds the number of computational gates alone. Theorem 1. There exist absolute constants \(c>0\) and \(n_0\) such that, for every integer \(n\geq n_0\), every syntactically homogeneous \(\Sigma\Pi\Sigma\Pi\Sigma\) circuit over \(\mathbb C\) computing \(\operatorname{IMM}_{n,n}\) has size at least \[n^{c\sqrt n}.\] One may take \(c=1/400\). The model permits unrestricted bottom fan-in and support, constants, and shared subcircuits. Corollary 9 extends the \(n^{\sqrt n/400}\) lower bound to every field of characteristic zero, with the same absolute threshold. Proposition 10 gives an elementary block construction of size at most \(n^{\sqrt n+4}\) over every field for \(n\geq2\). It is homogeneous of depth four; inserting unary bottom sums makes it depth five, so the lower bound has the matching scale. Iterated matrix multiplication nevertheless has polynomial-size circuits when depth is unrestricted. Historical context and previous boundsIterated matrix multiplication has long served as a test of the cost of restricting arithmetic depth. Its path expansion connects matrix products with reachability, while its polynomial-size unrestricted circuits make it a natural target for lower bounds on weaker circuit models. Nisan and Wigderson used dimensions of partial-derivative spaces to prove lower bounds for homogeneous depth-three circuits and for constant-depth set-multilinear circuits. They asked for an explicit homogeneous polynomial requiring superpolynomial size at constant depth, even at depth five (Nisan and Wigderson 1995, sec. 2.2 of the linked author journal manuscript). Depth reduction gave this program a further motivation. Agrawal and Vinay reduced general arithmetic computation to depth four, and Koiran and Tavenas sharpened the size bounds (Agrawal and Vinay 2008; Koiran 2012; Tavenas 2015). For \(d=N^{O(1)}\), Tavenas’s theorem converts a circuit of size \(N^{O(1)}\) computing a homogeneous degree-\(d\) polynomial in \(N\) variables to a homogeneous depth-four circuit of size \(N^{O(\sqrt d)}\) (Tavenas 2015, Theorem 1 of the linked preprint). This explains the square-root scale in depth-four lower bounds and in the block construction for IMM used here. The progress toward this scale involved several distinct restrictions. Fournier, Limaye, Malod, and Srinivasan proved IMM lower bounds with bounds on both product-layer fan-ins and, separately, for homogeneous multilinear formulas (Fournier et al. 2015, Theorems 16 and 29 of the cited author version). Kayal, Limaye, Saha, and Srinivasan removed the bottom-fan-in restriction for homogeneous depth-four formulas, obtaining an exponential lower bound over characteristic zero for a Nisan–Wigderson design family (Kayal et al. 2014, Theorem 1). Kumar and Saraf proved a \(d^{\Omega(\sqrt d)}\) lower bound for homogeneous depth-four circuits computing \(\operatorname{IMM}_{d^5,d}\), over every field (Kumar and Saraf 2017, Theorem 1.2 and Section 8.2 of the cited preprint). In another direction, Kayal, Saha, and Tavenas obtained \(w^{\Omega(\sqrt d)}\) for syntactically multilinear depth-four circuits computing \(\operatorname{IMM}_{w,d}\), without homogeneity, in the range \(d\geq\log^2 w\), over every field (Kayal et al. 2018, Theorem 1.4 and the following comparison). At depth five, Bera and Chakrabarti proved a lower bound with a restriction on bottom support. Their Theorem 1.1 states that, for every fixed \(0\leq\mu<1/2\), there is an integer \(q=q(\mu)>0\) such that homogeneous \(\Sigma\Pi\Sigma\Pi\Sigma\) circuits computing \(\operatorname{IMM}_{d^q,d}\), with \(N=d^{2q+1}\) ambient variables and bottom fan-in at most \(N^\mu\), require \(N^{\Omega_\mu(\sqrt d)}\) gates over every field (Bera and Chakrabarti 2015, Theorem 1.1). Their precise Theorem 4.2 proves the lower bound for a restricted IMM polynomial, using the number of distinct variables feeding each bottom linear gate as its support parameter (Bera and Chakrabarti 2015, Theorem 4.2). The Kumar–Saraf and Bera–Chakrabarti bounds use different width–degree regimes from \(w=d=n\), and the latter restricts the bottom linear forms. For a different hard family, Kumar and Saptharishi proved, over each fixed finite field \(\mathbb F_q\), \(\exp(\Omega_q(\sqrt d))\) lower bounds for homogeneous depth-five circuits without a bottom-support restriction (Kumar and Saptharishi 2017, Theorem 1). Their family is based on Nisan–Wigderson designs and lies in \(\mathrm{VNP}\). Armand, Behera, and Tavenas have since extended this finite-field approach to depth-five circuits whose top-product fan-in is bounded by a fixed polynomial in the degree \(d\), without homogeneity (Armand et al. 2026, Corollary 1.3). These finite-field theorems concern NW polynomials rather than IMM; both the field hypothesis and the exponential rate differ from those in Theorem 1. Superpolynomial lower bounds for unrestricted-bottom depth-five circuits over characteristic zero were already established by the constant-depth results of Limaye, Srinivasan, and Tavenas (Limaye et al. 2021, 2025). We use the theorem numbering of their ECCC revision 1. Their product-depth convention counts multiplication gates on a path, so our five-layer model has product-depth two. In the low-degree regime \(d\leq(\log w)/100\), their Corollary 3 gives \(w^{\Omega(\sqrt d)}\) for homogeneous product-depth-two circuits over every field (Limaye et al. 2021, Corollary 3). Their general-circuit results also imply superpolynomial lower bounds for \(\operatorname{IMM}_{n,n}\) over \(\mathbb C\) (Limaye et al. 2021, Corollary 4 and the following discussion). Bhargav, Dutta, and Saxena improved the constant-depth exponents in the low-degree regime (Bhargav et al. 2022). Forbes subsequently established low-depth IMM lower bounds over arbitrary fields in the regime \(d=o(\log w)\) (Forbes 2024, Theorem 10). Amireddy, Garg, Kayal, Saha, and Thankey gave a direct shifted-partials approach. For homogeneous product-depth-two formulas they obtain \(2^{-O(d)}w^{\Omega(\sqrt d)}\) when \(w=\omega(d)\), over every field (Amireddy et al. 2023, Theorem 24). The degree-dependent loss and the hypothesis \(w=\omega(d)\) prevent direct substitution of \(w=d=n\). The comparison addressed here is quantitative: we obtain the \(\sqrt n\) exponent in the balanced regime \(w=d=n\) for homogeneous five-layer circuits with unrestricted bottom linear forms. Proof overviewThe proof uses a derivative-based linear-algebraic measure. Dimensions of partial-derivative spaces were used by Nisan and Wigderson (Nisan and Wigderson 1995); shifted partial derivatives were developed in work of Kayal (Kayal 2012) and Gupta, Kamath, Kayal, and Saptharishi (Gupta et al. 2014). We define the operator needed here directly and prove its estimates. Partition the matrix layers into two groups containing \(k\) and \(m\) layers, where \(k+m=n\) and \(m-k\) is of order \(\sqrt n\). Let \(V\) and \(U\) be the corresponding variable sets. For a homogeneous polynomial \(g\) of degree \(n\), let \(g_{[k,m]}\) be the sum of its monomials having degree \(k\) in \(V\) and degree \(m\) in \(U\). Replace its \(V\)-variables by partial derivatives and its \(U\)-variables by multiplication operators. On polynomials of fixed bidegree \((a,b)\) this gives a linear map \[F_g=g_{[k,m]}(\partial_V,U)\] into polynomials of bidegree \((a-k,b+m)\). We choose \(a,b\) of order \(n^{5/2}\), write \(D\) for the dimension of the source, and use \(R(g)=\mathop{\mathrm{rank}}F_g\) as the complexity measure. Differentiation in \(V\) commutes with multiplication in \(U\); the full substitution therefore respects products, while the finite map is linear in \(g\) and its rank is subadditive. Section 2 gives the definitions and parameters. We first bound the rank of a circuit in Section 3. For a product of homogeneous factors, resolve each factor into its possible \(V\)-degrees. Apply first those factors whose \(V\)-degree exceeds their proportional share \(ke/n\) for a factor of degree \(e\). Their composition passes through a smaller intermediate polynomial space, which bounds its rank. The distance of each proportional share from the integers controls the sum over all such decompositions. These are the same integer-degree discrepancies that underlie the residue method of Amireddy, Garg, Kayal, Saha, and Thankey (Amireddy et al. 2022, Definition 2.1 and Lemma 3.1); here they control intermediate homogeneous dimensions. If all factor degrees are small, these distances give the required saving. If some factor has large degree, expand just one such factor into its bottom products of linear forms. This costs at most one additional factor of the circuit size. Proposition 3 gives, for a size-\(S\) circuit, \[R(g)\leq 2S^2D\exp(C\sqrt n)\,n^{-\sqrt n/100}\] with an absolute constant \(C\). The opposite estimate uses the paths in matrix multiplication. Section 4 arranges the two groups of layers in a balanced order, with no adjacent \(V\)-layers. Declare the monomials \(z^M/\sqrt{M!}\) orthonormal, where \(M\) is an exponent vector and \(M!\) is the product of its coordinate factorials. In these bases, differentiation and multiplication have coefficients given by square roots of exponents and their successors. For \(g=\operatorname{IMM}_{n,n}\), the first two trace moments of \(F_g^*F_g\) become weighted counts of paths and quadruples of paths. Exact factorial moments for uniform weak compositions compare these weights with independent geometric random variables. We verify the coefficient signs needed for that comparison. At each layer, a contributing quadruple has one of two pairing patterns. A change of pattern forces four vertex labels to agree and reduces the number of choices by a factor of \(n\). Section 5 sums the resulting weights, treating isolated corrections and the two endpoints explicitly. The balanced order controls the weight accumulated along each run of one pattern. The trace inequality \[\mathop{\mathrm{rank}}H\geq\frac{(\mathop{\mathrm{tr}}H)^2}{\mathop{\mathrm{tr}}(H^2)} \qquad(H\ne0\text{ positive semidefinite})\] then yields \(R(\operatorname{IMM}_{n,n})\geq D\exp(-C'\sqrt n)\), as stated in Proposition 6. Section 6 compares the two rank estimates and proves the field extension and matching upper bound. A rank measure from differentiation and multiplicationWe associate a linear map to a polynomial by differentiating in one group of variables and multiplying in a disjoint group. The rank of this map is subadditive. More importantly, the map associated to a product can be factored through intermediate homogeneous spaces, whose dimensions will control the circuit upper bound. The operator and its homogeneous spacesLet \(K\) be a field, and let \(V,U\) be disjoint finite sets of variables, of cardinalities \(v,u\ge1\). For a variable set \(E\) and an integer \(t\ge0\), write \(\mathcal H_E(t)=K[E]_t\) for the vector space of homogeneous polynomials of degree \(t\). Its dimension is \[h(|E|,t),\qquad h(r,t)=\binom{r+t-1}{t}.\] For \(Q\in K[V,U]\), let \[T_Q=Q(\partial_V,U)\] be the operator on \(K[V,U]\) obtained by replacing each variable in \(V\) by its formal partial derivative and each variable in \(U\) by multiplication by that variable. These operators commute because the two variable sets are disjoint. Thus \(T_{Q_1Q_2}=T_{Q_1}T_{Q_2}\). This identity holds over every field. Fix integers \(k,m\ge0\), \(a\ge k\), and \(b\ge0\). If \(g\) is homogeneous of degree \(k+m\), denote its component of \(V\)-degree \(k\) and \(U\)-degree \(m\) by \(g_{[k,m]}\). Define the finite-dimensional map \[ F_g=g_{[k,m]}(\partial_V,U): \mathcal H_V(a)\otimes\mathcal H_U(b) \longrightarrow \mathcal H_V(a-k)\otimes\mathcal H_U(b+m), \qquad R(g)=\mathop{\mathrm{rank}}F_g. \tag{2}\] The source dimension is \(D=h(v,a)h(u,b)\). Projection to a bidegree and operator substitution are both linear, so \[R(g_1+g_2)\le R(g_1)+R(g_2),\qquad R(cg)=R(g)\quad(c\in K\setminus\{0\}).\] Also \(R(0)=0\). The multiplicative identity for \(T_Q\) does not assert multiplicativity of \(g\mapsto F_g\): the latter includes a fixed bidegree projection. We will first decompose products into their bidegree components and then use multiplicativity of \(T_Q\) on each contribution. Choosing the degreesWe now choose the spaces in (2) for degree-\(n\) polynomials on the \(n\) matrix layers. Throughout the proof \(n\) is sufficiently large, and all implicit constants and thresholds are absolute. Let \(s\) be the largest integer at most \(\sqrt n\) having the same parity as \(n\), and put \[ \begin{gathered} k=\frac{n-s}{2},\qquad m=\frac{n+s}{2},\qquad \rho=\frac{k}{m},\qquad \lambda=\frac{k}{n} =\frac{\rho}{1+\rho},\\ v=kn^2,\qquad u=mn^2,\qquad a=\left\lceil\frac{v}{\sqrt n-1}\right\rceil, \qquad \alpha=\frac{a}{a+v},\\ b=\left\lceil\frac{u\alpha^\rho}{1-\alpha^\rho}\right\rceil, \qquad \beta=\frac{b}{b+u},\qquad q=\alpha^{(1+\rho)/2},\qquad D=h(v,a)h(u,b). \end{gathered} \tag{3}\] For now assign any \(k\) full matrix layers to \(V\) and the other \(m\) layers to \(U\). Each layer retains all its \(n^2\) variables, including variables absent from the endpoint entry of the matrix product. Section 4 will specify their order when bounding the rank of \(\operatorname{IMM}_{n,n}\) from below. The small excess \(m-k=s\) makes the slope \(\lambda\) slightly less than \(1/2\). For small positive even factor degrees \(e\), this moves \(\lambda e\) away from the integers; Section 3 quantifies the resulting rank saving. The definitions of \(a,b\) balance the dimension decrease caused by differentiation against the dimension increase caused by multiplication. Without the ceiling in the definition of \(b\), we would have \(\beta=\alpha^\rho\) and \(\alpha^k\beta^{-m}=1\). We record the rounding estimates explicitly, as their errors must stay small after many factors are combined. Lemma 2. For all sufficiently large \(n\), the parameters in (3) satisfy \[\begin{gather*} \frac{\sqrt n}{2}\le s\le\sqrt n,\qquad \lambda\ge\frac38,\qquad 0<\rho<1,\qquad v,u=\Theta(n^3),\qquad a,b=\Theta(n^{5/2}),\\ a\ge k,\qquad 2n\le\frac12\min(a,b),\qquad n^{-1/2}\le\alpha=n^{-1/2}\exp(O(1/a)),\qquad \alpha^{-1}\le\sqrt n,\\ \alpha^\rho\le\beta\le\alpha^\rho\exp(C/b), \qquad \beta\le\frac2{\sqrt n},\\ q=n^{-1/2}\exp\bigl(O(s\log n/n+1/a)\bigr), \qquad n^{-1/2}\le q\le\frac2{\sqrt n} \le n^{-2/5},\qquad q\le\frac12, \end{gather*}\] where \(C\) is an absolute constant. Proof. The parity choice gives \(\sqrt n-2<s\le\sqrt n\), and hence the claims about \(s,k,m,\lambda,\rho,v,u\). Write \(a_0=v/(\sqrt n-1)\), so that \(a_0\le a<a_0+1\) and \(a_0/(a_0+v)=n^{-1/2}\). The function \(x/(x+v)\) is increasing, and the derivative of its logarithm is \(v/(x(x+v))\le1/x\). The mean value theorem therefore gives \[0\le\log(\alpha n^{1/2})\le\frac1{a_0}=O(1/a).\] In particular \(a=\Theta(n^{5/2})\) and \(\alpha^{-1}\le\sqrt n\). Since \(1-\rho=s/m=O(s/n)\), the preceding estimate implies \[\alpha^\rho =n^{-1/2}\exp\bigl(O(s\log n/n+1/a)\bigr) =n^{-1/2}(1+o(1)).\] Put \(b_0=u\alpha^\rho/(1-\alpha^\rho)\). Then \(b_0=\Theta(n^{5/2})\), \(b_0\le b<b_0+1\), and \(b_0/(b_0+u)=\alpha^\rho\). Applying the same logarithmic derivative bound with \(u\) in place of \(v\) gives \[0\le\log(\beta/\alpha^\rho)\le1/b_0\le C/b.\] This proves the assertions about \(b,\beta\), including \(\beta\le2/\sqrt n\) eventually. The growth of \(a,b\) also gives \(a\ge k\) and \(2n\le\min(a,b)/2\). Finally, \[\log q=-\frac{1+\rho}{4}\log n+O(1/a) =-\frac12\log n+O(s\log n/n+1/a).\] Because \(0<\alpha<1\) and \((1+\rho)/2\le1\), we have \(q\ge\alpha\ge n^{-1/2}\). The remaining upper bounds follow from the last display and \(s\log n/n\to0\). ◻ The estimate \(q\le n^{-2/5}\) will suffice for the main power savings. The sharper \(q=O(n^{-1/2})\) will be essential when summing the smaller errors contributed by even factor degrees. The rank of a homogeneous depth-five circuitWe now bound the rank measure in terms of circuit size. The argument is uniform over the choice of the \(k\) matrix layers assigned to \(V\). Its first step bounds the rank of a product using only the degrees of its factors. We then expand one middle-layer sum when its degree is large, exposing its lower products of linear forms. Proposition 3. There are absolute constants \(C>0\) and \(n_0\) with the following property. For \(n\ge n_0\), use the parameters in (3) and any partition of the matrix layers with \(k\) layers in \(V\) and \(m\) layers in \(U\). Let \(K\) be a field, and let \(g\in K[V,U]\) be a homogeneous degree-\(n\) polynomial computed by a syntactically homogeneous \(\Sigma\Pi\Sigma\Pi\Sigma\) circuit of size \(S\). Then \[R(g)\le 2S^2D\exp(C\sqrt n)\,n^{-\sqrt n/100}.\] All thresholds in this section are absorbed into a single absolute \(n_0\), independent of the field, the circuit, and the partition. Only the parameter estimates of Lemma 2 will be used. Products and intermediate dimensionsFor a positive integer \(e\), define \[H_e=\sum_{i=0}^{e}q^{|i-\lambda e|}.\] These quantities account for all choices of bidegree in a product. The quantities \(H_e\) use the same integer-degree discrepancies as the residue method of Amireddy, Garg, Kayal, Saha, and Thankey (Amireddy et al. 2022, Definition 2.1 and Lemma 3.1). In the present argument they control the dimensions of the intermediate homogeneous spaces through which the differentiation–multiplication operator factors. Lemma 4. Let \(K\) be a field, and let \(Q_1,\ldots,Q_r\in K[V,U]\) be homogeneous of respective positive degrees \(e_1,\ldots,e_r\), with \(\sum_{j=1}^r e_j=n\). Then \[R\left(\prod_{j=1}^r Q_j\right) \le 2D\prod_{j=1}^r H_{e_j}.\] Proof. Decompose each factor into its bidegree components. The component of their product that defines the rank measure is \[\left(\prod_{j=1}^r Q_j\right)_{[k,m]} =\sum_{\substack{0\le i_j\le e_j\ (1\le j\le r)\\ \sum_j i_j=k}} \prod_{j=1}^r (Q_j)_{[i_j,e_j-i_j]}.\] Fix an assignment in this sum, and put \(\delta_j=i_j-\lambda e_j\). Since \(\lambda n=k\), we have \(\sum_j\delta_j=0\). The operators obtained by substituting \(\partial_V\) and \(U\) commute, so we may apply first the factors with \(\delta_j>0\). Write their total bidegree as \[I=\sum_{\delta_j>0}i_j, \qquad J=\sum_{\delta_j>0}(e_j-i_j).\] The resulting intermediate space is \(\mathcal H_V(a-I)\otimes\mathcal H_U(b+J)\). It is well defined because \(I\le k\le a\); also \(J\le m\). Its dimension bounds the rank of this contribution, including when the set of positive discrepancies is empty. The successive ratios of binomial coefficients give \[\begin{align*} \frac{h(v,a-I)}{h(v,a)} &=\prod_{t=0}^{I-1}\frac{a-t}{a+v-1-t} \le\left(\frac{a}{a+v-1}\right)^I,\\ \frac{h(u,b+J)}{h(u,b)} &=\prod_{t=1}^{J}\frac{b+u+t-1}{b+t} \le\left(\frac{b+u}{b}\right)^J =\beta^{-J}. \end{align*}\] The first inequality follows because \(x/(x+v-1)\) is nondecreasing for \(x>0\). Since \(\beta\ge\alpha^\rho\), these inequalities imply \[ \frac{h(v,a-I)h(u,b+J)}{D} \le \alpha^{I-\rho J} \left(1-\frac1{a+v}\right)^{-I} \le 2\alpha^{I-\rho J}. \tag{4}\] The last bound holds uniformly for \(I\le n\), because \(a+v=\Theta(n^3)\). Empty products in the ratio formulas equal 1. Using \(\lambda=\rho/(1+\rho)\) and \(\sum_j\delta_j=0\), we obtain \[I-\rho J =(1+\rho)\sum_{\delta_j>0}\delta_j =\frac{1+\rho}{2}\sum_j|\delta_j|.\] As \(q=\alpha^{(1+\rho)/2}\), the rank of the fixed-assignment contribution is therefore at most \[2D\prod_j q^{|i_j-\lambda e_j|}.\] Rank subadditivity permits summing these bounds. Dropping the constraint \(\sum_j i_j=k\) increases the resulting nonnegative sum and makes it factor as \(2D\prod_jH_{e_j}\). Zero bidegree components contribute rank zero throughout. ◻ The cost of integer degreesThe product estimate is effective because \(\lambda e\) is usually separated from the integers. Small even degrees require particular care: their separation can tend to zero, so a constant loss for each factor would be too large. We bound their combined error instead. Put \[d_e=\mathop{\mathrm{dist}}(\lambda e,\mathbb Z),\qquad t_0=\frac{n}{4s}.\] Lemma 5. For every integer \(e\ge1\), \[ H_e\le q^{d_e}\bigl(1+4q^{1-2d_e}\bigr)\le5. \tag{5}\] If \(1\le e<t_0\), then \[ d_e= \begin{cases} se/(2n),&e\text{ even},\\ 1/2-se/(2n),&e\text{ odd}, \end{cases} \qquad d_e\ge\frac{se}{2n}. \tag{6}\] In this range, odd degrees satisfy \(H_e\le q^{d_e/2}\), whereas even degrees satisfy \[ H_e\le q^{d_e}\exp\bigl(4q^{1-se/n}\bigr). \tag{7}\] There is an absolute constant \(C_1\) such that, for every finite list of positive integers \(e_1,\ldots,e_r\) with \(\sum_j e_j\le n\), \[ \sum_{\substack{j:\ e_j<t_0\\ e_j\text{ even}}} q^{1-se_j/n}\le C_1\sqrt n. \tag{8}\] Proof. Enlarge the sum defining \(H_e\) to all integers. Apart from one nearest integer to \(\lambda e\), the terms have total at most \(2q^{1-d_e}/(1-q)\). This remains valid when the nearest integer is not unique. Since \(q\le1/2\), it gives the first inequality in (5); the second follows from \(0\le d_e\le1/2\) and \(0<q<1\). For \(e<t_0\), write \[\lambda e=\frac e2-\frac{se}{2n}, \qquad 0<\frac{se}{2n}<\frac18.\] The nearest integer is consequently \(e/2\) for even \(e\), and \((e-1)/2\) for odd \(e\). This proves (6). For odd \(e\) we have \(d_e\ge3/8\). By \(q\le n^{-2/5}\), \[q^{-d_e/2}\ge n^{d_e/5}\ge n^{3/40}\ge5\] after increasing \(n_0\). Thus \(H_e\le5q^{d_e}\le q^{d_e/2}\). For even \(e\), substitute \(2d_e=se/n\) in (5) and use \(1+x\le\exp(x)\) to obtain (7). It remains to sum these even-degree errors. Increase \(n_0\) so that \(t_0>2\), and for real \(z\in[2,t_0]\) define \[f(z)=\frac{q^{1-sz/n}}{z}.\] Its logarithm is convex, since \((\log f)''(z)=1/z^2>0\). Hence \(f(z)\le\max\{f(2),f(t_0)\}\). The sharp estimate for \(q\) in Lemma 2 gives \[f(2) =\frac12 n^{-1/2} \exp\bigl(O(s\log n/n+1/a)\bigr) =O(n^{-1/2}).\] At the other endpoint, \(s\le\sqrt n\) and \(q\le2n^{-1/2}\) give \[f(t_0)=\frac{4s}{n}q^{3/4}=O(n^{-7/8}).\] Therefore \(q^{1-se/n}\le C_1e/\sqrt n\) uniformly over the low even degrees. Summing and using \(\sum_j e_j\le n\) proves (8). ◻ These estimates control a product of factors below \(t_0\) regardless of their coefficients. A factor of degree at least \(t_0\) will instead supply many linear factors through its bottom-layer expansion. From gates to productsProof of Proposition 3. If \(g=0\), the conclusion is immediate. Otherwise its formal output degree is \(n\): induction on the gates shows that every nonzero polynomial at a formally homogeneous degree-\(d\) gate is homogeneous of degree \(d\). We first record exactly what the circuit layers provide. A bottom sum gate computes either a homogeneous linear form or a scalar, because all its leaf inputs have the same formal degree. A lower product of formal degree \(e>0\) therefore computes a scalar times a product of exactly \(e\) homogeneous linear-form occurrences. Degree-zero factors are absorbed into that scalar. A zero factor makes the whole product zero and its contribution can be discarded. A gate computing zero need not be assigned a different formal degree. At either a middle sum or the output sum, repeated wires from the same predecessor gate can be combined by adding their scalar coefficients. There are at most \(S\) distinct predecessors. Thus \(g\) is a sum of at most \(S\) scalar multiples of products \[ G=\prod_{j=1}^{r}Q_j, \qquad \deg Q_j=e_j\ge1,\qquad \sum_j e_j=n, \tag{9}\] and each \(Q_j\) is a sum of at most \(S\) scalar multiples of products of \(e_j\) homogeneous linear forms. Zero upper terms have been discarded, and degree-zero factors in the remaining terms have been absorbed into their coefficients. If empty sums or products are allowed, they contribute only zero or a scalar and are handled in the same way. In (9), inputs to a product are counted with multiplicity: repeated use of a gate gives repeated factors. Their positive degrees add to \(n\), so \(r\le n\). Shared subcircuits do not affect the bounds on the number of distinct additive predecessors. In particular, this description does not charge for wires or impose any restriction on the support of a linear form. Suppose first that every \(e_j<t_0\). By (6), \[\sum_j d_{e_j}\ge\frac{s}{2n}\sum_j e_j=\frac s2.\] Apply Lemmas 4 and 5, weakening \(q^{d_{e_j}}\) to \(q^{d_{e_j}/2}\) for even degrees. The combined even-degree correction is at most \(\exp(4C_1\sqrt n)\). Consequently \[ R(G)\le2D\exp(4C_1\sqrt n)q^{s/4} \le2D\exp(4C_1\sqrt n)n^{-\sqrt n/20}, \tag{10}\] where we used \(q\le n^{-2/5}\) and \(s\ge\sqrt n/2\). Now suppose that one factor occurrence has degree \(e\ge t_0\). Expand that occurrence, using its middle sum, into at most \(S\) products of \(e\) homogeneous linear forms. All other factors remain unexpanded. This includes any other occurrences of the same gate: expanding one occurrence in \(Q^h\) leaves its other \(h-1\) occurrences unexpanded. In each resulting product, the \(e\) newly supplied linear factors contribute \(H_1^e\le q^{\lambda e/2}\) to the estimate of Lemma 4, because \(d_1=\lambda\) and \(1<t_0\). There are at most \(n/t_0=4s\) remaining factor occurrences of degree at least \(t_0\), and their \(H\)-factors are at most 5 each. The remaining low odd degrees contribute at most 1. The remaining low even degrees contribute at most \(\exp(4C_1\sqrt n)\) after their favorable powers of \(q\) are dropped. Rank subadditivity over the expansion therefore yields \[\begin{align*} R(G) &\le2SD\,5^{4s}\exp(4C_1\sqrt n)q^{\lambda t_0/2}\\ &\le2SD\,5^{4s}\exp(4C_1\sqrt n)n^{-3\sqrt n/160}. \tag{11}\end{align*}\] For the last step, \(q\le n^{-2/5}\) and \(\lambda\ge3/8\), \(t_0\ge\sqrt n/4\) imply \(\lambda t_0/5\ge3\sqrt n/160\). Since \(5^{4s}\le\exp(4\log(5)\sqrt n)\), both (10) and [eq:one-high-product] are at most \[2SD\exp(C\sqrt n)n^{-\sqrt n/100}\] for an absolute \(C\). Multiplication by a nonzero scalar leaves rank unchanged, and multiplication by zero gives rank zero. Summing the at most \(S\) upper-product contributions proves the proposition. ◻ Trace moments for iterated matrix multiplicationWe now choose the partition of the layers and prove that its mixed operator has large rank on iterated matrix multiplication. The parameters remain those of (3). Arrange the groups along the matrix product in the order \[ VU^{\ell_1}\,VU^{\ell_2}\cdots VU^{\ell_k}, \qquad \ell_i=1+\left\lfloor\frac{is}{k}\right\rfloor -\left\lfloor\frac{(i-1)s}{k}\right\rfloor. \tag{12}\] For sufficiently large \(n\) we have \(0<s/k<1\), so each \(\ell_i\) is either one or two. Their sum is \(k+s=m\). Thus this word has exactly \(k\) layers in \(V\) and \(m\) in \(U\), and no two \(V\) layers are adjacent. Every layer contributes all its \(n^2\) variables to its group, including the variables of the first and last matrices that do not occur in the \((1,1)\) entry. Put \(f=\operatorname{IMM}_{n,n}\) and \(L=n-1\). A path \(P\) is a sequence \((p_0,\ldots,p_n)\) with \(p_0=p_n=1\) and \(p_1,\ldots,p_{n-1}\in[n]\). Its coordinate in layer \(t\) is \[E_t(P)=x^{(t)}_{p_{t-1},p_t}.\] There are \(n^L\) paths, and \(f\) is the sum of the products of their layer coordinates. In particular, \(f\) has bidegree \((k,m)\), so its finite map \(F_f\) is the restriction of the full operator \(T_f=f(\partial_V,U)\) to \(\mathcal H_V(a)\otimes\mathcal H_U(b)\). Proposition 6. Over \(\mathbb C\), for the partition (12), there is an absolute constant \(C\) such that, for all sufficiently large \(n\), \[R(\operatorname{IMM}_{n,n})\ge D\exp(-C\sqrt n).\] The proof uses two trace moments. Give every homogeneous polynomial space the inner product in which \[\frac{z^M}{\sqrt{M!}},\qquad |M|=t, \qquad M!=\prod_i M_i!,\] is an orthonormal basis. This is the finite homogeneous part of the Bargmann–Fock polynomial normalization (Bargmann 1962). Use the tensor product of these inner products for the domain and codomain of \(F_f\), and write \[T=\mathop{\mathrm{tr}}(F_f^*F_f),\qquad T_2=\mathop{\mathrm{tr}}\bigl((F_f^*F_f)^2\bigr).\] If \(T>0\), Cauchy–Schwarz applied to the nonzero eigenvalues of \(F_f^*F_f\) gives \[ R(f)\ge \frac{T^2}{T_2}. \tag{13}\] Define \[A=\frac av,\qquad B=\frac bu,\qquad \mu=A^k(1+B)^m.\] We will prove the bounds \[T\ge Dn^L\mu\exp(-O(n^{-1/2})),\qquad T_2\le Dn^{2L}\mu^2\exp(O(\sqrt n)).\] This section reduces the second bound to a sum over two-letter words; the next section bounds that sum and completes Proposition 6. Occupation momentsA uniformly chosen basis vector of \(\mathcal H_V(a)\otimes\mathcal H_U(b)\) has two independent exponent vectors: one is uniform among weak compositions of \(a\) into \(v\) parts, and the other among weak compositions of \(b\) into \(u\) parts. We compare their moments with those of independent geometric variables. For an integer \(d\ge0\), write \[(z)_d=z(z-1)\cdots(z-d+1),\qquad r^{\overline d}=r(r+1)\cdots(r+d-1),\] with both empty products equal to one. Lemma 7. Let \(M=(M_1,\ldots,M_r)\) be uniform among the weak compositions of an integer \(t\ge0\) into \(r\ge1\) parts. For integers \(d_i\ge0\) and \(H=\sum_i d_i\), \[ \mathbb E\prod_i(M_i)_{d_i} =\frac{(t)_H}{r^{\overline H}}\prod_i d_i!. \tag{14}\] The right side is zero when \(H>t\). Let \(Z_1,\ldots,Z_r\) be independent geometric variables on the nonnegative integers with mean \(G=t/r\). If a polynomial \(P\) has nonnegative coefficients in the basis \(\{\prod_i(z_i)_{d_i}\}\), then \[ \mathbb E P(M)\le\mathbb E P(Z). \tag{15}\] If \(t>0\) and all terms of that expansion have total order at most \(H_0\le t/2\), then also \[ \mathbb E P(M) \ge \exp\left(-\frac{H_0^2}{t}-\frac{H_0^2}{2r}\right) \mathbb E P(Z). \tag{16}\] Proof. For \(d\ge0\), \[\sum_{j\ge0}(j)_d y^j=\frac{d!y^d}{(1-y)^{d+1}}.\] If \(H\le t\), coefficient extraction therefore gives \[\sum_{|M|=t}\prod_i(M_i)_{d_i} =\left(\prod_i d_i!\right) \binom{t+r-1}{t-H}.\] Divide by \(\binom{t+r-1}{t}\) to obtain (14). If \(H>t\), every composition has \(M_i<d_i\) for some \(i\), so every summand is zero, as is \((t)_H\). For \(G>0\), the geometric law is \[\Pr(Z_i=j)=\frac1{1+G}\left(\frac{G}{1+G}\right)^j \quad(j\ge0),\] and its factorial moment is \(\mathbb E(Z_i)_d=d!G^d\). For \(H\le t\) the ratio of the moment in (14) to the corresponding independent geometric moment is \[ \prod_{j=0}^{H-1}\frac{1-j/t}{1+j/r}. \tag{17}\] It is at most one. For \(H>t\) the composition moment is zero, so the same upper comparison holds. When \(H\le H_0\le t/2\), the inequalities \(\log(1-x)\ge-2x\) for \(0\le x\le1/2\) and \(\log(1+x)\le x\) for \(x\ge0\) show that the logarithm of (17) is at least \[-\sum_{j=0}^{H-1}\left(\frac{2j}{t}+\frac{j}{r}\right) \ge -\frac{H_0^2}{t}-\frac{H_0^2}{2r}.\] Sum these comparisons with the nonnegative coefficients of \(P\). If \(t=0\), both \(M\) and the geometric vector of mean zero are identically zero, giving (15) directly. ◻ The comparison is termwise and does not assert independence of the coordinates of \(M\). We apply it separately in the two groups. By Lemma 2, total orders at most \(2n\) satisfy the lower-bound hypothesis, and their combined logarithmic loss is \[ O\left(\frac{n^2}{a}+\frac{n^2}{v} +\frac{n^2}{b}+\frac{n^2}{u}\right) =O(n^{-1/2}). \tag{18}\] The first traceIn the chosen orthonormal bases, differentiation and multiplication act by \[\partial_i\frac{z^M}{\sqrt{M!}} =\sqrt{M_i}\frac{z^{M-\mathbf e_i}}{\sqrt{(M-\mathbf e_i)!}}, \qquad z_i\frac{z^M}{\sqrt{M!}} =\sqrt{M_i+1}\frac{z^{M+\mathbf e_i}}{\sqrt{(M+\mathbf e_i)!}}.\] The derivative is zero when \(M_i=0\); its displayed expression is used only when \(M_i\ge1\). Here \(\mathbf e_i\) is the coordinate unit vector. In particular, repeated differentiation of order \(d\) has coefficient \(\sqrt{(M_i)_d}\), with no additional factorial divisor. Index a domain basis vector by the combined exponent vector \(M\) on \(V\cup U\), with totals \(a\) and \(b\) in the two groups. The summand of \(F_f\) corresponding to a path \(P\) shifts this vector by \[\epsilon_P =-\sum_{t:\,V}\mathbf e_{E_t(P)} +\sum_{t:\,U}\mathbf e_{E_t(P)}\] with coefficient \[ c_P(M) =\left( \prod_{t:\,V}M_{E_t(P)} \prod_{t:\,U}(M_{E_t(P)}+1) \right)^{1/2}. \tag{19}\] A shift requiring a negative occupation contributes zero. We extend the coefficient notation by zero to invalid input indices as well. Different layers have disjoint coordinates, so a path never repeats a coordinate. Moreover, the shifts \(\epsilon_P\) are distinct: a shift specifies the coordinate in every layer and hence every vertex of \(P\). Consequently different paths from the same input reach different output indices. Summing the squared entries of \(F_f\) gives the exact identity \[T=D\sum_P\mathbb E\left[ \prod_{t:\,V}M_{E_t(P)} \prod_{t:\,U}(M_{E_t(P)}+1) \right],\] where the expectation is over the uniform domain indices. Every polynomial inside this expectation has nonnegative falling-factorial coefficients. Under independent geometric occupations of means \(A\) and \(B\), its expectation is \(\mu\). Lemma 7 and (18) therefore imply \[ T\ge Dn^L\mu\exp(-O(n^{-1/2}))>0. \tag{20}\] The inactive endpoint coordinates are included in the uniform compositions and in \(v,u\) throughout; they introduce no additional factor into this calculation. Four paths in the second traceThe matrix entries of \(F_f\) in these bases are real and nonnegative. An entry of \(F_f^*F_f\) indexed by \(M,M'\) is the sum of \(c_P(M)c_Q(M')\) over pairs of paths satisfying \(M+\epsilon_P=M'+\epsilon_Q\). Squaring its entries and summing yields \[ \begin{split} T_2 &=D\,\mathbb E_M \sum_{\substack{P,Q,R,S:\ \epsilon_P-\epsilon_Q=\epsilon_R-\epsilon_S}} c_P(M)c_Q(M')c_R(M)c_S(M'),\\[-2pt] &\hspace{34mm} M'=M+\epsilon_P-\epsilon_Q. \end{split} \tag{21}\] The zero convention handles invalid indices. There is no additional sum over \(M'\), because \(M,P,Q\) determine it. The condition on four paths holds separately in each layer. Denoting their four coordinates in that layer by \(p,q,r,s\), respectively, it is \(\mathbf e_p-\mathbf e_q=\mathbf e_r-\mathbf e_s\). If this difference is zero, then \(p=q\) and \(r=s\). Otherwise its positive and negative coordinates force \(p=r\) and \(q=s\), with \(p\ne q\). Thus there are exactly two types: \[\begin{array}{c|l} \mathcal N & p=q=i,\quad r=s=j,\\ \mathcal D & p=r=i,\quad q=s=j,\quad i\ne j. \end{array}\] The all-equal case belongs to \(\mathcal N\). For each compatible quadruple, the four-coefficient product in (21) is a product over layers of the following polynomials: \[ \begin{array}{c|cc} &\mathcal N&\mathcal D\\ \hline V&M_iM_j&M_i(M_j+1)\\ U&(M_i+1)(M_j+1)&(M_i+1)M_j. \end{array} \tag{22}\] Indeed, the shift from \(M\) to \(M'\) is zero in type \(\mathcal N\). In a \(V\) layer of type \(\mathcal D\) it is \(-\mathbf e_i+\mathbf e_j\), so the two coefficients at \(M\) contribute \(M_i\) and the two at \(M'\) contribute \(M_j+1\). In a \(U\) layer of type \(\mathcal D\) the shift is \(\mathbf e_i-\mathbf e_j\), giving \((M_i+1)M_j\) instead. These polynomial formulas also account for invalid indices. In type \(\mathcal D\), a negative coordinate of \(M'\) requires \(M_i=0\) in a \(V\) layer or \(M_j=0\) in a \(U\) layer, and the corresponding table entry vanishes. In type \(\mathcal N\), an unavailable derivative makes \(M_iM_j\) zero. Since different layers use distinct coordinates, these exhaust the possible failures. Thus the product in (22) equals the zero-extended contribution. When \(i=j\) in type \(\mathcal N\), the required expansions are \[z^2=(z)_2+(z)_1, \qquad (z+1)^2=(z)_2+3(z)_1+1.\] All other table entries are products of \((z)_1\) and \((z)_1+1\) on distinct coordinates. Hence every product of local entries has nonnegative falling-factorial coefficients, with order at most \(2k\) in \(V\) and \(2m\) in \(U\). Lemma 7 bounds its expectation by the expectation for independent geometric occupations. For a geometric variable \(Z\) of mean \(G\), \(\mathbb EZ^2=2G^2+G\) and \(\mathbb E(Z+1)^2=2G^2+3G+1\). Dividing the geometric expectations in each \(V\) layer by \(A^2\) and in each \(U\) layer by \((1+B)^2\), we obtain \[ \begin{array}{c|cc} &\mathcal N&\mathcal D\\ \hline V&1+\alpha^{-1}\mathbf1_{\{i=j\}}&\alpha^{-1}\\ U&1+\beta\mathbf1_{\{i=j\}}&\beta. \end{array} \tag{23}\] Here \((A+1)/A=\alpha^{-1}\) and \(B/(B+1)=\beta\). For example, the repeated-coordinate \(V\) entry is \((2A^2+A)/A^2=1+\alpha^{-1}\), so the repeated factorial contribution has been retained. The product of the normalizing factors over all layers is \(\mu^2\). A sum over pairing typesAssign to a compatible quadruple its type word \(\tau\in\{\mathcal N,\mathcal D\}^n\). For each such word, enlarge its class of quadruples by dropping the inequalities \(i\ne j\) at all \(\mathcal D\) layers. Keep their weights equal to \(\alpha^{-1}\) and \(\beta\) as in (23). These are assigned weights on the newly admitted tuples, not their geometric occupation moments. Every original tuple retains its weight, and every new weight is nonnegative, so this enlargement gives an upper bound. Equality of matrix-entry coordinates equates the path labels at both ends of that layer. The relaxed equalities can therefore be counted independently at every internal vertex. A layer of type \(\mathcal N\) pairs the paths as \(\{P,Q\},\{R,S\}\), while a layer of type \(\mathcal D\) pairs them as \(\{P,R\},\{Q,S\}\). At a vertex between layers of the same type, there are two free labels in \([n]\). At a vertex between different types the two pairings together identify all four labels, leaving one free label. These give \(n^2\) and \(n\) choices, respectively, as illustrated in Figure 1. The two external vertex labels are fixed to \(1\). Every independent choice at the internal vertices gives four paths, because all matrix entries are available, and every relaxed quadruple arises uniquely this way. The set of assignments is therefore a Cartesian product over internal vertices. If \[w(\tau)=\#\{t\in\{1,\ldots,n-1\}:\tau_t\ne\tau_{t+1}\},\] the number of assignments is exactly \(n^{2L-w(\tau)}\). For a layer \(t\) of type \(\mathcal N\), let \(h_t\) be the number of its end vertices that are internal and lie between two layers of type \(\mathcal N\). At each of these vertices the two free labels are independent and uniform in \([n]\), so they agree with probability \(1/n\). At an external vertex or an interface between different types the labels already agree. Consequently the two coordinates \(i,j\) of this \(\mathcal N\) layer agree with probability \(n^{-h_t}\). The end-vertex sets of different \(V\) layers are disjoint, because no two \(V\) layers are adjacent in (12). Under the uniform distribution on the Cartesian product of relaxed vertex assignments, the equality events just described are therefore independent for the \(\mathcal N\) layers in \(V\). Their average weight is \[\prod_{t:\,\tau_t=\mathcal N,\ t\text{ in }V} (1+\alpha^{-1}n^{-h_t}).\] For each \(\mathcal N\) layer in \(U\) we instead bound its weight pointwise by \(1+\beta\), so no independence assertion for these layers is needed. Write \(d_V(\tau)\) and \(d_U(\tau)\) for the numbers of \(\mathcal D\) layers in \(V\) and \(U\), respectively, and put \(N_V(\tau)=\{t:t\text{ is in }V,\ \tau_t=\mathcal N\}\). Combining the occupation comparison, the relaxed assignment count, and the preceding weight estimates proves \[ \frac{T_2}{Dn^{2L}\mu^2} \le (1+\beta)^m \sum_{\tau\in\{\mathcal N,\mathcal D\}^n} n^{-w(\tau)}\alpha^{-d_V(\tau)}\beta^{d_U(\tau)} \prod_{t\in N_V(\tau)} (1+\alpha^{-1}n^{-h_t}). \tag{24}\] Since \(\beta\le2/\sqrt n\), the factor \((1+\beta)^m\) is \(\exp(O(\sqrt n))\). It remains to prove the same bound for the word sum in (24). Lemma 8 establishes this using the spacing of the \(V\) layers and the balanced schedule. Bounding the path-type sumWe now bound the sum in (24). The coincidence factor at an interior \(V\) layer can be large only when both neighboring layers have the opposite type. Removing these isolated positions and bounding the endpoint factors will leave a sum controlled by the number of runs of \(\mathcal D\) layers. Lemma 8. For all sufficiently large \(n\), use the layer schedule (12) and the parameters \(\alpha,\beta,\rho\) of (3). For a word \(\tau\in\{\mathcal N,\mathcal D\}^n\), let \(w(\tau)\) be its number of switches, let \(d_V(\tau),d_U(\tau)\) count its \(\mathcal D\) positions in the respective variable groups, and let \(N_V(\tau)\) be its set of \(\mathcal N\) positions in group \(V\). For \(t\in N_V(\tau)\), let \(h_t\) be the number of internal vertices adjacent to layer \(t\) whose two incident layers both have type \(\mathcal N\). There is an absolute constant \(C\) such that \[ \sum_{\tau\in\{\mathcal N,\mathcal D\}^n} n^{-w(\tau)}\alpha^{-d_V(\tau)}\beta^{d_U(\tau)} \prod_{t\in N_V(\tau)}\bigl(1+\alpha^{-1}n^{-h_t}\bigr) \le \exp(C\sqrt n). \tag{25}\] Proof. Denote the summand on the left of (25) by \(W(\tau)\). Call a position isolated if it is an interior \(V\) layer with type \(\mathcal N\) and both its neighbors have type \(\mathcal D\). Change every isolated position to type \(\mathcal D\), obtaining a word \(F(\tau)\). No two \(V\) layers are adjacent, so none of their neighbors is changed. It follows that \(F(\tau)\) has no isolated position, and the values of \(h_t\) at its remaining \(\mathcal N_V\) positions are unchanged. Each changed position has \(h_t=0\) before the change. Its two incident switches disappear, its factor \(1+\alpha^{-1}\) disappears, and a factor \(\alpha^{-1}\) is introduced. Switches removed at distinct positions are distinct, even when those positions are separated by only one \(U\) layer. Thus, if \(j\) positions were changed, \[ \frac{W(\tau)}{W(F(\tau))} =\left(\frac{1+\alpha}{n^2}\right)^j. \tag{26}\] The preimages can be counted exactly. For a word \(y\) with no isolated position, let \(E(y)\) be the set of interior \(V\) positions whose type and both neighboring types are \(\mathcal D\). Its preimages are obtained by changing an arbitrary subset of \(E(y)\) to \(\mathcal N\). These positions are nonadjacent, their neighbors remain unchanged, and the operation creates precisely the isolated positions that are changed back by \(F\). Consequently \[\sum_{\tau:F(\tau)=y}W(\tau) =W(y)\left(1+\frac{1+\alpha}{n^2}\right)^{|E(y)|} \le W(y)(1+2/n^2)^k,\] where \(0<\alpha<1\) and \(|E(y)|\le k\) were used. In a word with no isolated position, every interior \(\mathcal N_V\) position has \(h_t\ge1\). An endpoint position can have \(h_t=0\); there is at most one endpoint \(V\) layer, since the schedule starts with \(V\) and ends with \(U\). Hence \[ \sum_\tau W(\tau) \le (1+2/n^2)^k(1+\alpha^{-1}) (1+\alpha^{-1}/n)^k Z, \qquad Z=\sum_\tau n^{-w(\tau)} \alpha^{-d_V(\tau)}\beta^{d_U(\tau)}. \tag{27}\] Here we enlarged the final sum from words without isolated positions to all words. By Lemma 2, \(\alpha^{-1}\le\sqrt n\) and \(k\le n/2\), so the logarithm of the prefactor is at most \[\frac{2k}{n^2}+\log(1+\sqrt n)+\frac{k}{\sqrt n} =O(\sqrt n).\] It remains to bound \(Z\). A run of \(\mathcal D\) positions is a maximal nonempty interval of such positions. Each interior run has two switches, contributing \(n^{-2}\), whereas a run meeting exactly one endpoint has one switch. We will show that the product of layer weights on every run is at most \(n\) times a rounding factor. Thus the switch costs leave a factor \(n^{-1}\) for every interior run. The relation between \(\alpha\) and \(\beta\) reduces the layer weight to a discrepancy between the two layer counts. For an interval \(I\) of consecutive layers, define \[d(I)=\#\{V\text{ layers in }I\} -\rho\,\#\{U\text{ layers in }I\}.\] We claim that \[ d(I)\le1+\rho \quad\text{for every interval }I, \qquad d([n])=0. \tag{28}\] Indeed, \(r\) consecutive complete chunks of the schedule, starting after chunk \(j\), contain \(r\) layers in \(V\) and \(r+E\) layers in \(U\), where \[E=\left\lfloor\frac{(j+r)s}{k}\right\rfloor -\left\lfloor\frac{js}{k}\right\rfloor, \qquad |E-rs/k|<1.\] Using \(m=k+s\) and \(\rho=k/m\), their discrepancy is \[r-\rho(r+E)=\rho(rs/k-E)<\rho.\] An interval spanning several chunks consists of consecutive complete chunks, possibly preceded by a proper terminal part of one chunk and followed by a proper initial part of another. The terminal part contains only \(U\) layers and has nonpositive discrepancy; the initial part contains at most one \(V\) layer and has discrepancy at most \(1\). An interval contained in a single chunk also has discrepancy at most \(1\). This proves the first assertion of (28). The second is the identity \(k-\rho m=0\). By Lemma 2, the product of layer weights on a \(\mathcal D\) run \(I\) is at most \[\alpha^{-\#V(I)}\beta^{\#U(I)} \le \alpha^{-d(I)}\exp(C\#U(I)/b) \le n\exp(C\#U(I)/b).\] For the last inequality, the sign of \(d(I)\) causes no difficulty: \[\alpha^{-d(I)}\le\alpha^{-(1+\rho)} \le n^{(1+\rho)/2}\le n,\] since \(0<\alpha<1\), \(\alpha\ge n^{-1/2}\), and \(\rho<1\). The runs are disjoint, so all their rounding factors together contribute at most \(\exp(Cn/b)\). Consider a mixed word, meaning one containing both types. Let \(r\) be its number of interior \(\mathcal D\) runs and \(e\) its number of \(\mathcal D\) runs meeting an endpoint. A mixed word has no run meeting both endpoints, so \(e\in\{0,1,2\}\) and \[w(\tau)=2r+e.\] There are \(r+e\) runs. Their weight, including the switch factors, is therefore at most \[n^{-(2r+e)}n^{r+e}\exp(Cn/b) =n^{-r}\exp(Cn/b).\] The initial type and the set of switch positions uniquely specify a word. Thus at most \(2\binom{n-1}{2r+e}\) words have given values of \(r,e\). Taking binomial coefficients outside their usual range to be zero, the mixed-word contribution to \(Z\) is at most \[\exp(Cn/b)\sum_{e=0}^2\sum_{r\ge0} 2\binom{n-1}{2r+e}n^{-r} \le 6n^2\exp(\sqrt n+Cn/b).\] To see the last inequality, for each \(e\in\{0,1,2\}\) use \[\sum_{r\ge0}\binom{n-1}{2r+e}n^{-r} \le \sum_{r\ge0}\frac{n^{r+e}}{(2r+e)!} \le n^2\sum_{r\ge0}\frac{(\sqrt n)^{2r}}{(2r)!} \le n^2\exp(\sqrt n).\] The constant word \(\mathcal N^n\) has weight \(1\). The other constant word has weight \[\alpha^{-k}\beta^m \le\alpha^{-k+\rho m}\exp(Cm/b) =\exp(Cm/b).\] It follows that \[Z\le\exp(Cn/b)\bigl(2+6n^2\exp(\sqrt n)\bigr) =\exp(O(\sqrt n)),\] where \(b=\Theta(n^{5/2})\). Combining this with (27) proves the lemma. ◻ Completion of the proof of Proposition 6. Lemma 8, applied to (24), gives \[T_2\le D n^{2L}\mu^2(1+\beta)^m\exp(C\sqrt n) \le D n^{2L}\mu^2\exp(C'\sqrt n),\] because \(\beta\le2/\sqrt n\) and \(m\le n\). By (20), \[T\ge Dn^L\mu\exp(-C''n^{-1/2})>0.\] For the positive semidefinite matrix \(H=F_f^*F_f\), the Cauchy–Schwarz inequality applied to its nonzero eigenvalues yields \[(\mathop{\mathrm{tr}}H)^2\le\mathop{\mathrm{rank}}(H)\,\mathop{\mathrm{tr}}(H^2).\] Since \(T>0\) and \(\mathop{\mathrm{rank}}(H)=\mathop{\mathrm{rank}}(F_f)=R(f)\), the two moment bounds imply \[R(f)\ge\frac{T^2}{T_2} \ge D\exp(-C'''\sqrt n).\] This is the assertion of Proposition 6. ◻ Completion and consequencesWe compare the two rank bounds for the balanced partition of the matrix layers. We then transfer the resulting lower bound to every field of characteristic zero and give an elementary upper bound of the same order in the exponent. Proof of Theorem 1. Let a syntactically homogeneous \(\Sigma\Pi\Sigma\Pi\Sigma\) circuit over \(\mathbb C\) of size \(S\) compute \(f=\operatorname{IMM}_{n,n}\). Use the partition from Proposition 6. For all sufficiently large \(n\), Propositions 6 and 3 give absolute constants \(C_1,C_2>0\) such that \[D\exp(-C_1\sqrt n) \le R(f) \le 2S^2D\exp(C_2\sqrt n)n^{-\sqrt n/100}.\] Since \(D>0\), cancellation and square roots yield \[S\ge 2^{-1/2} \exp\left(-\frac{C_1+C_2}{2}\sqrt n\right) n^{\sqrt n/200}.\] After increasing the absolute threshold for \(n\), the exponential factor and \(2^{-1/2}\) are absorbed by \(n^{\sqrt n/400}\). Therefore \(S\ge n^{\sqrt n/400}\), as asserted. ◻ The inner products in Proposition 6 were used over \(\mathbb C\), but its conclusion concerns the rank of a matrix defined over the integers. This gives a field-independent consequence. Corollary 9. There is an absolute integer \(n_0\) such that, for every field \(K\) of characteristic zero and every \(n\ge n_0\), every syntactically homogeneous \(\Sigma\Pi\Sigma\Pi\Sigma\) circuit over \(K\) computing \(\operatorname{IMM}_{n,n}\) has at least \(n^{\sqrt n/400}\) gates. Bottom fan-in and bottom support are unrestricted. Proof. Fix \(n\) and the parameters and partition used in Proposition 6. Express \(F_{\operatorname{IMM}_{n,n}}\) in ordinary monomial bases of both its domain and codomain. The coefficients of \(\operatorname{IMM}_{n,n}\) are integers, multiplication has integral matrix entries, and differentiation has integral matrix entries: a repeated derivative acts by a product of falling factorials of nonnegative integers. Consequently this finite matrix has entries in \(\mathbb Z\). Every minor is an integer. Under the natural map \(\mathbb Z\longrightarrow K\), an integer is zero precisely when it was zero in \(\mathbb Z\), because \(K\) has characteristic zero. The same holds over \(\mathbb C\). Thus the largest order of a nonzero minor, and hence the rank, is the same over \(K\) and over \(\mathbb C\). Changing from ordinary monomials to the normalized bases used in the complex moment argument does not change that complex rank. Proposition 6 therefore supplies its lower bound over \(K\). Proposition 3 holds over every field, with the same constants. The preceding comparison proves the corollary with an absolute threshold independent of \(K\). ◻ A direct block construction gives an upper bound of the form \(n^{\sqrt n+O(1)}\). The next count includes variable leaves and permits the computed block entries to be shared. Proposition 10. Let \(K\) be any field and \(n\ge2\). Put \[t=\lceil\sqrt n\rceil, \qquad r=\left\lceil\frac nt\right\rceil.\] There is a syntactically homogeneous \(\Sigma\Pi\Sigma\Pi\Sigma\) circuit over \(K\) computing \(\operatorname{IMM}_{n,n}\) whose number of gates, including leaves, is at most \[ 2n^3+rn^2+rn^{t+1}+n^{r-1}+1 \le n^{\sqrt n+4}. \tag{29}\] Proof. Partition the \(n\) consecutive matrix layers into \(r\) nonempty consecutive blocks, with lengths \(\ell_1,\ldots,\ell_r\le t\). For block \(j\), let \(Y^{(j)}\) be the product of its matrices. An entry \(Y^{(j)}_{a,b}\) is a sum of \(n^{\ell_j-1}\) monomials, one for each choice of the internal indices of that block, and each monomial has degree \(\ell_j\). At the bottom sum layer, use one identity sum gate for each variable, sharing it among all its uses. This requires at most \(n^3\) leaves and \(n^3\) bottom sum gates. For every block and each of its \(n^2\) entries, compute the displayed monomials by lower product gates and add them at a middle sum gate. Thus block \(j\) uses \(n^{\ell_j+1}\) lower product gates and \(n^2\) middle sum gates. When \(\ell_j=1\), the product and sum gates have one input; all five computational layers are still present. Set \(a_0=a_r=1\). Matrix multiplication now gives \[\operatorname{IMM}_{n,n} =\sum_{(a_1,\ldots,a_{r-1})\in[n]^{r-1}} \prod_{j=1}^{r}Y^{(j)}_{a_{j-1},a_j}.\] For \(r=1\) the right-hand side means the single entry \(Y^{(1)}_{1,1}\). Use one upper product gate for each of the \(n^{r-1}\) summands, and one output sum gate. Each block-entry gate is shared by all summands that use it. The upper products have formal degree \(\ell_1+\cdots+\ell_r=n\), and every middle sum adds monomials of its block’s degree. The bottom sums have degree one, so the whole circuit is syntactically homogeneous. Any gates that do not feed the output may be discarded. The gate count is at most \[2n^3+rn^2+\sum_{j=1}^{r}n^{\ell_j+1}+n^{r-1}+1,\] which proves the first bound in (29). For the second, note that \(r\le t\le n\). If \(n\ge3\), then \(t\ge2\) and the first bound is at most \[3n^3+n^{t+2}+n^{t-1}+1 \le 3n^{t+2} \le n^{t+3} \le n^{\sqrt n+4}.\] Here \(3n^3\le n^{t+2}\) and \(n^{t-1}+1\le n^{t+2}\) justify the middle estimate. For \(n=2\), the first bound is \(30\le2^5\) and \(t=2\), giving the same conclusion. ◻
Agrawal, Manindra, and V. Vinay. 2008. Arithmetic Circuits: A Chasm at Depth Four. Nos. TR08-062. Electronic Colloquium on Computational Complexity. https://eccc.weizmann.ac.il/report/2008/062/.
Amireddy, Prashanth, Ankit Garg, Neeraj Kayal, Chandan Saha, and Bhargav Thankey. 2022. Low-Depth Arithmetic Circuit Lower Bounds via Shifted Partials. https://arxiv.org/abs/2211.07691v1.
Amireddy, Prashanth, Ankit Garg, Neeraj Kayal, Chandan Saha, and Bhargav Thankey. 2023. “Low-Depth Arithmetic Circuit Lower Bounds: Bypassing Set-Multilinearization.” 50th International Colloquium on Automata, Languages, and Programming (ICALP 2023), Leibniz international proceedings in informatics, vol. 261: 12:1–20. https://doi.org/10.4230/LIPIcs.ICALP.2023.12.
Armand, Jules, Amik Raj Behera, and Sébastien Tavenas. 2026. Lower Bounds for Depth-5 Algebraic Circuits with Bounded Fan-in of Top Product Gates. Nos. TR26-104. Electronic Colloquium on Computational Complexity. https://eccc.weizmann.ac.il/report/2026/104/.
Bargmann, V. 1962. “Remarks on a Hilbert Space of Analytic Functions.” Proceedings of the National Academy of Sciences of the United States of America 48 (2): 199–204. https://doi.org/10.1073/pnas.48.2.199.
Bera, Suman K., and Amit Chakrabarti. 2015. “A Depth-Five Lower Bound for Iterated Matrix Multiplication.” In 30th Conference on Computational Complexity (CCC 2015), edited by David Zuckerman, vol. 33. Leibniz International Proceedings in Informatics. Schloss Dagstuhl – Leibniz-Zentrum für Informatik. https://doi.org/10.4230/LIPIcs.CCC.2015.183.
Bhargav, C. S., Sagnik Dutta, and Nitin Saxena. 2022. “Improved Lower Bound, and Proof Barrier, for Constant Depth Algebraic Circuits.” 47th International Symposium on Mathematical Foundations of Computer Science (MFCS 2022), Leibniz international proceedings in informatics, vol. 241: 18:1–16. https://doi.org/10.4230/LIPIcs.MFCS.2022.18.
Forbes, Michael A. 2024. “Low-Depth Algebraic Circuit Lower Bounds over Any Field.” 39th Computational Complexity Conference (CCC 2024), Leibniz international proceedings in informatics, vol. 300: 31:1–16. https://doi.org/10.4230/LIPIcs.CCC.2024.31.
Fournier, Hervé, Nutan Limaye, Guillaume Malod, and Srikanth Srinivasan. 2015. “Lower Bounds for Depth 4 Formulas Computing Iterated Matrix Multiplication.” SIAM Journal on Computing 44 (5): 1173–201. https://doi.org/10.1137/140990280.
Gupta, Ankit, Pritish Kamath, Neeraj Kayal, and Ramprasad Saptharishi. 2014. “Approaching the Chasm at Depth Four.” Journal of the ACM 61 (6): 33:1–16. https://doi.org/10.1145/2629541.
Kayal, Neeraj. 2012. An Exponential Lower Bound for the Sum of Powers of Bounded Degree Polynomials. Nos. TR12-081. Electronic Colloquium on Computational Complexity. https://eccc.weizmann.ac.il/report/2012/081/revision/1/download/.
Kayal, Neeraj, Nutan Limaye, Chandan Saha, and Srikanth Srinivasan. 2014. An Exponential Lower Bound for Homogeneous Depth Four Arithmetic Formulas. Nos. TR14-005. Electronic Colloquium on Computational Complexity. https://eccc.weizmann.ac.il/report/2014/005/.
Kayal, Neeraj, Chandan Saha, and Sébastien Tavenas. 2018. “On the Size of Homogeneous and of Depth-Four Formulas with Low Individual Degree.” Theory of Computing 14 (16): 1–46. https://doi.org/10.4086/toc.2018.v014a016.
Koiran, Pascal. 2012. “Arithmetic Circuits: The Chasm at Depth Four Gets Wider.” Theoretical Computer Science 448: 56–65. https://doi.org/10.1016/j.tcs.2012.03.041.
Kumar, Mrinal, and Ramprasad Saptharishi. 2017. “An Exponential Lower Bound for Homogeneous Depth-5 Circuits over Finite Fields.” In 32nd Computational Complexity Conference (CCC 2017), edited by Ryan O’Donnell, vol. 79. Leibniz International Proceedings in Informatics (LIPIcs). Schloss Dagstuhl – Leibniz-Zentrum für Informatik. https://doi.org/10.4230/LIPIcs.CCC.2017.31.
Kumar, Mrinal, and Shubhangi Saraf. 2017. “On the Power of Homogeneous Depth 4 Arithmetic Circuits.” SIAM Journal on Computing 46 (1): 336–87. https://doi.org/10.1137/140999335.
Limaye, Nutan, Srikanth Srinivasan, and Sébastien Tavenas. 2021. Superpolynomial Lower Bounds Against Low-Depth Algebraic Circuits. Nos. TR21-081. Electronic Colloquium on Computational Complexity. https://eccc.weizmann.ac.il/report/2021/081/revision/1/download.
Limaye, Nutan, Srikanth Srinivasan, and Sébastien Tavenas. 2025. “Superpolynomial Lower Bounds Against Low-Depth Algebraic Circuits.” Journal of the ACM 72 (4). https://doi.org/10.1145/3734215.
Nisan, Noam, and Avi Wigderson. 1995. “Lower Bounds on Arithmetic Circuits via Partial Derivatives.” 36th Annual Symposium on Foundations of Computer Science, 16–25. https://www.math.ias.edu/~avi/PUBLICATIONS/MYPAPERS/NW96/final.pdf.
Tavenas, Sébastien. 2015. “Improved Bounds for Reduction to Depth 4 and Depth 3.” Information and Computation 240: 2–11. https://doi.org/10.1016/j.ic.2014.09.004.
|
| ||||||||
|