48 research outputs found
Superpolynomial lower bounds for general homogeneous depth 4 arithmetic circuits
In this paper, we prove superpolynomial lower bounds for the class of
homogeneous depth 4 arithmetic circuits. We give an explicit polynomial in VNP
of degree in variables such that any homogeneous depth 4 arithmetic
circuit computing it must have size .
Our results extend the works of Nisan-Wigderson [NW95] (which showed
superpolynomial lower bounds for homogeneous depth 3 circuits),
Gupta-Kamath-Kayal-Saptharishi and Kayal-Saha-Saptharishi [GKKS13, KSS13]
(which showed superpolynomial lower bounds for homogeneous depth 4 circuits
with bounded bottom fan-in), Kumar-Saraf [KS13a] (which showed superpolynomial
lower bounds for homogeneous depth 4 circuits with bounded top fan-in) and
Raz-Yehudayoff and Fournier-Limaye-Malod-Srinivasan [RY08, FLMS13] (which
showed superpolynomial lower bounds for multilinear depth 4 circuits). Several
of these results in fact showed exponential lower bounds.
The main ingredient in our proof is a new complexity measure of {\it bounded
support} shifted partial derivatives. This measure allows us to prove
exponential lower bounds for homogeneous depth 4 circuits where all the
monomials computed at the bottom layer have {\it bounded support} (but possibly
unbounded degree/fan-in), strengthening the results of Gupta et al and Kayal et
al [GKKS13, KSS13]. This new lower bound combined with a careful "random
restriction" procedure (that transforms general depth 4 homogeneous circuits to
depth 4 circuits with bounded support) gives us our final result
Lower Bounds for Depth Three Arithmetic Circuits with Small Bottom Fanin
Shpilka and Wigderson (CCC 99) had posed the problem of proving exponential lower bounds for (nonhomogeneous) depth three arithmetic circuits with bounded bottom fanin over a field F of characteristic zero. We resolve this problem by proving a N^(Omega(d/t)) lower bound for (nonhomogeneous) depth three arithmetic circuits with bottom fanin at most t computing an explicit N-variate polynomial of degree d over F.
Meanwhile, Nisan and Wigderson (CC 97) had posed the problem of proving superpolynomial lower bounds for homogeneous depth five arithmetic circuits. Over fields of characteristic zero, we show a lower bound of N^(Omega(sqrt(d))) for homogeneous depth five circuits (resp. also for depth three circuits) with bottom fanin at most N^(u), for any fixed u < 1. This resolves the problem posed by Nisan and Wigderson only partially because of the added restriction on the bottom fanin (a general homogeneous depth five circuit has bottom fanin at most N)
Quasi-polynomial Hitting-set for Set-depth-Delta Formulas
We call a depth-4 formula C set-depth-4 if there exists a (unknown) partition
(X_1,...,X_d) of the variable indices [n] that the top product layer respects,
i.e. C(x) = \sum_{i=1}^k \prod_{j=1}^{d} f_{i,j}(x_{X_j}), where f_{i,j} is a
sparse polynomial in F[x_{X_j}]. Extending this definition to any depth - we
call a depth-Delta formula C (consisting of alternating layers of Sigma and Pi
gates, with a Sigma-gate on top) a set-depth-Delta formula if every Pi-layer in
C respects a (unknown) partition on the variables; if Delta is even then the
product gates of the bottom-most Pi-layer are allowed to compute arbitrary
monomials.
In this work, we give a hitting-set generator for set-depth-Delta formulas
(over any field) with running time polynomial in exp(({Delta}^2 log s)^{Delta -
1}), where s is the size bound on the input set-depth-Delta formula. In other
words, we give a quasi-polynomial time blackbox polynomial identity test for
such constant-depth formulas. Previously, the very special case of Delta=3
(also known as set-multilinear depth-3 circuits) had no known sub-exponential
time hitting-set generator. This was declared as an open problem by Shpilka &
Yehudayoff (FnT-TCS 2010); the model being first studied by Nisan & Wigderson
(FOCS 1995). Our work settles this question, not only for depth-3 but, up to
depth epsilon.log s / loglog s, for a fixed constant epsilon < 1.
The technique is to investigate depth-Delta formulas via depth-(Delta-1)
formulas over a Hadamard algebra, after applying a `shift' on the variables. We
propose a new algebraic conjecture about the low-support rank-concentration in
the latter formulas, and manage to prove it in the case of set-depth-Delta
formulas.Comment: 22 page
On the power of homogeneous depth 4 arithmetic circuits
We prove exponential lower bounds on the size of homogeneous depth 4
arithmetic circuits computing an explicit polynomial in . Our results hold
for the {\it Iterated Matrix Multiplication} polynomial - in particular we show
that any homogeneous depth 4 circuit computing the entry in the product
of generic matrices of dimension must have size
.
Our results strengthen previous works in two significant ways.
Our lower bounds hold for a polynomial in . Prior to our work, Kayal et
al [KLSS14] proved an exponential lower bound for homogeneous depth 4 circuits
(over fields of characteristic zero) computing a poly in . The best known
lower bounds for a depth 4 homogeneous circuit computing a poly in was the
bound of by [LSS, KLSS14].Our exponential lower bounds
also give the first exponential separation between general arithmetic circuits
and homogeneous depth 4 arithmetic circuits. In particular they imply that the
depth reduction results of Koiran [Koi12] and Tavenas [Tav13] are tight even
for reductions to general homogeneous depth 4 circuits (without the restriction
of bounded bottom fanin).
Our lower bound holds over all fields. The lower bound of [KLSS14] worked
only over fields of characteristic zero. Prior to our work, the best lower
bound for homogeneous depth 4 circuits over fields of positive characteristic
was [LSS, KLSS14]
Multi-k-ic Depth Three Circuit Lower Bound
In a multi-k-ic depth three circuit every variable appears in at most k of the linear polynomials in every product gate of the circuit. This model is a natural generalization of multilinear depth three circuits that allows the formal degree of the circuit to exceed the number of underlying variables (as the formal degree of a multi-k-ic depth three circuit can be kn where n is the number of variables). The problem of proving lower bounds for depth three circuits with high formal degree has gained in importance following a work by Gupta, Kamath, Kayal and Saptharishi [7] on depth reduction to high formal degree depth three circuits. In this work, we show an exponential lower bound for multi-k-ic depth three circuits for any arbitrary constant k
On the size of homogeneous and of depth four formulas with low individual degree
International audienceLet r ≥ 1 be an integer. Let us call a polynomial f (x_1,...,x_N) ∈ F[x] as a multi-r-ic polynomial if the degree of f with respect to any variable is at most r (this generalizes the notion of multilinear polynomials). We investigate arithmetic circuits in which the output is syntactically forced to be a multi-r-ic polynomial and refer to these as multi-r-ic circuits. We prove lower bounds for several subclasses of such circuits. Specifically, first define the formal degree of a node α with respect to a variable x_i inductively as follows. For a leaf α it is 1 if α is labelled with x_i and zero otherwise; for an internal node α labelled with × (respectively +) it is the sum of (respectively the maximum of) the formal degrees of the children with respect to x_i. We call an arithmetic circuit as a multi-r-ic circuit if the formal degree of the output node with respect to any variable is at most r. We prove lower bounds for various subclasses of multi-r-ic circuits
Arithmetic Circuit Lower Bounds via MaxRank
We introduce the polynomial coefficient matrix and identify maximum rank of
this matrix under variable substitution as a complexity measure for
multivariate polynomials. We use our techniques to prove super-polynomial lower
bounds against several classes of non-multilinear arithmetic circuits. In
particular, we obtain the following results :
As our main result, we prove that any homogeneous depth-3 circuit for
computing the product of matrices of dimension requires
size. This improves the lower bounds by Nisan and
Wigderson(1995) when .
There is an explicit polynomial on variables and degree at most
for which any depth-3 circuit of product dimension at most
(dimension of the space of affine forms feeding into each
product gate) requires size . This generalizes the lower bounds
against diagonal circuits proved by Saxena(2007). Diagonal circuits are of
product dimension 1.
We prove a lower bound on the size of product-sparse
formulas. By definition, any multilinear formula is a product-sparse formula.
Thus, our result extends the known super-polynomial lower bounds on the size of
multilinear formulas by Raz(2006).
We prove a lower bound on the size of partitioned arithmetic
branching programs. This result extends the known exponential lower bound on
the size of ordered arithmetic branching programs given by Jansen(2008).Comment: 22 page