CORE
πΊπ¦Β
Β make metadata, not war
Services
Services overview
Explore all CORE services
Access to raw data
API
Dataset
FastSync
Content discovery
Recommender
Discovery
OAI identifiers
OAI Resolver
Managing content
Dashboard
Bespoke contracts
Consultancy services
Support us
Support us
Membership
Sponsorship
Community governance
Advisory Board
Board of supporters
Research network
About
About us
Our mission
Team
Blog
FAQs
Contact us
The Local Landscape of Phase Retrieval Under Limited Samples
Authors
Kaizhao Liu
Zihao Wang
Lei Wu
Publication date
26 November 2023
Publisher
View
on
arXiv
Abstract
In this paper, we provide a fine-grained analysis of the local landscape of phase retrieval under the regime with limited samples. Our aim is to ascertain the minimal sample size necessary to guarantee a benign local landscape surrounding global minima in high dimensions. Let
n
n
n
and
d
d
d
denote the sample size and input dimension, respectively. We first explore the local convexity and establish that when
n
=
o
(
d
log
β‘
d
)
n=o(d\log d)
n
=
o
(
d
lo
g
d
)
, for almost every fixed point in the local ball, the Hessian matrix must have negative eigenvalues as long as
d
d
d
is sufficiently large. Consequently, the local landscape is highly non-convex. We next consider the one-point strong convexity and show that as long as
n
=
Ο
(
d
)
n=\omega(d)
n
=
Ο
(
d
)
, with high probability, the landscape is one-point strongly convex in the local annulus:
{
w
β
R
d
:
o
d
(
1
)
β©½
β₯
w
β
w
β
β₯
β©½
c
}
\{w\in\mathbb{R}^d: o_d(1)\leqslant \|w-w^*\|\leqslant c\}
{
w
β
R
d
:
o
d
β
(
1
)
β©½
β₯
w
β
w
β
β₯
β©½
c
}
, where
w
β
w^*
w
β
is the ground truth and
c
c
c
is an absolute constant. This implies that gradient descent initialized from any point in this domain can converge to an
o
d
(
1
)
o_d(1)
o
d
β
(
1
)
-loss solution exponentially fast. Furthermore, we show that when
n
=
o
(
d
log
β‘
d
)
n=o(d\log d)
n
=
o
(
d
lo
g
d
)
, there is a radius of
Ξ
~
(
1
/
d
)
\widetilde\Theta\left(\sqrt{1/d}\right)
Ξ
(
1/
d
β
)
such that one-point convexity breaks in the corresponding smaller local ball. This indicates an impossibility to establish a convergence to exact
w
β
w^*
w
β
for gradient descent under limited samples by relying solely on one-point convexity.Comment: 41 page
Similar works
Full text
Available Versions
arXiv.org e-Print Archive
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:arXiv.org:2311.15221
Last time updated on 10/05/2024