CORE
πΊπ¦Β
Β make metadata, not war
Services
Services overview
Explore all CORE services
Access to raw data
API
Dataset
FastSync
Content discovery
Recommender
Discovery
OAI identifiers
OAI Resolver
Managing content
Dashboard
Bespoke contracts
Consultancy services
Support us
Support us
Membership
Sponsorship
Community governance
Advisory Board
Board of supporters
Research network
About
About us
Our mission
Team
Blog
FAQs
Contact us
slides
Locally Consistent Parsing for Text Indexing in Small Space
Authors
Or Birenzwige
Shay Golan
Ely Porat
Publication date
1 January 2020
Publisher
'Society for Industrial & Applied Mathematics (SIAM)'
Doi
Cite
View
on
arXiv
Abstract
We consider two closely related problems of text indexing in a sub-linear working space. The first problem is the Sparse Suffix Tree (SST) construction of a set of suffixes
B
B
B
using only
O
(
β£
B
β£
)
O(|B|)
O
(
β£
B
β£
)
words of space. The second problem is the Longest Common Extension (LCE) problem, where for some parameter
1
β€
Ο
β€
n
1\le\tau\le n
1
β€
Ο
β€
n
, the goal is to construct a data structure that uses
O
(
n
Ο
)
O(\frac {n}{\tau})
O
(
Ο
n
β
)
words of space and can compute the longest common prefix length of any pair of suffixes. We show how to use ideas based on the Locally Consistent Parsing technique, that was introduced by Sahinalp and Vishkin [STOC '94], in some non-trivial ways in order to improve the known results for the above problems. We introduce new Las-Vegas and deterministic algorithms for both problems. We introduce the first Las-Vegas SST construction algorithm that takes
O
(
n
)
O(n)
O
(
n
)
time. This is an improvement over the last result of Gawrychowski and Kociumaka [SODA '17] who obtained
O
(
n
)
O(n)
O
(
n
)
time for Monte-Carlo algorithm, and
O
(
n
log
β‘
β£
B
β£
)
O(n\sqrt{\log |B|})
O
(
n
lo
g
β£
B
β£
β
)
time for Las-Vegas algorithm. In addition, we introduce a randomized Las-Vegas construction for an LCE data structure that can be constructed in linear time and answers queries in
O
(
Ο
)
O(\tau)
O
(
Ο
)
time. For the deterministic algorithms, we introduce an SST construction algorithm that takes
O
(
n
log
β‘
n
β£
B
β£
)
O(n\log \frac{n}{|B|})
O
(
n
lo
g
β£
B
β£
n
β
)
time (for
β£
B
β£
=
Ξ©
(
log
β‘
n
)
|B|=\Omega(\log n)
β£
B
β£
=
Ξ©
(
lo
g
n
)
). This is the first almost linear time,
O
(
n
β
p
o
l
y
log
β‘
n
)
O(n\cdot poly\log{n})
O
(
n
β
p
o
l
y
lo
g
n
)
, deterministic SST construction algorithm, where all previous algorithms take at least
Ξ©
(
min
β‘
{
n
β£
B
β£
,
n
2
β£
B
β£
}
)
\Omega\left(\min\{n|B|,\frac{n^2}{|B|}\}\right)
Ξ©
(
min
{
n
β£
B
β£
,
β£
B
β£
n
2
β
}
)
time. For the LCE problem, we introduce a data structure that answers LCE queries in
O
(
Ο
log
β‘
β
n
)
O(\tau\sqrt{\log^*n})
O
(
Ο
lo
g
β
n
β
)
time, with
O
(
n
log
β‘
Ο
)
O(n\log\tau)
O
(
n
lo
g
Ο
)
construction time (for
Ο
=
O
(
n
log
β‘
n
)
\tau=O(\frac{n}{\log n})
Ο
=
O
(
l
o
g
n
n
β
)
). This data structure improves both query time and construction time upon the results of Tanimura et al. [CPM '16].Comment: Extended abstract to appear is SODA 202
Similar works
Full text
Available Versions
Crossref
See this paper in CORE
Go to the repository landing page
Download from data provider
Last time updated on 10/08/2021