Fast Output-Sensitive Pattern Discovery in Massive Sequences using the Motif Trie

Abstract : We introduce the motif trie data structure, which has applications in pattern matching and discovery in genomic analysis, plagiarism detection, data mining, intrusion detection, spam fighting and time series analysis, to name a few. Here the extraction of recurring patterns in sequential and textual data is one of the main computational bottlenecks. For this, we address the problem of extracting maximal patterns with at most k don't care symbols and at least q occurrences, according to a maximality notion we define. We apply the motif trie to this problem, also showing how to build it efficiently. As a result, we give the first algorithm that attains a stronger notion of output-sensitivity, where the cost for an input sequence of n symbols is proportional to the actual number of occurrences of each pattern, which is at most n (much smaller in practice). This avoids the best-known cost of O(nc)O(nc) per pattern, for constant c>1c>1, which is otherwise impractical for massive sequences with large n.
Complete list of metadatas

Cited literature [21 references]  Display  Hide  Download

https://hal.inria.fr/hal-01525745
Contributor : Marie-France Sagot <>
Submitted on : Wednesday, May 24, 2017 - 11:11:15 AM
Last modification on : Friday, April 12, 2019 - 10:18:10 AM
Long-term archiving on : Monday, August 28, 2017 - 4:41:14 PM

File

Auth-TCS17.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Roberto Grossi, Giulia Menconi, Nadia Pisanti, Roberto Trani, Søren Vind. Fast Output-Sensitive Pattern Discovery in Massive Sequences using the Motif Trie. Theoretical Computer Science, Elsevier, 2017, pp.25. ⟨10.1016/j.tcs.2017.04.012⟩. ⟨hal-01525745⟩

Share

Metrics

Record views

203

Files downloads

257