SAX Discretization Does Not Guarantee Equiprobable Symbols

In time series analysis research, there is a strong interest in discrete representations of real valued data streams. One approach still considered state-of-the-art is the Symbolic Aggregate Approximation (SAX) algorithm. The interest of this paper concerns the SAX assumption of data being highly Ga...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on knowledge and data engineering 2015-04, Vol.27 (4), p.1162-1166
Main Authors: Butler, Matthew, Kazakov, Dimitar
Format: Article
Language:English
Subjects:
Aggregates
Approximation algorithms
Approximation methods
auto-correlation
Autocorrelation
Contracts
discretization
Mathematical analysis
Noise
Partitions
Representations
SAX
Standard deviation
Symbols
Time series
Time series analysis
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In time series analysis research, there is a strong interest in discrete representations of real valued data streams. One approach still considered state-of-the-art is the Symbolic Aggregate Approximation (SAX) algorithm. The interest of this paper concerns the SAX assumption of data being highly Gaussian and the use of the standard normal curve to choose partitions to discretize the data. The SAX approach chooses partitions on the standard normal curve that would produce an equal probability for each symbol. This procedure is generally valid as a time series is normalized to have μ = 0 and σ = 1. However, there exists a caveat to this assumption of equi-probability due to the intermediate step of Piecewise Aggregate Approximation (PAA). We show in this paper that when PAA is applied, the distribution of the data is altered, resulting in a shrinking standard deviation that is proportional to the number of points used to create a segment of the PAA representation and the degree of auto-correlation within the series. Data that exhibits statistically significant auto-correlation is less affected by this shrinking distribution. As the standard deviation of the data contracts, the mean remains the same, however the distribution is no longer standard normal and therefore the partitions based on the standard normal curve are no longer valid for the assumption of equal probability.
ISSN:1041-4347
1558-2191
DOI:10.1109/TKDE.2014.2382882