Loading [MathJax]/extensions/MathMenu.js
Benjamin Weiss - IEEE Xplore Author Profile

Showing 1-12 of 12 results

Filter Results

Show

Results

The main result is a universal pointwise test that, when presented with a set of words S on a finite or countable alphabet X that purports to be a set of memory words for a stationary process, will eventually almost surely return the value YES precisely when all positive probability words in S are memory words. For example, if S consists of all of the single letters in X, then the test will eventu...Show More
We present here a universal estimation scheme for the problem of estimating the residual waiting time until the next occurrence of a zero after observing the first n outputs of a stationary and ergodic binary process. The scheme will involve estimating only at carefully selected stopping times but will be almost surely consistent. In case the process happens to be a genuine renewal process then ou...Show More
For a stationary stochastic process {Xn} with values in some set A, a finite word w isin AK is called a memory word if the conditional probability of X 0 given the past is constant on the cylinder set defined by X - K -1=w . It is a called a minimal memory word if no proper suffix of w is also a memory word. For example in a K-step Markov processes all words of length K are memory words but not ne...Show More

Order estimation of Markov chains

G. Morvai;B. Weiss

IEEE Transactions on Information Theory
Year: 2005 | Volume: 51, Issue: 4 | Journal Article |
Cited by: Papers (18)
Estimators /spl chi//sub n/(X/sub 0/, X/sub 1/, ..., X/sub n/), are described which, when applied to an unknown stationary process taking values from a countable alphabet /spl chi/, converge almost surely to k in case the process is a kth-order Markov chain and to infinity otherwise.Show More
This paper takes as point of departure a novel dovetail technique, previously developed, for constructing families of spreading sequences mutually orthogonal in the asynchronous sense. Any two members of the family have periodic cross-correlation values which are identically zero for all values of the shift index, obviating the need for mutual synchronization. Other methods achieve orthogonality b...Show More
For a stationary random field {x(u): u /spl isin/ Z/sup d/}, the recurrence time R/sub n/(x) may be defined as the smallest positive k, such that the pattern {x(u): 0 /spl les/ u/sub i/ < n} is seen again, in a new position in the cube {0 /spl les/ |u/sub i/| < k}. In analogy with the case of d = 1, where the pioneering work was done by Wyner and Ziv (1989), we prove here that the asymptotic growt...Show More
This paper describes a novel dovetail technique for constructing families of spreading sequences for SS/CDMA which are mutually orthogonal in the asynchronous sense. That is, any two members of the family have periodic crosscorrelation values which are identically zero for all values of the shift index, obviating the need for mutual synchronization. Our goal is to improve the crosscorrelation prop...Show More
The construction of collections of pseudorandom binary sequences whose elements are chosen from the set (1, -1) and which have "noiselike" properties remains an important issue in spread spectrum communications systems and the search for such sequences may be methodically attacked armed with a spectral approach. Along these lines a reasonable conjecture is that the flatness of the sequence spectru...Show More
Shows that for any sequence /spl rho/(n)=o(n) and any sequence of prefix codes, there is a B-process of entropy arbitrarily close to the maximum possible entropy for which the expected redundancy is at least as large as /spl rho/(n) for infinitely many n. This extends work of Shields (1993), whose examples had O entropy. The class of B-processes, that is, stationary codings of independent and iden...Show More
Shows that for any sequence /spl rho/(n)=o(n) and any sequence of prefix codes, there is a B-process of entropy arbitrarily close to the maximum possible entropy for which the expected redundancy is at least as large as /spl rho/(n) for infinitely many n. This extends earlier work of the first author, whose examples had 0 entropy, [Shields, 1993]. The class of B-processes, that is, stationary codi...Show More
The entropy of a stationary multidimensional array of random variables is related to the rate of recurrence of the patterns that are seen in the center of the array. The results give the possibility of calculating the entropy of a (stochastic) process from a single set of observations without computation of probabilities.<>Show More
Some new ways of defining the entropy of a process by observing a single typical output sequence as well as a new kind of Shannon-McMillan-Breiman theorem are presented. This provides a new and conceptually very simple ways of estimating the entropy of an ergodic stationary source as well as new insight into the workings of such well-known data compression schemes as the Lempel-Ziv algorithm.<>Show More