By Topic

IEEE Transactions on Information Theory

Issue 5 • Sept. 1996

Filter Results

Displaying Results 1 - 25 of 44
  • A geometric construction procedure for geometrically uniform trellis codes

    Publication Year: 1996, Page(s):1498 - 1513
    Cited by:  Papers (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1500 KB)

    The problem of maximizing the minimum free squared Euclidean distance of a trellis code is developed from a geometric point of view. This approach provides a new way of constructing constellations for trellis coding. A decomposition of the trellis topology leads to a systematic construction of signal sets and generators for geometrically uniform trellis codes. An algorithm is proposed to construct... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Two-Dimensional Imaging [Book Reviews]

    Publication Year: 1996
    Request permission for commercial reuse | PDF file iconPDF (234 KB)
    Freely Available from IEEE
  • Contributors

    Publication Year: 1996
    Request permission for commercial reuse | PDF file iconPDF (527 KB)
    Freely Available from IEEE
  • Constrained block codes for class-IV partial-response channels with maximum-likelihood sequence estimation

    Publication Year: 1996, Page(s):1405 - 1424
    Cited by:  Papers (5)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1580 KB)

    Significant improvements in magnetic storage densities have been made feasible by the application of partial-response signaling combined with maximum-likelihood sequence estimation. To enhance the performance of this technique when applied to the class-IV partial-response channel, which is recognized as being appropriate to model the magnetic recording channel, it is often required to bound the nu... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Source coding and graph entropies

    Publication Year: 1996, Page(s):1329 - 1339
    Cited by:  Papers (79)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (752 KB)

    A sender wants to accurately convey information to a receiver who has some, possibly related, data. We study the expected number of bits the sender must transmit for one and for multiple instances in two communication scenarios and relate this number to the chromatic and Korner (1973) entropies of a naturally defined graph View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The intersymbol interference channel: lower bounds on capacity and channel precoding loss

    Publication Year: 1996, Page(s):1388 - 1404
    Cited by:  Papers (79)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1368 KB)

    The discrete-time additive Gaussian intersymbol interference (ISI) channel with i.i.d. (not necessarily Gaussian) input signals is considered. Several new and old lower bounds on the capacity are derived in a unified manner by assuming different front-end receiver filters, in particular the sampled whitened matched filter (SWMF) and the minimum mean-squared error-decision feedback equalizer (MMSE-... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • First-order approximation of the ordered binary-symmetric channel

    Publication Year: 1996, Page(s):1381 - 1387
    Cited by:  Papers (12)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (488 KB)

    Soft-decision decoding algorithms of binary linear block codes require reordering of the received symbols within each block in decreasing reliability. Efficient decoding algorithms based on reordering have been devised. This paper presents different results related to the ordering of a sequence of N received symbols with respect to their reliability measure, for BPSK transmission over the AWGN cha... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Match-length functions for data compression

    Publication Year: 1996, Page(s):1375 - 1380
    Cited by:  Papers (9)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (400 KB)

    We investigate uniquely decodable match-length functions (MLFs) in conjunction with Lempel-Ziv (1977) type data compression. An MLF of a data string is a function that associates a nonnegative integer with each position of the string. The MLF is used to parse the input string into phrases. The codeword for each phrase consists of a pointer to the beginning of a maximal match consistent with the ML... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Efficient scalar quantization of exponential and Laplacian random variables

    Publication Year: 1996, Page(s):1365 - 1374
    Cited by:  Papers (101)  |  Patents (30)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (948 KB)

    This paper presents solutions to the entropy-constrained scalar quantizer (ECSQ) design problem for two sources commonly encountered in image and speech compression applications: sources having the exponential and Laplacian probability density functions. We use the memoryless property of the exponential distribution to develop a new noniterative algorithm for obtaining the optimal quantizer design... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the relative entropy of discrete-time Markov processes with given end-point densities

    Publication Year: 1996, Page(s):1529 - 1535
    Cited by:  Papers (8)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (608 KB)

    Given a Markov process x(k) defined over a finite interval I=[0,N], I⊂Z we construct a process x*(k) with the same initial density as x, but a different end-point density, which minimizes the relative entropy of x and x*. It is shown that x* is a Markov process in the same reciprocal class as x. In the Gaussian case, the minimum relative entropy problem is related to a minimum energy ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Hierarchical universal coding

    Publication Year: 1996, Page(s):1354 - 1364
    Cited by:  Papers (21)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (932 KB)

    In an earlier paper, we proved a strong version of the redundancy-capacity converse theorem of universal coding, stating that for “most” sources in a given class, the universal coding redundancy is essentially lower-bounded by the capacity of the channel induced by this class. Since this result holds for general classes of sources, it extends Rissanen's (1986) strong converse theorem f... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Generation of discrete distributions from biased coins

    Publication Year: 1996, Page(s):1541 - 1546
    Cited by:  Papers (11)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (556 KB)

    The procedure of Knuth and Yao (1976) to simulate random numbers with specified distribution by parsing sequences of fair coin tosses is generalized to employ discrete distributions of particular form instead of fair coins. Each probability in these distributions is an integral power of some fixed value t. The parse tree for the simulation procedure is closely related to the code trees arising in ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Nearest neighbor decoding for additive non-Gaussian noise channels

    Publication Year: 1996, Page(s):1520 - 1529
    Cited by:  Papers (117)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (912 KB)

    We study the performance of a transmission scheme employing random Gaussian codebooks and nearest neighbor decoding over a power limited additive non-Gaussian noise channel. We show that the achievable rates depend on the noise distribution only via its power and thus coincide with the capacity region of a white Gaussian noise channel with signal and noise power equal to those of the original chan... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the weight hierarchy of Kerdock codes over Z4

    Publication Year: 1996, Page(s):1587 - 1593
    Cited by:  Papers (22)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (492 KB)

    The rth generalized Hamming weight dr of the Kerdock code of length 2m over Z4 is considered. A lower bound on dr is derived for any r, and dr is exactly determined for r=0.5, 1, 1.5, 2, 2.5. In the case of length 2 2m, dr is determined for any r, where 0⩽r⩽m and 2r is an integer. In addition, it is shown that it ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Upper bounds on the minimum distance of spherical codes

    Publication Year: 1996, Page(s):1576 - 1581
    Cited by:  Papers (18)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (484 KB)

    We use linear programming techniques to obtain new upper bounds on the maximal squared minimum distance of spherical codes with fixed cardinality. Functions Qj(n,s) are introduced with the property that Qj(n,s)<0 for some j>m if and only if the Levenshtein bound Lm(n,s) on A(n,s)=max{|W|:W is an (n,|W|,s) code} can be improved by a polynomial of degree at lea... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The optimal error exponent for Markov order estimation

    Publication Year: 1996, Page(s):1488 - 1497
    Cited by:  Papers (16)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (724 KB)

    We consider the problem of estimating the order of a stationary ergodic Markov chain. Our focus is on estimators which satisfy a generalized Neyman-Pearson criterion of optimality. Specifically, the optimal estimator minimizes the probability of underestimation among all estimators with probability of overestimation not exceeding a given value. Our main result identifies the best exponent of asymp... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A rate 4/6 (d=1, k=11) block-decodable runlength-limited code

    Publication Year: 1996, Page(s):1551 - 1553
    Cited by:  Patents (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (308 KB)

    A new rate 4/6 (d=1, k'=11) runlength-limited code which is well adapted to byte-oriented storage systems is presented. The new code has the virtue that it can be decoded on a block basis, i.e., without knowledge of previous or next codewords, and, therefore, it does not suffer from error propagation. This code is particularly attractive as many commercially available Reed-Solomon codes operate in... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the probability of error of convolutional codes

    Publication Year: 1996, Page(s):1562 - 1568
    Cited by:  Papers (9)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (620 KB)

    New upper and lower bounds and approximations on the sequence, event, first event, and bit-error probabilities of convolutional codes are presented. Each of these probabilities are precisely defined and the relationship between them described. Some of the new bounds and approximations are found to be very close to computer simulations at very high error ratios. Simple modifications to the traditio... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A method for constructing decodable de Bruijn sequences

    Publication Year: 1996, Page(s):1472 - 1478
    Cited by:  Papers (13)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (620 KB)

    We present two related methods of construction for de Bruijn (1946) sequences, both based on interleaving “smaller” de Bruijn sequences. Sequences obtained using these construction methods have the advantage that they can be “decoded” very efficiently, i.e., the position within the sequence of any particular “window” can be found very simply. Sequences with simp... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A note on bounds for q-ary covering codes

    Publication Year: 1996, Page(s):1640 - 1642
    Cited by:  Papers (12)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (196 KB)

    Two strongly seminormal codes over Z5 are constructed to prove a conjecture of Ostergard (see ibid., vol.37, no.3, p.660-4, 1991). It is shown that a result of Honkala (see ibid., vol.37, no.4, p.1203-6, 1991) on (k,t)-subnormal codes holds also under weaker assumptions. A lower bound and an upper bound on Kq(n, R), the minimal cardinality of a q-ary code of length n with cov... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The weight distribution of the third-order Reed-Muller code of length 512

    Publication Year: 1996, Page(s):1622 - 1625
    Cited by:  Papers (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (336 KB)

    A method for computing the weight distribution of the third-order Reed-Muller code of length 512 is presented. Linear block codes are also examined View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Recovering band-limited signals under noise

    Publication Year: 1996, Page(s):1425 - 1438
    Cited by:  Papers (17)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (912 KB)

    We consider the problem of recovering a band-limited signal f(t) from noisy data yk=f(kτ)+≫epsilon/k, where τ is the sampling rate. Starting from the truncated Whittaker-Shannon cardinal expansion with or without sampling windows (both cases yield inconsistent estimates of f(t)) we propose estimators that are convergent to f(t) in the pointwise and uniform sense. The basic id... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Information rates of pre/post-filtered dithered quantizers

    Publication Year: 1996, Page(s):1340 - 1353
    Cited by:  Papers (61)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1128 KB)

    We consider encoding of a source with pre-specified second-order statistics, but otherwise arbitrary, by entropy-coded dithered (lattice) quantization (ECDQ) incorporating linear pre- and post-filters. In the design and analysis of this scheme we utilize the equivalent additive-noise channel model of the ECDQ. For Gaussian sources and a square error distortion measure, the coding performance of th... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Some inequalities for channel capacities, mutual informations and mean-squared errors

    Publication Year: 1996, Page(s):1536 - 1540
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (384 KB)

    We derive some information-theoretic inequalities to evaluate the channel capacity and mean-squared error. We prove an inequality for the capacity of an additive-noise channel with feedback. We also prove an inequality for mutual information and mean-squared error. The inequality is applied to bound minimum mean-squared transmission errors. The results for the channel capacity and the mean-squared... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Context weighting for general finite-context sources

    Publication Year: 1996, Page(s):1514 - 1520
    Cited by:  Papers (24)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (588 KB)

    Context weighting procedures are presented for sources with models (structures) in four different classes. Although the procedures are designed for universal data compression purposes, their generality allows application in the area of classification View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.

Aims & Scope

IEEE Transactions on Information Theory publishes papers concerned with the transmission, processing, and utilization of information.

Full Aims & Scope

Meet Our Editors

Editor-in-Chief
Prakash Narayan 

Department of Electrical and Computer Engineering