By Topic

IEEE Transactions on Information Theory

Issue 6 • Date Oct. 1998

Filter Results

Displaying Results 1 - 25 of 26
  • Guest Editorial

    Publication Year: 1998, Page(s):2042 - 2044
    Cited by:  Papers (2)
    Request permission for commercial reuse | PDF file iconPDF (24 KB)
    Freely Available from IEEE
  • Comments on broadcast channels

    Publication Year: 1998, Page(s):2524 - 2530
    Cited by:  Papers (178)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (214 KB)

    The key ideas in the theory of broadcast channels are illustrated by discussing some of the progress toward finding the capacity region. The capacity region is still unknown. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Applications of error-control coding

    Publication Year: 1998, Page(s):2531 - 2560
    Cited by:  Papers (160)  |  Patents (28)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (668 KB)

    An overview of the many practical applications of channel coding theory in the past 50 years is presented. The following application areas are included: deep space communication, satellite communication, data transmission, data storage, mobile communication, file transfer, and digital audio/video transmission. Examples, both historical and current, are given that typify the different approaches us... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Universal prediction

    Publication Year: 1998, Page(s):2124 - 2147
    Cited by:  Papers (145)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (712 KB)

    This paper consists of an overview on universal prediction from an information-theoretic perspective. Special attention is given to the notion of probability assignment under the self-information loss function, which is directly related to the theory of universal data compression. Both the probabilistic setting and the deterministic setting of the universal prediction problem are described with em... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Information-theoretic image formation

    Publication Year: 1998, Page(s):2094 - 2123
    Cited by:  Papers (45)  |  Patents (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (856 KB)

    The emergent role of information theory in image formation is surveyed. Unlike the subject of information-theoretic communication theory, information-theoretic imaging is far from a mature subject. The possible role of information theory in problems of image formation is to provide a rigorous framework for defining the imaging problem, for defining measures of optimality used to form estimates of ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The interactions between ergodic theory and information theory

    Publication Year: 1998, Page(s):2079 - 2093
    Cited by:  Papers (22)  |  Patents (10)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (576 KB)

    Information theorists frequently use the ergodic theorem; likewise entropy concepts are often used in information theory. Recently, the two subjects have become partially intertwined as deeper results from each discipline find use in the other. A brief history of this interaction is presented in this paper, together with a more detailed look at three areas of connection, namely, recurrence theory,... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Statistical inference under multiterminal data compression

    Publication Year: 1998, Page(s):2300 - 2324
    Cited by:  Papers (65)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1220 KB)

    This paper presents a survey of the literature on the information-theoretic problems of statistical inference under multiterminal data compression with rate constraints. Significant emphasis is put on problems: (1) multiterminal hypothesis testing, (2) multiterminal parameter estimation and (3) multiterminal pattern classification, in either case of positive rates or zero rates. In addition, the p... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Association schemes and coding theory

    Publication Year: 1998, Page(s):2477 - 2504
    Cited by:  Papers (55)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1544 KB)

    This paper contains a survey of association scheme theory (with its algebraic and analytical aspects) and of its applications to coding theory (in a wide sense). It is mainly concerned with a class of subjects that involve the central notion of the distance distribution of a code. Special emphasis is put on the linear programming method, inspired by the MacWilliams transform. This produces upper b... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Fifty years of Shannon theory

    Publication Year: 1998, Page(s):2057 - 2078
    Cited by:  Papers (81)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (236 KB)

    A brief chronicle is given of the historical development of the central problems in the theory of fundamental limits of data compression and reliable communication View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Codes for digital recorders

    Publication Year: 1998, Page(s):2260 - 2299
    Cited by:  Papers (113)  |  Patents (15)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1144 KB)

    Constrained codes are a key component in digital recording devices that have become ubiquitous in computer data storage and electronic entertainment applications. This paper surveys the theory and practice of constrained coding, tracing the evolution of the subject from its origins in Shannon's classic 1948 paper to present-day applications in high-density digital recorders. Open problems and futu... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Data compression and harmonic analysis

    Publication Year: 1998, Page(s):2435 - 2476
    Cited by:  Papers (179)  |  Patents (36)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1112 KB)

    In this paper we review some recent interactions between harmonic analysis and data compression. The story goes back of course to Shannon's R(D) theory in the case of Gaussian stationary processes, which says that transforming into a Fourier basis followed by block coding gives an optimal lossy compression technique; practical developments like transform-based image compression have been inspired ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Learning pattern classification-a survey

    Publication Year: 1998, Page(s):2178 - 2206
    Cited by:  Papers (72)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (844 KB)

    Classical and recent results in statistical pattern recognition and learning theory are reviewed in a two-class pattern classification setting. This basic model best illustrates intuition and analysis techniques while still containing the essential features and serving as a prototype for many applications. Topics discussed include nearest neighbor, kernel, and histogram methods, Vapnik-Chervonenki... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the role of pattern matching in information theory

    Publication Year: 1998, Page(s):2045 - 2056
    Cited by:  Papers (37)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (456 KB)

    In this paper, the role of pattern matching in information theory is motivated and discussed. We describe the relationship between a pattern's recurrence time and its probability under the data-generating stochastic source. We show how this relationship has led to great advances in universal data compression. We then describe nonasymptotic uniform bounds on the performance of data-compression algo... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Quantization

    Publication Year: 1998, Page(s):2325 - 2383
    Cited by:  Papers (734)  |  Patents (35)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1408 KB)

    The history of the theory and practice of quantization dates to 1948, although similar ideas had appeared in the literature as long ago as 1898. The fundamental role of quantization in modulation and analog-to-digital conversion was first recognized during the early development of pulse-code modulation systems, especially in the 1948 paper of Oliver, Pierce, and Shannon. Also in 1948, Bennett publ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The method of types [information theory]

    Publication Year: 1998, Page(s):2505 - 2523
    Cited by:  Papers (168)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1044 KB)

    The method of types is one of the key technical tools in Shannon theory, and this tool is valuable also in other fields. In this paper, some key applications are presented in sufficient detail enabling an interested nonspecialist to gain a working knowledge of the method, and a wide selection of further applications are surveyed. These range from hypothesis testing and large deviations theory thro... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The art of signaling: fifty years of coding theory

    Publication Year: 1998, Page(s):2561 - 2595
    Cited by:  Papers (25)  |  Patents (5)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1004 KB)

    In 1948 Shannon developed fundamental limits on the efficiency of communication over noisy channels. The coding theorem asserts that there are block codes with code rates arbitrarily close to channel capacity and probabilities of error arbitrarily close to zero. Fifty years later, codes for the Gaussian channel have been discovered that come close to these fundamental limits. There is now a substa... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Zero-error information theory

    Publication Year: 1998, Page(s):2207 - 2229
    Cited by:  Papers (86)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (732 KB)

    The problem of error-free transmission capacity of a noisy channel was posed by Shannon in 1956 and remains unsolved, Nevertheless, partial results for this and similar channel and source coding problems have had a considerable impact on information theory, computer science, and mathematics. We review the techniques, results, information measures, and challenges encountered in this ongoing quest View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Modulation and coding for linear Gaussian channels

    Publication Year: 1998, Page(s):2384 - 2415
    Cited by:  Papers (248)  |  Patents (79)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1156 KB)

    Shannon's determination of the capacity of the linear Gaussian channel has posed a magnificent challenge to succeeding generations of researchers. This paper surveys how this challenge has been met during the past half century. Orthogonal minimum-bandwidth modulation techniques and channel capacity are discussed. Binary coding techniques for low-signal-to-noise ratio (SNR) channels and nonbinary c... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Algebraic-geometry codes

    Publication Year: 1998, Page(s):2596 - 2618
    Cited by:  Papers (23)  |  Patents (7)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1088 KB)

    The theory of error-correcting codes derived from curves in an algebraic geometry was initiated by the work of Goppa as generalizations of Bose-Chaudhuri-Hocquenghem (BCH), Reed-Solomon (RS), and Goppa codes. The development of the theory has received intense consideration since that time and the purpose of the paper is to review this work. Elements of the theory of algebraic curves, at a level su... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Detection of stochastic processes

    Publication Year: 1998, Page(s):2230 - 2231
    Cited by:  Papers (97)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1080 KB)

    This paper reviews two streams of development, from the 1940's to the present, in signal detection theory: the structure of the likelihood ratio for detecting signals in noise and the role of dynamic optimization in detection problems involving either very large signal sets or the joint optimization of observation time and performance. This treatment deals exclusively with basic results developed ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Reliable communication under channel uncertainty

    Publication Year: 1998, Page(s):2148 - 2177
    Cited by:  Papers (237)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1000 KB)

    In many communication situations, the transmitter and the receiver must be designed without a complete knowledge of the probability law governing the channel over which transmission takes place. Various models for such channels and their corresponding capacities are surveyed. Special emphasis is placed on the encoders and decoders which enable reliable communication over these channels View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Information theory and communication networks: an unconsummated union

    Publication Year: 1998, Page(s):2416 - 2434
    Cited by:  Papers (177)  |  Patents (6)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (284 KB)

    Information theory has not yet had a direct impact on networking, although there are similarities in concepts and methodologies that have consistently attracted the attention of researchers from both fields. In this paper, we review several topics that are related to communication networks and that have an information-theoretic flavor, including multiaccess protocols, timing channels, effective ba... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Fading channels: information-theoretic and communications aspects

    Publication Year: 1998, Page(s):2619 - 2692
    Cited by:  Papers (1063)  |  Patents (36)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1592 KB)

    In this paper we review the most peculiar and interesting information-theoretic and communications features of fading channels. We first describe the statistical models of fading channels which are frequently used in the analysis and design of communication systems. Next, we focus on the information theory of fading channels, by emphasizing capacity as the most important performance measure. Both ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Lossy source coding

    Publication Year: 1998, Page(s):2693 - 2723
    Cited by:  Papers (73)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (728 KB)

    Lossy coding of speech, high-quality audio, still images, and video is commonplace today. However, in 1948, few lossy compression systems were in service. Shannon introduced and developed the theory of source coding with a fidelity criterion, also called rate-distortion theory. For the first 25 years of its existence, rate-distortion theory had relatively little impact on the methods and systems a... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Quantum information theory

    Publication Year: 1998, Page(s):2724 - 2742
    Cited by:  Papers (196)  |  Patents (5)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (468 KB)

    We survey the field of quantum information theory. In particular, we discuss the fundamentals of the field, source coding, quantum error-correcting codes, capacities of quantum channels, measures of entanglement and quantum cryptography View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.

Aims & Scope

IEEE Transactions on Information Theory publishes papers concerned with the transmission, processing, and utilization of information.

Full Aims & Scope

Meet Our Editors

Editor-in-Chief
Frank R. Kschischang

Department of Electrical and Computer Engineering