By Topic

IEEE Transactions on Information Theory

Issue 3 • May 1977

Filter Results

Displaying Results 1 - 23 of 23
  • A new multilevel coding method using error-correcting codes

    Publication Year: 1977, Page(s):371 - 377
    Cited by:  Papers (591)  |  Patents (59)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1024 KB)

    A new multilevel coding method that uses several error-correcting codes is proposed. The transmission symbols are constructed by combining symbols of codewords of these codes. Usually, these codes are binary error-correcting codes and have different error-correcting capabilities. For various channels, efficient systems can be obtained by choosing these codes appropriately. Encoding and decoding pr... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Two-user communication channels

    Publication Year: 1977, Page(s):295 - 304
    Cited by:  Papers (106)  |  Patents (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1480 KB)

    A discrete memoryless channel with two inputs and two outputs, called a two-user channel, is studied under the communication situation where only separate messages are allowed to be sent between two source-user pairs. An outer bound to the capacity region is obtained by a method similar to that used by the author for the broadcast channel. Two extreme cases of two-user channels are discussed: sepa... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Explicit evaluation of Viterbi's union bounds on convolutional code performance for the binary symmetric channel (Corresp.)

    Publication Year: 1977, Page(s):403 - 404
    Cited by:  Papers (6)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (952 KB)

    An explicit method is given to evaluate Viterbi's union bounds on both the first event error probability and the bit error probability of binary convolutional codes on a binary symmetric channel. These bounds are evaluated for the rate 1/2 code with generators 1 + D + D^{2} and 1 + D^...
						<a href= View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Exponential Fourier densities on S2 and optimal estimation and detection for directional processes

    Publication Year: 1977, Page(s):321 - 336
    Cited by:  Papers (8)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (2064 KB)

    Two classes of probability densities, the exponential Fourier densities and the exponential trigonometric densities, are introduced on the unit sphere, as well as four kinds of displacements. In general, neither class is closed under the operation of taking conditional distributions with respect to any of the displacements. A combined usage of both classes is required to study the estimation and d... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Convolutional tree codes for multiple access channels (Corresp.)

    Publication Year: 1977, Page(s):397 - 399
    Cited by:  Papers (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (496 KB)

    The decoding algorithm of Viterbi is extended to the case of a memoryless multiple access channel. It is Shown that in the capacity region, the probability of decoding error is bounded from above by a function of the constraint length of the code. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On quantizers for DPCM coding of picture signals

    Publication Year: 1977, Page(s):360 - 370
    Cited by:  Papers (20)  |  Patents (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1248 KB)

    A measure of picture quality for simple element, differentially coded pictures is developed based on certain subjective tests. The measure weights the quantization noise according to its visibility. It is shown that the measure correlates well with the picture quality determined on a standard impairment scale. Optimization of DPCM quantizers is done for this and for the mean-square measure of pict... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On common information in decision problems

    Publication Year: 1977, Page(s):393 - 396
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (752 KB)

    Three classes of decisionmaking problems are distinguished, and notions of common information appropriate thereto are discussed for cases involving two or more decisionmakers. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • An extension of the Shannon theory approach to cryptography

    Publication Year: 1977, Page(s):289 - 294
    Cited by:  Papers (47)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1048 KB)

    Shannon's information-theoretic approach to cryptography is reviewed and extended. It is shown that Shannon's random cipher model is conservative in that a randomly chosen cipher is essentially the worst possible. This is in contrast with error-correcting codes where a randomly chosen code is essentially the best possible. The concepts of matching a cipher to a language and of the trade-off betwee... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A self-tuning filter for fixed-lag smoothing

    Publication Year: 1977, Page(s):377 - 384
    Cited by:  Papers (58)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1168 KB)

    The problem of estimating a discrete-time stochastic signal which is corrupted by additive white measurement noise is discussed. How the stationary solution to the fixed-lag smoothing problem can be obtained is shown. The first step is to construct an innovation model for the process. It is then shown how the fixed-lag smoother can be determined from the polynomials in the transfer function of the... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On sequential sign detection of a constant signal

    Publication Year: 1977, Page(s):304 - 315
    Cited by:  Papers (13)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1080 KB)

    In fixed sample size signal detection, the sign detector is easier to implement and requires much less knowledge of the noise density than does the optimum fixed sample size detector. These advantages accrue at a cost of more observations needed to achieve the same performance. By utilizing the sign detector sequentially, it is shown that considerable saving in the (average) number of observations... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Trellis encoding of continuous-amplitude memoryless sources (Corresp.)

    Publication Year: 1977, Page(s):404 - 409
    Cited by:  Papers (20)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (840 KB)

    Trellis coding of analog memoryless sources with respect to the squared-error distortion criterion is investigated via simulation. Sources treated are the Gaussian, uniform, Laplacian, and Gaussian mixture models, and the encoding algorithms studied are the Viterbi and M algorithms. Performance versus complexity trade-offs are presented for these source models,... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A universal algorithm for sequential data compression

    Publication Year: 1977, Page(s):337 - 343
    Cited by:  Papers (1716)  |  Patents (312)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1016 KB)

    A universal algorithm for sequential data compression is presented. Its performance is investigated with respect to a nonprobabilistic model of constrained sources. The compression ratio achieved by the proposed universal code uniformly approaches the lower bounds on the compression ratios attainable by block-to-variable codes and variable-to-block codes designed to match a completely specified so... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the computation of the probability of post-decoding error events for block codes (Corresp.)

    Publication Year: 1977, Page(s):399 - 403
    Cited by:  Papers (18)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (432 KB)

    The computation of the probability of certain post-decoding error events is formulated for block codes whose weight distributions are known. A bounded-distance decoder for group codes is assumed. Numerical examples included show post-decoding character error rates for the Golay code and for some Reed-Solomon codes and the distribution of post-decoding errors for the same Reed-Solomon codes. An ext... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • An asymptotic Hamming bound on the feedback decoding minimum distance of linear tree codes (Corresp.)

    Publication Year: 1977, Page(s):396 - 397
    Cited by:  Papers (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (336 KB)

    An asymptotic Hamming bound for tree codes is derived. This bound is not new, it has been obtained earlier by Pinsker. However, Markov chains were used by Pinsker in its proof whereas more direct methods are used here. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A note on feedback communication with noisy side information at the receiver (Corresp.)

    Publication Year: 1977, Page(s):384 - 386
    Cited by:  Papers (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (392 KB)

    A feedback communication system which has noisy side information at the receiver is considered. The estimation scheme is a simple extension of the conventional one without side information. The resulting mean-squared error is compared with the rate-distortion bound obtained recently by Wyner and Ziv. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A conditional rank test for nonparametric detection

    Publication Year: 1977, Page(s):315 - 320
    Cited by:  Papers (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (920 KB)

    A one-input nonparametric detector employing the Wilcoxon signed-rank test and conditional testing is described. The rank test is applied to input samples which are larger in absolute value than a positive constant, so that the number of samples ranked is a random variable. A conditional test allows nonparametric operation; the detector is shown to maintain efficient performance with reduced ranki... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • More on autoregressive model fitting with noisy data by Akaike's information criterion (Corresp.)

    Publication Year: 1977, Page(s):409 - 410
    Cited by:  Papers (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (288 KB)

    Tong has proposed an objective method, based on Akaike's information criterion (AIC), for the determination of the order of an autoregressive (AR) model with noisy data; some extensions of this proposed method are discussed. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On binary sliding block codes

    Publication Year: 1977, Page(s):343 - 353
    Cited by:  Papers (10)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1752 KB)

    Sliding block codes are an intriguing alternative to the block codes used in the development of classical information theory. The fundamental analytical problem associated with the use of a sliding block code (SBC) for source encoding with respect to a fidelity criterion is that of determining the entropy of the coder output. Several methods of calculating and of bounding the output entropy of an ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A note on Wyner's wiretap channel (Corresp.)

    Publication Year: 1977, Page(s):387 - 390
    Cited by:  Papers (26)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (712 KB)

    Wyner recently introduced the concept of a wiretap channel and showed that by transmitting at a rate less than capacity on the main link it was possible to keep the wiretapper's information about the entire message equal to zero. It is shown that it is possible to send at capacity on the main link and still keep the wiretapper's information equal to zero on many, large, arbitrary portions of the m... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Transient analysis of the first-order phase-locked loop (Corresp.)

    Publication Year: 1977, Page(s):411 - 415
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (488 KB)

    The problem of obtaining the transient solution to a class of Fokker-Planck equation derived from the first-order nondetuning phase-locked loop is considered. Two methods are proposed to obtain the eigenvalues and the eigenfunctions of the spatial operator for the Fokker-planck equation. One is a perturbation method in which the signal-to-noise ratio is adopted as a parameter. The other is a metho... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Distortion-rate functions for vector sources and a maximum fidelity criterion

    Publication Year: 1977, Page(s):354 - 359
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (896 KB)

    The problem of distortion-rate functions for vector sources is considered. Two fidelity criteria are treated. The first considers the maximum of the weighted component distortions and then takes the per-letter average. The second takes the maximum of the weighted component per-letter averages. In either case, a well-defined distortion-rate function results, giving the minimum possible distortion a... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Information structure: Common and private (Corresp.)

    Publication Year: 1977, Page(s):390 - 393
    Cited by:  Papers (5)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (704 KB)

    Two new definitions for the common and private information structures between two decisionmakers are introduced and are shown to satisfy various reasonable properties. The new definitions are framed in a decisionmaking context and do not require a probability assignment on the space of events. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Switching-time statistics for a ramp-excited tunnel diode switch (Corresp.)

    Publication Year: 1977, Page(s):415 - 418
    Cited by:  Papers (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (592 KB)

    An analytical model is developed which yields switching-time jitter statistics for a tunnel diode excited by a current ramp. For appropriate wide-band noise, a "switch sensitivity period" is defined over which a weighted average (a stochastic integral)of the noise specifies the deviation in the switching time. The predictions agree with experimental results. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.

Aims & Scope

IEEE Transactions on Information Theory publishes papers concerned with the transmission, processing, and utilization of information.

Full Aims & Scope

Meet Our Editors

Editor-in-Chief
Prakash Narayan 

Department of Electrical and Computer Engineering