IEEE Transactions on Information Theory

Volume 16 Issue 1 • January 1970

Filter Results

Displaying Results 1 - 25 of 25
  • On the difficulty of computations

    Publication Year: 1970, Page(s):5 - 9
    Cited by:  Papers (22)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (908 KB)

    Two practical considerations concerning the use of computing machines are the amount of information that must be given to the machine for it to perform a given task and the time it takes the machine to perform it. The size of programs and their running time are studied for mathematical models of computing machines. The study of the amount of information (i.e., number of bits) in a computer program... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The rate of a class of random processes

    Publication Year: 1970, Page(s):10 - 16
    Cited by:  Papers (30)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (745 KB)

    In certain situations, a single transmission system must be designed to function satisfactorily when used for any source from a class<tex>a</tex>of sources. In this situation, the rate-distortion function<tex>R_a (d)</tex>is the minimum capacity required by any transmission system that can transmit each source from<tex>a</tex>with average distortion<tex>\l... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Distribution of the time-average power of a Gaussian process

    Publication Year: 1970, Page(s):17 - 26
    Cited by:  Papers (15)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1154 KB)

    A method is given for obtaining a closed-form expression for the characteristic function of the average power, in a<tex>T</tex>-second interval, of a zero-mean Gaussian random process. The technique, which is constructive in nature, is applicable to the class of covariance kernels whose corresponding homogeneous Fredholm integral equations admit reduction to an equivalent linear differ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Some convergence properties of a nearest neighbor decision rule

    Publication Year: 1970, Page(s):26 - 31
    Cited by:  Papers (16)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (868 KB)

    This paper focuses on the problem of the relationship between the risk incurred using a nearest neighbor rule and the size of the data base. Theoretical results include demonstrations of the facts that the proximity of the nearest neighbor to a new sample in a collection of<tex>n</tex>samples becomes (in probability) arbitrarily small as<tex>n</tex>is increased; that the co... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The effects of dependence on nonparametric detection

    Publication Year: 1970, Page(s):32 - 41
    Cited by:  Papers (15)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1472 KB)

    This paper investigates the effects of dependence on rank tests, in particular on a class of recently defined nonparametric tests called "mixed" statistical tests. It is shown that the mixed test statistic is asymptotically normal for Gaussian processes with mild regularity properties justifying the use of asymptotic relative efficiency (ARE) as a figure of merit. Results are presented in terms of... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On optimum recognition error and reject tradeoff

    Publication Year: 1970, Page(s):41 - 46
    Cited by:  Papers (310)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (715 KB)

    The performance of a pattern recognition system is characterized by its error and reject tradeoff. This paper describes an optimum rejection rule and presents a general relation between the error and reject probabilities and some simple properties of the tradeoff in the optimum recognition system. The error rate can be directly evaluated from the reject function. Some practical implications of the... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On feature selection in a class of distribution-free pattern classifiers

    Publication Year: 1970, Page(s):47 - 55
    Cited by:  Papers (13)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (892 KB)

    A feature-selection procedure is proposed for the class of distribution-free pattern classifiers [1], [2]. The selection procedure can be readily carried out on fixed (large) training samples using matrix inversion. If direct matrix inversion is to be avoided, the approximation method [4] or the stochastic-approximation procedure [2] can be applied to the training samples. The proposed procedure, ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Coding theorems for the nonsynchronized channel

    Publication Year: 1970, Page(s):55 - 73
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (2156 KB)

    Capacity and error bounds are derived for a memoryless binary symmetric channel with the receiver having no a priori information as to the starting time of the code words. The channel capacity is the same as the capacity of the synchronized channel. For all rates below capacity, the minimum probability of error for the nonsynchronized channel decreases exponentially with the code-block length. For... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Correction to 'The design of clutter-resistant radar waveforms with limited dynamic range'

    Publication Year: 1970, Page(s): 73
    Cited by:  Papers (4)
    Request permission for commercial reuse | PDF file iconPDF (68 KB)
    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Entropy and data compression (Corresp.)

    Publication Year: 1970, Page(s):74 - 75
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (277 KB)

    An optimum compression ratio (OCR) is defined for a source, leading to "efficiency" of a compression algorithm and resulting in a good evaluation of data-compression schemes. Applications to first- and second-order Markov sources, in conjunction with the "fan" and "zero-order hold" compression schemes, are also presented. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Interpolation of a Gaussian-Markov process (Corresp.)

    Publication Year: 1970, Page(s):75 - 77
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (329 KB)

    Expressions are derived for the optimal estimate and the resultant error variance for interpolation between sample points of a Gaussian-Markov process. The results are also displayed as a family of curves for the optimal estimate and error variance. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Spherically invariant and compound Gaussian stochastic processes (Corresp.)

    Publication Year: 1970, Page(s):77 - 79
    Cited by:  Papers (36)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (502 KB)

    This correspondence discusses the comparison between the class of spherically invariant processes and a particular class of Gaussian compound processes. We give a simple expression for the probability distribution and calculate some expectation values. The comparison shows that spherically invariant processes are slightly more general. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Ideal limiting of digital signals in Gaussian noise (Corresp.)

    Publication Year: 1970, Page(s):79 - 81
    Cited by:  Papers (2)
    Request permission for commercial reuse | PDF file iconPDF (331 KB)
    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Asymptotic quantizing error for unbounded random variables (Corresp.)

    Publication Year: 1970, Page(s):81 - 83
    Cited by:  Papers (5)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (345 KB)

    A sufficient condition is given for mean<tex>r</tex>th-power error in quantizing an unbounded random variable to vary inversely with the<tex>r</tex>th power of the number of quantizing levels. An example is given of a distribution for which this behavior is unattainable. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A state-space bandwidth constraint for problems in waveform design (Corresp.)

    Publication Year: 1970, Page(s):83 - 85
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (345 KB)

    In this correspondence we review some of the difficulties associated with the commonly used bandwidth constraints in the time domain. Then we derive a constraint in state-space, which guarantees that the signal design will result in a waveform having a certain percentage of its energy within a specified frequency band. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Synthesis of low-peak-factor signals and binary sequences with low autocorrelation (Corresp.)

    Publication Year: 1970, Page(s):85 - 89
    Cited by:  Papers (421)  |  Patents (15)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (594 KB)

    This correspondence considers the problem of how to adjust the phase angles of a periodic signal with a given power spectrum to minimize its peak-to-peak amplitude. This "peak-factor problem" arises in radar, sonar, and numerous other applications. However, in spite of the wide-spread interest it has evoked, the peak-factor problem has so far defied solution except in cases where the number of spe... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Optimum Radar Signal-Filter Pairs in a Cluttered Environment

    Publication Year: 1970, Page(s):89 - 90
    Cited by:  Papers (5)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (264 KB)

    In a recent paper on radar detection in clutter, the authors stated that the signal-to-interference ratio<tex>\rho_{cf} (u)</tex>obtained with the signal<tex>u</tex>and its optimum filter can have stationary points which are not stationary points of<tex>\rho_{mf} (u)</tex>, the signal-to-interference ratio obtained with<tex>u</tex>and its matched fil... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Comments on "Signal design for a class of clutter channels" by Balakrishnan, A.V.

    Publication Year: 1970, Page(s):90 - 91
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (334 KB)

    When scatterers introduce Doppler shifts distributed uniformly over a frequency band more than twice as wide as that of the signal, the maximum echo SNR for detection in the clutter and white noise is independent of the shape of the transmitted signal. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A Bayes sequential test of m hypotheses (Corresp.)

    Publication Year: 1970, Page(s):91 - 94
    Cited by:  Papers (5)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (707 KB)

    The problem of sequentially deciding upon one of<tex>m</tex>mutually exclusive and exhaustive hypotheses has been studied in detail for the case of<tex>m = 2</tex>. This correspondence presents the structure for the Bayes<tex>m</tex>-ary sequential detector. Computational results depend on a property called subspace separability, which allows one to reduce the d... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Bounded approximations for averaging multitrial detection probabilities over slowly fading targets (Corresp.)

    Publication Year: 1970, Page(s):94 - 95
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (286 KB)

    The averaging of target-detection probability over random target strength is more difficult when multiple-trial detection logic is used. This correspondence examines an approximation method sometimes used, and determines the theoretical bounds on the true average in terms of the estimated average. These are derived for a two-trial detection scheme and then generalized to<tex>N</tex>tri... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Small and Large-Sample Behavior of Two Detectors Against Envelope-Detected

    Publication Year: 1970, Page(s):95 - 99
    Cited by:  Papers (17)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (714 KB)

    The mean and median detectors are compared at both small- and large-(ARE)-sample sizes for use with envelope-detected data. For the Rayleigh distribution, the mean is the better detector for all sample sizes. However, for the noncoherent contaminated-normal distribution, the mean is the better small-sample detector, whereas the median is the better large-sample detector. Hence, the ARE cannot alwa... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Piecewise linear discriminant functions and classification errors for multiclass problems (Corresp.)

    Publication Year: 1970, Page(s):99 - 100
    Cited by:  Papers (8)
    Request permission for commercial reuse | PDF file iconPDF (318 KB)
    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the capacity of a cascade of identical discrete memoryless nonsingular channels (Corresp.)

    Publication Year: 1970, Page(s):100 - 102
    Cited by:  Papers (9)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (380 KB)

    A simplified procedure for calculating the channel capacity of a cascade of<tex>N</tex>identical discrete memoryless nonsingular channels is presented. The result depends only upon the<tex>M</tex>eigenvalues and<tex>M</tex>eigenvectors of any one of the subchannel transition matrices. Thus, for small<tex>M</tex>and large<tex>N</tex>(the u... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Review of 'Probabilistic Information Theory, Discrete and Memoryless Models' (Jelinek, F.; 1968)

    Publication Year: 1970, Page(s): 103
    Request permission for commercial reuse | PDF file iconPDF (172 KB)
    Freely Available from IEEE
  • Review of 'Information Theory and Reliable Communication' (Gallager, R. G.; 1968)

    Publication Year: 1970, Page(s):103 - 104
    Cited by:  Papers (3)
    Request permission for commercial reuse | PDF file iconPDF (292 KB)
    Freely Available from IEEE

Aims & Scope

IEEE Transactions on Information Theory publishes papers concerned with the transmission, processing, and utilization of information.

Full Aims & Scope

Meet Our Editors

Editor-in-Chief
Alexander Barg

Department of Electrical and Computer Engineering and the Institute for Systems Research, University of Maryland

email: abarg-ittrans@ece.umd.edu