IEEE Transactions on Information Theory

Volume 17 Issue 1 • January 1971

Filter Results

Displaying Results 1 - 25 of 28
  • Stochastic point processes and multicoincidences

    Publication Year: 1971, Page(s):2 - 7
    Cited by:  Papers (10)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (810 KB)

    In this paper stochastic point processes (PP) are studied by means of coincidence probabilities (CP). After a definition and short review of these CP, it is shown that they provide a complete statistical description of the PP. All the statistics of the resulting shot noise are derived and time intervals between successive occurrences are studied and related to CP. Some new applications, including ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Finite-time averaged power spectra

    Publication Year: 1971, Page(s):7 - 16
    Cited by:  Papers (7)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1248 KB)

    This paper deals with harmonizable nonstationary second-order stochastic processes. The approximations and hypotheses that are necessary to derive a spectral distribution for the finite-time averaged power are first considered. Then the class of asymptotically stationary processes is defined; an expression is established for the spectral distribution of its finite-time averaged power; and the stat... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the expansion of a bivariate distribution and its relationship to the output of a nolinearity

    Publication Year: 1971, Page(s):17 - 25
    Cited by:  Papers (7)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1230 KB)

    The series expansion of a bivariate distribution and the series expansion of the output of a nonlinearity are considered, as well as the relationship between these two problems. Three distinct expansions of bivariate distributions are presented along with a constructive procedure to obtain them explicitly. The cross-covarianee property and certain results on the expansion of the output of a nonlin... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Shaping filter representation of nonstationary colored noise

    Publication Year: 1971, Page(s):26 - 31
    Cited by:  Papers (13)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (837 KB)

    The problem of determining a shaping filter for nonstationary colored noise is considered. The shaping filter transforms white noise into a possibly nonstationary random process (having no white noise component) with a specified covariance function. A set of conditions to be satisfied by the covariance function leads to the determination of a shaping filter. The shaping filter coefficients are sim... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Output signal-to-noise ratios of FM correlation systems

    Publication Year: 1971, Page(s):32 - 36
    Cited by:  Papers (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (527 KB)

    An analysis is presented on the output signal-to-noise ratios for the FM correlation systems having an FM detector in each input channel of a conventional correlator. The input consists of a frequency-modulated signal combined additively with stationary narrow-band Gaussian random noise. A general expression is derived for the output signal-to-noise ratio. A detailed calculation is made for the ou... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Reconstructions of signals of a known class from a given set of linear measurements

    Publication Year: 1971, Page(s):37 - 44
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1115 KB)

    This paper investigates the error in reconstructions of a signal based on a given finite set of linear measurements, and presents two schemes that, if there is available a priori knowledge of the class of signals of which the measured signal is a member, can achieve a reduction of this error beyond the best that could be done without such knowledge. The error measure used is the supremum over the ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Nonlinear interpolation

    Publication Year: 1971, Page(s):45 - 49
    Cited by:  Papers (10)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (625 KB)

    The nonlinear interpolation problem is formulated in state variable form. Using the techniques of nonlinear filter theory, an exact solution is obtained in the sense that a partial differential equation for the evolution of the conditional probability density of the state vector at a fixed point in time is derived. The solution for the finite-dimensional-state space case is determined since it has... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Robust detection of a known signal in nearly Gaussian noise

    Publication Year: 1971, Page(s):50 - 56
    Cited by:  Papers (97)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (984 KB)

    A detector that is not nonparametric, but that nevertheless performs well over a broad class of noise distributions is termed a robust detector. One possible way to obtain a certain degree of robustness or stability is to look for a min-max solution. For the problem of detecting a signal of known form in additive, nearly Gaussian noise, the solution to the min-max problem is obtained when the sign... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Feedback equalization for fading dispersive channels

    Publication Year: 1971, Page(s):56 - 64
    Cited by:  Papers (125)  |  Patents (17)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1274 KB)

    Data transmission through a slowly fading dispersive channel is considered. A receiver that linearly operates on both the received signal and reconstructed data is postulated. Assuming an absence of decision errors, the receiver is optimized for a minimum-mean-square-error criterion. Transfer functions are determined and superiority over nonfeedback receivers is indicated. The feedback receiver ca... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Convergence to the rate-distortion function for Gaussian sources

    Publication Year: 1971, Page(s):65 - 70
    Cited by:  Papers (5)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (746 KB)

    In this paper we derive an expression for the minimum-mean-square error achievable in encoding<tex>t</tex>samples of a stationary correlated Gaussian source. It is assumed that the source output is not known exactly but is corrupted by correlated Gaussian noise. The expression is obtained in terms of the covariance matrices of the source and noise sequences. It is shown that as<tex&... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The source coding game

    Publication Year: 1971, Page(s):71 - 76
    Cited by:  Papers (15)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (857 KB)

    The encoding of a source whose probability distribution varies arbitrarily from letter to letter is considered. The problem is formulated as a two-person statistical game. The exponential rate of growth with block length of the minimum number of codewords needed to achieve a specified fidelity with respect to a single-letter distortion measure is determined. The rate distortion function of a sourc... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The complexity of decoders--II: Computational work and decoding time

    Publication Year: 1971, Page(s):77 - 85
    Cited by:  Papers (9)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1467 KB)

    The computational work and the time required to decode with reliability<tex>E</tex>at code rate<tex>R</tex>on noisy channels are defined, and bounds on the size of these measures are developed. A number of ad hoc decoding procedures are ranked on the basis of the computational work they require. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Cyclic and multiresidue codes for arithmetic operations

    Publication Year: 1971, Page(s):85 - 91
    Cited by:  Papers (21)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1128 KB)

    In this paper, the cyclic nature of<tex>AN</tex>codes is defined after a brief summary of previous work in this area is given. New results are shown in the determination of the range for single-error-correcting<tex>AN</tex>codes when<tex>A</tex>is the product of two odd primes<tex>p_1</tex>and<tex>p_2</tex>, given the orders of 2 modulo&l... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Some asymptotically optimal burst-correcting codes and their relation to single-error-correcting Reed-Solomon codes

    Publication Year: 1971, Page(s):92 - 95
    Cited by:  Papers (8)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (494 KB)

    A class of asymptotically optimal burst-correcting codes that are closely related to the Fire codes is defined. The codes are quasi-cyclic as defined by Townsend and Weldon. However, decoding can be accomplished with a very simple algorithm similar to that used for cyclic burst-correcting codes. It is shown that these codes are equivalent to certain Reed-Solomon codes. From this it follows that su... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the direct calculation of MMSE of linear realizable estimator by Toeplitz form method (Corresp.)

    Publication Year: 1971, Page(s):95 - 97
    Cited by:  Papers (11)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (389 KB)

    In this correspondence, the Toeplitz form method is used in the direct calculation of the MMSE resulting from linear realizable mean-square interpolation, extrapolation, and filtering of certain classes of signal sequences in additive (not necessarily white) noise sequences. Further simplification results when the signal plus noise forma a<tex>p</tex>th-order auto-regressive random seq... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Realization of filter-squarer receivers (Corresp.)

    Publication Year: 1971, Page(s):97 - 101
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (738 KB)

    Sufficient conditions for the realization of a causal filter-squarer receiver for the detection of a Gaussian signal in white Gaussian noise are established. Special consideration is given to a Gaussian signal that is the projection of a vector Gauss-Markov process. For this case, the causal filter-squarer receiver is shown to be related to the Kalman-Bucy filter for estimatng the underlying vecto... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Resolution of overlapping random signals (Corresp.)

    Publication Year: 1971, Page(s):101 - 104
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (630 KB)

    This correspondence is concerned with the estimation and resolution of overlapping random signals in additive noise. Two resolution schemes are presented; one is optimal and the other has computational advantages. It is shown that the overlapping signals are not resolvable if the eigenfunctions constitute a complete basis. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Reply to 'Finite memory hypothesis testing - Comments on a critique' by Cover, T.M., and Hellman, M.E.

    Publication Year: 1971, Page(s):104 - 105
    Cited by:  Papers (5)
    Request permission for commercial reuse | PDF file iconPDF (324 KB)
    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Comments on "Nonparametric feature selection" by Patrick, E.A., and Fisher, E.P.

    Publication Year: 1971, Page(s):105 - 106
    Cited by:  Papers (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (282 KB)

    In applications with high-dimensional spaces and relatively few samples, difficulties can arise in the feature selection algorithm proposed by Patrick and Fischer. This correspondence suggests a modification that overcomes these difficulties with little, if any, computational penalty. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Author's reply to 'Comment on Nonparametric Feature Selection'

    Publication Year: 1971, Page(s): 106
    Request permission for commercial reuse | PDF file iconPDF (144 KB)
    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Supervised learning sequential structure and parameter adaptive pattern recognition: Discrete data case (Corresp.)

    Publication Year: 1971, Page(s):106 - 110
    Cited by:  Papers (10)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (481 KB)

    In a previous paper [1], Bayes-optimal recursive supervised learning structure and parameter adaptive pattern recognition systems were derived for continuous "lumped" Gaussian processes. In this paper, the discrete data case is considered, and the discrete data version of the partition theorem is derived. Several examples are also presented of the application of the adaptive detectors, and computa... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Rate distortion over band-limited feedback channels (Corresp.)

    Publication Year: 1971, Page(s):110 - 112
    Cited by:  Papers (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (475 KB)

    Although linear feedback is by itself sufficient to achieve capacity of an additive Gaussian white noise (AGWN) channel, it can not, in general, achieve the theoretical minimum mean-squared error for analog Gaussian data. This correspondence gives the necessary and sufficient conditions under which this optimum performance can be achieved. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Information rates of stochastically driven dynamic systems (Corresp.)

    Publication Year: 1971, Page(s):113 - 114
    Cited by:  Papers (7)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (291 KB)

    An expression is given for the mean-squared-error (MSE) rate distortion curve of a linear finite-memory Gaussian dynamic system; for a range of small MSE, it coincides with that of the excitation noise vector.<tex>R(D)</tex>curves of non-Gaussian and nonlinear dynamic systems are analyzed, also. The results are applicable to determining information requirements for communication and co... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the capacity of a finite-state channel (Corresp.)

    Publication Year: 1971, Page(s):114 - 116
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (475 KB)

    For the case where the channel states are the same as the channel outputs a simple necessary and sufficient condition is given to determine when the capacity of a finite-state channel is positive. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • kth-Order Near-Orthogonal Codes (Corresp.)

    Publication Year: 1971, Page(s):116 - 117
    Cited by:  Papers (23)
    Request permission for commercial reuse | PDF file iconPDF (348 KB)
    Full text access may be available. Click article title to sign in or learn about subscription options.

Aims & Scope

IEEE Transactions on Information Theory publishes papers concerned with the transmission, processing, and utilization of information.

Full Aims & Scope

Meet Our Editors

Editor-in-Chief
Alexander Barg

Department of Electrical and Computer Engineering and the Institute for Systems Research, University of Maryland

email: abarg-ittrans@ece.umd.edu