IEEE Transactions on Information Theory

Volume 28 Issue 6 • November 1982

Filter Results

Displaying Results 1 - 25 of 30
  • On the error exponent of source-channel transmission with a distortion threshold

    Publication Year: 1982, Page(s):823 - 828
    Cited by:  Papers (28)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (849 KB)

    The author's previous results on the exponent of probability of error for joint source-channel codes are improved and extended to distortion threshold fidelity criteria. The maximum error version of the problem is also considered. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Rate-distortion for correlated sources with partially separated encoders

    Publication Year: 1982, Page(s):828 - 840
    Cited by:  Papers (83)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1781 KB)

    We resolve some open problems concerning the encoding of a pair of correlated sources with respect to a fidelity criterion. Two encoders are used. One encoder observes only the output of the first source, while the other is supplied both with the second source output and with partial information about the first source at some predetermined rate. A general coding theorem is proved which established... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Multiple-access channels with different generalized feedback signals

    Publication Year: 1982, Page(s):841 - 850
    Cited by:  Papers (125)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1509 KB)

    This paper is concerned with a communication channel with two senders and one receiver, in which each sender observes a private feedback signal. The two feedback signals are not necessarily equivalent to or derived from the signal observed by the receiver. An achievable rate region is demonstrated for this multiple-access channel by means of a new superposition coding scheme. In particular it is s... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Achievable rates for multiple descriptions

    Publication Year: 1982, Page(s):851 - 857
    Cited by:  Papers (421)  |  Patents (8)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (902 KB)

    Consider a sequence of independent identically distributed (i.i.d.) random variablesX_{l},X_{2}, \cdots, X_{n}and a distortion measured(X_{i},X̂_{i})on the estimatesX̂_{i}ofX_{i}. Two descriptionsi(X)\in \{1,2, \cdots ,2^{nR_{1}\}andj(X)\in \{1,2, \cdots,2^{nR_{2}\}are given of the sequenceX=(X_{1}, X_{2}, \cdots ,X_{n}).... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Bent-function sequences

    Publication Year: 1982, Page(s):858 - 864
    Cited by:  Papers (122)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (933 KB)

    In this paper we construct a new family of nonlinear binary signal sets which achieve Welch's lower bound on simultaneous cross correlation and autocorrelation magnitudes. Given a parameter<tex>n</tex>with<tex>n=0 \pmod{4}</tex>, the period of the sequences is<tex>2^{n}-1</tex>, the number of sequences in the set is<tex>2^{n/2}</tex>, and the cross/a... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Maximal families of bent sequences

    Publication Year: 1982, Page(s):865 - 868
    Cited by:  Papers (30)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (507 KB)

    In a recent paper Olsen, Scholtz, and Welch (OSW) describe the use of bent functions to construct families of sequences with asymptotically optimal correlation properties. We show that the sequences produced by the OSW construction possess the claimed correlation properties if and only if the underlying bent functions are pairwise orthogonal. Consequently, the cardinality of a family of OSW sequen... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Bit-serial Reed - Solomon encoders

    Publication Year: 1982, Page(s):869 - 874
    Cited by:  Papers (155)  |  Patents (20)
    Request permission for commercial reuse | PDF file iconPDF (677 KB)
    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the power of straight- line computations in finite fields

    Publication Year: 1982, Page(s):875 - 880
    Cited by:  Papers (5)  |  Patents (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (986 KB)

    It is shown that a lower hound of<tex>n^{3}</tex>or more on the straight-line complexity of a function<tex>f</tex>over GF<tex>(2^{n})</tex>is also a lower bound on the network complexity of<tex>f</tex>and, hence, on the product of run time and program size of Turing machines. It is further shown that most functions over a finite field are hard to com... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Efficient run-length encodings

    Publication Year: 1982, Page(s):880 - 890
    Cited by:  Papers (28)  |  Patents (6)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1319 KB)

    A method for the noiseless coding of binary memoryless sources when the symbol probabilities are unknown is investigated. Codes of long block length are constructed from truncated run-length codes. Though not universal, the codes are shown to achieve high efficiencies over a wide range of symbol probabilities. Several generalizations of the basic scheme are also presented. The schemes presented in... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Adaptive digital matched filters

    Publication Year: 1982, Page(s):890 - 904
    Cited by:  Papers (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (2135 KB)

    A class of<tex>M</tex>-ary adaptive communication receivers, both taught and untaught, for signals whose waveforms are unknown {\em a priori} is described. The optimal<tex>M</tex>-ary taught receiver for binary-valued signals and the binary symmetric channel is studied in detail. It is shown that a bank of<tex>M</tex>adaptive digital correlators (or adaptive dig... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On a direct method of analysis and synthesis of the SPRT

    Publication Year: 1982, Page(s):905 - 911
    Cited by:  Papers (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (858 KB)

    The behavior of the sequential probability ratio test (SPRT) can be described using four performance measures, i.e., the probabilities of both types of error<tex>\alpha_{0}, \alpha_{1}</tex>, and the average test lengths (or sample sizes)<tex>E_{0}, E_{1}</tex>for the given decision problem. Whereas Bayes optimality of the SPRT is well-known from the work of Wald and Wolfow... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Asymptotic efficiencies of truncated sequential tests

    Publication Year: 1982, Page(s):911 - 923
    Cited by:  Papers (51)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1726 KB)

    Truncation of a sequential test with constant boundaries is considered for the problem of testing a location hypothesis:<tex>f(x- \theta_{0})</tex>versus<tex>f(x- \theta_{1})</tex>. A test design procedure is developed by using bounds for the error probabilities under the hypothesis and alternative. By viewing the truncated sequential test as a mixture of a sequential proba... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Structural characterization of locally optimum detectors in terms of locally optimum estimators and correlators

    Publication Year: 1982, Page(s):924 - 932
    Cited by:  Papers (18)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1314 KB)

    Explicit formulas for locally (SNR<tex>\rightarrow 0)</tex>optimum (MMSE) signal estimators (smoother, filter, and predictor) for discrete-time observations of a random signal in additive random noise are derived and used to characterize the locally optimum (likelihood ratio) signal detector for on-off signaling. The characterizations are canonical (distribution-free) detector structur... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The solution of the general equation for public key distribution systems (Corresp.)

    Publication Year: 1982, Page(s): 933
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (119 KB)

    A generalization of the public key distribution is derived. It is shown that the public key of any two members must obey a functional equation, which can be solved in a closed mathematical form. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Look-ahead coding for input- restricted channels (Corresp.)

    Publication Year: 1982, Page(s):933 - 937
    Cited by:  Papers (19)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (665 KB)

    A<tex>(k/n)</tex>code is a uniquely decipherable scheme mapping source words of length<tex>k</tex>into channel words of length<tex>n</tex>. In a look-ahead code the encoding and/or decoding of a current word may depend on upcoming, as well as past, symbols. Given an<tex>\theta</tex>-ary source, a channel of View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the existence of optimal quantizers (Corresp.)

    Publication Year: 1982, Page(s):937 - 940
    Cited by:  Papers (13)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (755 KB)

    The existence of optimal<tex>N</tex>-level quantizers is demonstrated for several classes of quantizers including block quantizers, memoryless quantizers, and uniform step-size quantizers. No assumptions whatsoever are made regarding the input probability distribution. The distortion measure considered generalizes many of the commonly used error-based distortion measures, including mea... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Detection and estimation of frequency-random signals (Corresp.)

    Publication Year: 1982, Page(s):940 - 946
    Cited by:  Papers (8)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1263 KB)

    A random frequency-varying signal is approximated by a finite-parameter model. A maximum {\em a posteriori} estimate of the parameter set leads to an estimation criterion, which when maximized is also the decision statistic obtained with an estimator-correlator detector. An efficient implementation of the frequency-parameter estimate (which corresponds to maximizing the criterion) is presented. Th... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Distance measures and estimation performance bounds for continuous-time data (Corresp.)

    Publication Year: 1982, Page(s):946 - 951
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (916 KB)

    Recursive expressions for certain distance measures between continuous-time stationary vector-Gaussian processes are derived and used to derive upper bounds to the mean square error performance of the Bayes and maximum-likelihood estimates of a parameter, when only a finite-valued parameter set is used. The question of convergence when the true parameter value does not belong to the finite set is ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Comment on "Anomalous behavior of receiver output SNR as a predictor of signal detection performance exemplified for quadratic receivers and incoherent fading Gaussian channels" by Gardner, W.A.

    Publication Year: 1982, Page(s):952 - 953
    Cited by:  Papers (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (300 KB)

    A previously published derivation of an optimal quadratic receiver with respect to a generalized signal-to-noise ratio is corrected, and a different performance measure is proposed for which a general analytical solution exists. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Reverse-time diffusion processes (Corresp.)

    Publication Year: 1982, Page(s):953 - 956
    Cited by:  Papers (9)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (556 KB)

    Given a diffusion process on<tex>{\bf R}^{n}</tex>described by a stochastic differential equation forward in time, we develop a corresponding stochastic differential equation in reverse time which yields the same sample paths. This stochastic differential equation can be used in problems of estimation and smoothing. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Cross-entropy minimization given fully decomposable subset and aggregate constraints (Corresp.)

    Publication Year: 1982, Page(s):956 - 961
    Cited by:  Papers (7)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1035 KB)

    The principle of maximum entropy and the principle of minimum cross-entropy (minimum directed divergence, minimum discrimination information) have been applied recently to problems in queuing theory and computer-system performance modeling. These information-theoretic principles estimate probability distributions based on information in the form of known expected values. In the case of queuing the... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the convexity of higher order Jensen differences based on entropy functions (Corresp.)

    Publication Year: 1982, Page(s):961 - 963
    Cited by:  Papers (18)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (468 KB)

    In an earlier work, the authors introduced a divergence measure, called the first-order Jensen difference, or in short<tex>\cal j</tex>-divergence, which is based on entropy functions of degree<tex>\alpha</tex>. This provided a generalization of the measure of mutual information based on Shannon's entropy (corresponding to<tex>\alpha = 1)</tex>. It was shown tha... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Some informational properties of the lognormal distribution (Corresp.)

    Publication Year: 1982, Page(s):963 - 966
    Cited by:  Papers (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (699 KB)

    The marginal, joint, and conditional entropy and the trans-information are derived for random variables with lognormal probability distributions, revealing some interesting deviations from its sister distribution, the normal. A maximal entropy property, capacity theorem for the lognormal channel, and implications for some nonlinear transformations are also presented. Potential applications of the ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Independent pairs of good self-dual codes (Corresp.)

    Publication Year: 1982, Page(s):966 - 967
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (351 KB)

    Let<tex>n \equiv 0 \pmod{8}</tex>. Then there are two self-dual binary codes of length<tex>n</tex>having only the zero and all-one vectors in common, having all weights divisible by four, and having minimum distances asymptotically the same as that given by the Varshamov-Gilbert bound. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The acceptance of information, its subjective cost and the measurement of distortion (Corresp.)

    Publication Year: 1982, Page(s):967 - 971
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (845 KB)

    A suitable operational definition of the subjective acceptability of an information source to a human user is shown to be the "probability of acceptance in a multiple-choice test." It is shown that acceptance probability relates directly to the user's statistical dependence on a given source. The notion of subjective cost of information is introduced as a concise way of defining such acceptance pr... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.

Aims & Scope

IEEE Transactions on Information Theory publishes papers concerned with the transmission, processing, and utilization of information.

Full Aims & Scope

Meet Our Editors

Editor-in-Chief
Alexander Barg

Department of Electrical and Computer Engineering and the Institute for Systems Research, University of Maryland

email: abarg-ittrans@ece.umd.edu