IRE Transactions on Information Theory

Issue 3 • September 1956

Filter Results

Displaying Results 1 - 19 of 19
  • The zero error capacity of a noisy channel

    Publication Year: 1956, Page(s):8 - 19
    Cited by:  Papers (396)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1495 KB)

    The zero error capacityC_oof a noisy channel is defined as the least upper bound of rates at which it is possible to transmit information with zero probability of error. Various properties ofC_oare studied; upper and lower bounds and methods of evaluation ofC_oare given. Inequalities are obtained for theC_orelating to the "sum" and "product" of two given... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A linear circuit viewpoint on error-correcting codes

    Publication Year: 1956, Page(s):20 - 28
    Cited by:  Papers (20)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (840 KB)

    A linear binary filter has as its output a binary sequence, each digit of which is the result of a parity check on a selection of preceding output digits and of present and preceding digits of the filter input sequence. The terminal properties of these filters may be described by transfer ratios of polynomials in a delay operator. If two binary filters have transfer ratios which are reciprocally r... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Theory of information feedback systems

    Publication Year: 1956, Page(s):29 - 40
    Cited by:  Papers (30)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1438 KB)

    A general information feedback system is defined and formulated in a way broad enough to allow coded or uncoded channels with total dr partial information feedback. Basic theorems governing change in information rate and reliability are derived with full consideration of the transition probabilities of both direct and feedback channels, including message words as well as the confirmation- denial s... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A linear coding for transmitting a set of correlated signals

    Publication Year: 1956, Page(s):41 - 46
    Cited by:  Papers (74)  |  Patents (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (613 KB)

    A coding scheme is described for the transmission ofncontinuous correlated signals overmchannels,mbeing equal to or less thann. Each of themsignals is a linear combination of thenoriginal signals. The coefficients of this linear transformation, which constitute anm times nmatrix, are constants of the coding scheme. For th... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On an application of semi groups methods to some problems in coding

    Publication Year: 1956, Page(s):47 - 60
    Cited by:  Papers (52)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1840 KB)

    First Page of the Article
    View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The logic theory machine--A complex information processing system

    Publication Year: 1956, Page(s):61 - 79
    Cited by:  Papers (188)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (2155 KB)

    In this paper we describe a complex information processing system, which we call the logic theory machine, that is capable of discovering proofs for theorems in symbolic logic. This system, in contrast to the systematic algorithms that are ordinarily employed in computation, relies heavily on heuristic methods similar to those that have been observed in . human problem solving activity. The specif... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Tests on a cell assembly theory of the action of the brain, using a large digital computer

    Publication Year: 1956, Page(s):80 - 93
    Cited by:  Papers (112)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1670 KB)

    Theories by D.O. Hebb and P.M. Milner on how the brain works were tested by simulating neuron nets on the IBM Type 704 Electronic Calculator. The formation of cell assemblies from an unorganized net of neurons was demonstrated, as well as a plausible mechanism for short-term memory and the phenomena of growth and fractionation of cell assemblies. The cell assemblies do not yet act just as the theo... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The measurement of third order probability distributions of television signals

    Publication Year: 1956, Page(s):94 - 105
    Cited by:  Papers (32)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1965 KB)

    A device has been built for the rapid, automatic measurement of the third order probability density of video signals. Special cathode ray tubes are used to perform a 64-level amplitude analysis on each signal. A triple coincidence is formed among the three analyzer outputs, the number of occurrences in a frame interval being stored in an 8 Mc counter. These numbers are recorded on magnetic tape wh... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Gap analysis and syntax

    Publication Year: 1956, Page(s):106 - 112
    Cited by:  Papers (6)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (883 KB)

    A statistical procedure has been tried as a method of investigating the structure of language with the aid of data processing machines. The frequency of gaps of various lengths between occurrences of two specified words is counted. The results are compared with what would be expected if the occurrences of the two words were statistically independent. Deviations from the expected number give clues ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Three models for the description of language

    Publication Year: 1956, Page(s):113 - 124
    Cited by:  Papers (534)  |  Patents (8)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1496 KB)

    We investigate several conceptions of linguistic structure to determine whether or not they can provide simple and "revealing" grammars that generate all of the sentences of English and only these. We find that no finite-state Markov process that produces symbols with transition from state to state can serve as an English grammar. Furthermore, the particular subclass of such processes that produce... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Some studies in the speed of visual perception

    Publication Year: 1956, Page(s):125 - 128
    Cited by:  Papers (47)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (508 KB)

    Statistical studies of television signals indicated a high degree of correlation between successive elements, lines and frames. A continuous test run indicated that the normalized detail content of actual broadcast signals run lower than 5 percent. The fact that most transmitted television scenes thus measured contained very little detail compared to some artificial subjects indicated that the obs... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Human memory and the storage of information

    Publication Year: 1956, Page(s):129 - 137
    Cited by:  Papers (52)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1237 KB)

    The amount of selective information in a message can be increased either by increasing the variety of the symbols from which it is composed or by increasing the length of the message. Psychological experiments indicate that the variety of the symbols is far less important than the length of the message in controlling what human subjects are able to remember. Two messages equal in length but differ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The human use of information--III: Decision-making in signal detection and recognition situations involving multiple alternatives

    Publication Year: 1956, Page(s):138 - 165
    Cited by:  Papers (11)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (2308 KB)

    A general theory of signal detectability, constructed after the model provided by decision theory, is applied to the performance of the human observer faced with the problem of choosing among multiple signal alternatives on the basis of a fixed, finite observation interval. An extension of the theory, previously reported, of deciding among two alternatives, is developed in detail, permitting the t... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On optimum non-linear extraction and coding filters

    Publication Year: 1956, Page(s):166 - 172
    Cited by:  Papers (9)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (697 KB)

    The problem of determining optimal non-linear least-square filters is solved for a class of stationary time series. This theory is then used as the basis for developing a band-width reduction scheme using non-linear encoding and decoding filters, for the same class of signals. A simple illustrative example is included. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Final-value systems with Gaussian inputs

    Publication Year: 1956, Page(s):173 - 175
    Cited by:  Papers (6)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (253 KB)

    A final-value system controls a response variabler(t)over a time interval(O,T)with the objective of minimizing the difference between a desired valuerhoand the final response valuer(T). An ensemble of situations is considered, and the system inputi(t)and the desired responserhoare random variables that are statistically related. Phy... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • An extension of the minimum mean square prediction theory for sampled input signals

    Publication Year: 1956, Page(s):176 - 184
    Cited by:  Papers (14)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (709 KB)

    A method is developed for finding the ordinates of a digital filter which will produce a general linear operator of the signalS(t)such that the mean square error of prediction will be a minimum. The input to the filter is sampled at intervalsDelta t. The samples contain stationary noiseN(jDelta t), a stationary signal component,M(jDelta t), and a nonrand... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A new interpretation of information rate

    Publication Year: 1956, Page(s):185 - 189
    Cited by:  Papers (90)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (556 KB)

    If the input symbols to a communication channel represent the outcomes of a chance event on which bets are available at odds consistent with their probabilities (i.e., "fair" odds), a gambler can use the knowledge given him by the received symbols to cause his money to grow exponentially. The maximum exponential rate of growth of the gambler's capital is equal to the rate of transmission of inform... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • An outline of a purely phenomenological theory of statistical thermodynamics--I: Canonical ensembles

    Publication Year: 1956, Page(s):190 - 203
    Cited by:  Papers (22)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1760 KB)

    "Boltzmann's problem" of statistical thermodynamics, is that of eliminating the paradoxical incompatibility of structure, existing between the irreversibility of the classical phenomenological thermodynamics, and the reversibility of any purely kinetic model, one could ever think of for these phenomena. One finds that, in order to construct kinetic "analogs" to the laws of phenomenological thermod... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A radar detection philosophy

    Publication Year: 1956, Page(s):204 - 221
    Cited by:  Papers (91)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (2434 KB)

    This paper is an attempt to present a short, unified discussion of the radar detection, parameter estimation, and multiple-signal resolution problems--mostly from a philosophical rather than a detailed mathematical point of view. The purpose is, hopefully, to make it possible in at least some limited sense to reason back from appropriate measures of desired radar performance to specifications of t... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.

Aims & Scope

This Transactions ceased production in 1962. The current retitled publication is IEEE Transactions on Information Theory.

Full Aims & Scope