By Topic

IEEE Transactions on Automatic Control

Issue 5 • Date October 1981

Filter Results

Displaying Results 1 - 25 of 29
  • [Front cover and table of contents]

    Publication Year: 1981, Page(s): 0
    Request permission for commercial reuse | PDF file iconPDF (196 KB)
    Freely Available from IEEE
  • Foreword [Intro. to the Bellman Special Issue]

    Publication Year: 1981, Page(s):986 - 987
    Cited by:  Papers (16)
    Request permission for commercial reuse | PDF file iconPDF (187 KB)
    Freely Available from IEEE
  • [Back cover]

    Publication Year: 1981, Page(s): 0
    Request permission for commercial reuse | PDF file iconPDF (1697 KB)
    Freely Available from IEEE
  • Applications of dynamic programming and other optimization methods in pest management

    Publication Year: 1981, Page(s):1125 - 1132
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1024 KB)

    Pest management is a multistage decision process in a stochastic and observable system. A control model of a pest ecosystem is characterized by discontinuous cost functions and nonlinear, stochastic state equations describing the interactions among a large namber of ecosystem components. Dynamic programming has been the optimization technique which has been most widely applied to pest management a... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Dynamic programming for noncausal problems

    Publication Year: 1981, Page(s):1041 - 1047
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (632 KB)

    The theory of dynamic programming as used in most control applications relies heavily on the causal structure of the underlying dynamics. In this survey paper, we will show noncausal problems, such as those arising in partial differential equations, multidimensional smoothing and filtering, and digital image processing can often be converted into causal problems by imposing a causal vector structu... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Priority assignment using dynamic programming for a class of queueing systems

    Publication Year: 1981, Page(s):1095 - 1106
    Cited by:  Papers (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1064 KB)

    This paper deals with the problem of allocating attention among multiple tasks in a supervisory control system. The situation is modeled in the framework of a single server priority queueing system. Using Bellman's principle of optimality, a functional equation for the optimal, state dependent, preempt resume priority policy is obtained, and an efficient recursive technique is proposed for its com... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On convergence of the recursive identification algorithms

    Publication Year: 1981, Page(s):1009 - 1017
    Cited by:  Papers (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (832 KB)

    The paper is concerned with identification of a linear dynamic system through recursive algorithms of the approximate maximum likelihood (AML) method. In all papers on the convergence of the recursive AML procedure, no matter what method of analysis is used, a certain rather restrictive positive real condition is imposed on the model of disturbance. In this work, it is shown that recursive AML alg... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Quasi-solutions, vector Lyapunov functions, and monotone method

    Publication Year: 1981, Page(s):1149 - 1153
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (544 KB)

    The notion of quasi-solution which was introduced earlier has been developed in this paper. Further, the notion of coupled quasi-solutions and coupled maximal and minimal solutions has been introduced. It is shown that the idea of quasi-solutions leads to isolated subsystems, and has obtained error estimates between solutions and quasi-solutions. Also, monotone iterative techniques have been devel... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Generalized decompositions of dynamic systems and vector Lyapunov functions

    Publication Year: 1981, Page(s):1118 - 1125
    Cited by:  Papers (14)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (776 KB)

    The notion of decomposition is generalized to provide more freedom in constructing vector Lyapunov functions for stability analysis of nonlinear dynamic systems. A generalized decomposition is defined as a disjoint decomposition of a system which is obtained by expanding the state-space of a given system. An inclusion principle is formulated for the solutions of the expansion to include the soluti... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • General theory of best variants choice: Some aspects

    Publication Year: 1981, Page(s):1030 - 1040
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1224 KB)

    The conventional mechanisms of making the best choice, in particular, optimization mechanisms, make explicit or implicit use of the structural principle of "pair comparability" for variants and of the specific logic of the "dominant" rule for choice. This paper argues for going beyond the framework of "pairness-dominance" on the structures and rules of choice and for using "nonconventional" struct... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A remark on an equation of dynamic programming

    Publication Year: 1981, Page(s):988 - 993
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (416 KB)

    Some unilatral problems arising from dynamic programming are discussed. The main interest is in the number of solutions of the problem. In particular, an example with exactly two solutions is studied. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • The certainty equivalence property in stochastic control theory

    Publication Year: 1981, Page(s):1080 - 1087
    Cited by:  Papers (13)  |  Patents (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (776 KB)

    In this paper we will give a general formulation of the certainty equivalence principle for stochastic optimal control problems. Special attention is paid to the question: "What do we mean by a certainty equivalence control law?" It is then shown that in this context the LQG-problem is indeed certainty equivalent. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Some properties of the dual adaptive stochastic control algorithm

    Publication Year: 1981, Page(s):1001 - 1008
    Cited by:  Papers (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (720 KB)

    The purpose of this paper is to compare analytically the properties of the suboptimal dual adaptive stochastic control with those of the optimal control, when plant dynamic contain multiplicative white noise parameters. A simple scalar example is used for this analysis. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Time-varying feedback laws for decentralized control

    Publication Year: 1981, Page(s):1133 - 1139
    Cited by:  Papers (83)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (768 KB)

    Decentralized control schemes are considered for time-invariant, finite dimensional, linear systems with know state equations. It is assumed that the systems are reachable and observable at a fictitious centralized control station, and that there is strong connectivity between the decentralized control stations via the system where necessary. It is shown that whether or not there are decentralized... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On existence and nonexistence of limit cycles in interconnected systems

    Publication Year: 1981, Page(s):1153 - 1169
    Cited by:  Papers (5)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1336 KB)

    In this paper we establish conditions which ensure the existence and the nonexistence of self-excited oscillations (limit cycles) in complex dynamical systems. We consider those types of systems which can be viewed as an interconnection of several simpler subsystems. Our results are phrased in terms of the qualitative properties of the free subsystems and in terms of the system interconnecting str... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Optimal control of a class of nonlinear stochastic systems

    Publication Year: 1981, Page(s):1048 - 1054
    Cited by:  Papers (7)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (696 KB)

    Bellman's principle of optimality and dynamic programming are shown to be the basis for solution of a physically significant class of nonlinear stochastic control problems. Various previous results are integrated into a survey here, and a new result which extends the separation principle is presented. Certain bilinear and linear-in-control systems are included in the analysis. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Asymptotic methods in the theory of optimal control

    Publication Year: 1981, Page(s):993 - 1000
    Cited by:  Papers (1)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (792 KB)

    The paper gives a survey of some works devoted to methods of the small parameter for the solution of optimal control problems. It is well known that these problems are difficult both for analytical and numerical approaches. Exact analytical solutions exist only for specific classes of optimal control problems. A numerical solution is possible for optimal program (open-loop) controls, but it become... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Aspects of dynamic programming in signal and image processing

    Publication Year: 1981, Page(s):1018 - 1029
    Cited by:  Papers (25)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1048 KB)

    The techniques peculiar to dynamic programming have found a variety of successful applications in the theory and practice of modern control. Successes in the theory and practice of signal and image processing are less numerous and prominent, but they do exist. In this paper, we sound a call for renewed attention to the potential of dynamic programming for solving knotty, nonlinear filtering proble... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Techniques in the identification of deterministic systems

    Publication Year: 1981, Page(s):1169 - 1176
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (888 KB)

    The paper deals with the problem of identifying the constants in a system described by linear ordinary or partial differential equations on the basis of noise-free observations. The techniques presented are derived from the ideas of R. Bellman and include applications of quasi-linearization, differential approximation, and dynamic programming. From knowledge of available input-output data, a numer... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Microprocessor-based controller for pharmacodynamical applications

    Publication Year: 1981, Page(s):1208 - 1213
    Cited by:  Papers (23)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (632 KB)

    To design an automatic drug delivery system for the purpose of keeping the output as close as possible to a desired value, the system input-output is first represented as an autoregressive model. A minimum variance controller is then designed to solve the control problem. The implementation of the controller is performed on a microprocessor. As a specific application, the control of the mean arter... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Singular perturbation results for a class of stochastic control problems

    Publication Year: 1981, Page(s):1071 - 1080
    Cited by:  Papers (4)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (640 KB)

    Composite control originally proposed in a deterministic context is generalized to the problem with white-noise inputs. However, the approach used here is radically different from the deterministic approach. Presence of noise smoothes the system behavior and allows a more complete solution than in the deterministic case. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Continuous state feedback guaranteeing uniform ultimate boundedness for uncertain dynamic systems

    Publication Year: 1981, Page(s):1139 - 1144
    Cited by:  Papers (481)  |  Patents (2)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (528 KB)

    We consider a dynamic system containing uncertain elements. Only the set of possible values of these uncertainties is known. Based on this information a class of state feedback controls is proposed in order to guarantee uniform ultimate boundedness of every system response within an arbitrarily small neighborhood of the zero state. These feedback controls are continuous functions of the state. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • A singular perturbation approach to modeling and control of Markov chains

    Publication Year: 1981, Page(s):1087 - 1094
    Cited by:  Papers (61)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (696 KB)

    Finite state continuous time Markov processes with weak interactions are modeled as singularly perturbed systems. Aggregate states are obtained using a grouping algorithm. Two-time scale expansions simplify cost equations and lead to decentralized optimization algorithms. View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • On the optimal solution of the one-armed bandit adaptive control problem

    Publication Year: 1981, Page(s):1176 - 1184
    Cited by:  Papers (3)
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (816 KB)

    The "one-armed bandit" problem of Bellman is a classic problem in sequential adaptive control. It is important a) for its own direct applications and b) since it is the simplest problem in the important class of Bayesian adaptive control problems. As in other such problems, even though the dynamic programming equation for the optimal expected return may be written down by inspection, it is extreme... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.
  • Perturbation analysis of a system of quasi-variational inequalities for optimal stochastic scheduling

    Publication Year: 1981, Page(s):1054 - 1070
    Request permission for commercial reuse | Click to expandAbstract | PDF file iconPDF (1560 KB)

    Optimal scheduling of continuously evolving dynamical systems involves the analysis of certain partial differential inequalities on solution dependent domains. These are the "quasi-variatlonai inequalities" (QVI's) introduced for such problems by A. Bensoussan and J. L. Lions. They arise naturally in such applications as inventory control and unit commitment scheduling in electric energy systems. ... View full abstract»

    Full text access may be available. Click article title to sign in or learn about subscription options.

Aims & Scope

In the IEEE Transactions on Automatic Control, the IEEE Control Systems Society publishes high-quality papers on the theory, design, and applications of control engineering.  Two types of contributions are regularly considered

Full Aims & Scope

Meet Our Editors

Editor-in-Chief
P. J. Antsaklis
Dept. Electrical Engineering
University of Notre Dame