样式: 排序: IF: - GO 导出 标记为已读
-
Stochastic Maximum Principle for Subdiffusions and Its Applications SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-03-14 Shuaiqi Zhang, Zhen-Qing Chen
SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 953-981, April 2024. Abstract. In this paper, we study optimal stochastic control problems for stochastic systems driven by non-Markov subdiffusion [math], which have mixed features of deterministic and stochastic controls. Here [math] is the standard Brownian motion on [math], and [math] is the inverse of a subordinator [math] with
-
Stability Analysis for Nonlinear Neutral Stochastic Functional Differential Equations SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-03-07 Huabin Chen, Chenggui Yuan
SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 924-952, April 2024. Abstract. This paper provides some sufficient conditions for the existence and uniqueness and the stochastic stability of the global solution for nonlinear neutral stochastic functional differential equations. When the drift term and the diffusion term satisfy a locally Lipschitz condition, and the Lyapunov monotonicity
-
Viscosity Solutions for McKean–Vlasov Control on a Torus SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-03-05 H. Mete Soner, Qinxin Yan
SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 903-923, April 2024. Abstract. An optimal control problem in the space of probability measures and the viscosity solutions of the corresponding dynamic programming equations defined using the intrinsic linear derivative are studied. The value function is shown to be Lipschitz continuous with respect to a smooth Fourier–Wasserstein metric
-
Verification Methods for the Lyapunov–Krasovskii Functional Inequalities SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-03-04 Ali Diab, Giorgio Valmorbida, William Pasillas-Lépine
SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 877-902, April 2024. Abstract. We study parameterizations of Lyapunov–Krasovskii functionals (LKFs) to analyze the stability of linear time-delay systems. We discuss the solution to the delay Lyapunov matrix, which constructs an LKF associated with a prescribed time derivative, and relate it to the approaches commonly used in the numerical
-
Long-Run Impulse Control with Generalized Discounting SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-03-04 Damian Jelito, Łukasz Stettner
SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 853-876, April 2024. Abstract. In this paper, we investigate the effects of applying generalized (nonexponential) discounting on a long-run impulse control problem for a Feller–Markov process. We show that the optimal value of the discounted problem is the same as the optimal value of its undiscounted version. Next, we prove that an
-
On Global Approximate Controllability of a Quantum Particle in a Box by Moving Walls SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-03-04 Aitor Balmaseda, Davide Lonigro, Juan Manuel Pérez-Pardo
SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 826-852, April 2024. Abstract. We study a system composed of a free quantum particle trapped in a box whose walls can change their position. We prove the global approximate controllability of the system: any initial pure state can be driven arbitrarily close to any target pure state in the Hilbert space of the free particle with a predetermined
-
Learning Stationary Nash Equilibrium Policies in [math]-Player Stochastic Games with Independent Chains SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-03-01 S. Rasoul Etesami
SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 799-825, April 2024. Abstract. We consider a subclass of [math]-player stochastic games, in which players have their own internal state/action spaces while they are coupled through their payoff functions. It is assumed that players’ internal chains are driven by independent transition probabilities. Moreover, players can receive only
-
Spectral Factorization of Rank-Deficient Rational Densities SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-20 Wenqi Cao, Anders Lindquist
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 776-798, February 2024. Abstract. Though there are hundreds of papers on rational spectral factorization, most of them are concerned with full-rank spectral densities. In this paper we propose a novel approach for spectral factorization of a rank-deficient spectral density, leading to a minimum-phase full-rank spectral factor, in both
-
Turnpike Properties for Mean-Field Linear-Quadratic Optimal Control Problems SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-16 Jingrui Sun, Jiongmin Yong
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 752-775, February 2024. Abstract. This paper is concerned with an optimal control problem for a mean-field linear stochastic differential equation with a quadratic functional in the infinite time horizon. Under suitable conditions, including the stabilizability, the (strong) exponential, integral, and mean-square turnpike properties
-
Leader-Following Rendezvous Control for Generalized Cucker-Smale Model on Riemannian Manifolds SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-16 Xiaoyu Li, Yuhu Wu, Lining Ru
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 724-751, February 2024. Abstract. This paper studies a leader-following rendezvous problem for the generalized Cucker–Smale model, a double-integrator multiagent system, on some Riemannian manifolds. By using intrinsic properties of the covariant derivative, logarithmic map, and parallel transport on the Riemannian manifolds, we design
-
On the Modeling of Impulse Control with Random Effects for Continuous Markov Processes SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-15 Kurt L. Helmes, Richard H. Stockbridge, Chao Zhu
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 699-723, February 2024. Abstract. The use of coordinate processes for the modeling of impulse control for general Markov processes typically involves the construction of a probability measure on a countable product of copies of the path space. In addition, admissibility of an impulse control policy requires that the random times of
-
Optimal Control Duality and the Douglas–Rachford Algorithm SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-12 Regina S. Burachik, Bethany I. Caldwell, C. Yalçin Kaya, Walaa M. Moursi
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 680-698, February 2024. Abstract. We explore the relationship between the dual of a weighted minimum-energy control problem, a special case of linear-quadratic optimal control problems, and the Douglas–Rachford (DR) algorithm. We obtain an expression for the fixed point of the DR operator as applied to solving the optimal control problem
-
Primal-Dual Regression Approach for Markov Decision Processes with General State and Action Spaces SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-12 Denis Belomestny, John Schoenmakers
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 650-679, February 2024. Abstract. We develop a regression-based primal-dual martingale approach for solving discrete time, finite-horizon MDPs. The state and action spaces may be finite or infinite (but regular enough) subsets of Euclidean space. Consequently, our method allows for the construction of tight upper and lower-biased approximations
-
A Stability Result for a Degenerate Beam Equation SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-09 Alessandro Camasta, Genni Fragnelli
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 630-649, February 2024. Abstract. We consider a beam equation in the presence of a leading degenerate operator which is not in divergence form. We impose clamped conditions where the degeneracy occurs and dissipative conditions at the other endpoint. We provide some conditions for the uniform exponential decay of solutions for the associated
-
Optimal Control and Signaling Strategies of Control-Coding Capacity of General Decision Models: Applications to Gaussian Models and Decentralized Strategies SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-08 Charalambos D. Charalambous, Christos K. Kourtellaris, Ioannis Tzortzis
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 600-629, February 2024. Abstract. We investigate the control-coding (CC) capacity of general dynamical decision models (DMs) that involve nonlinear filtering, which is absent in the specific DMs investigated in [C. K. Kourtellaris and C. D. Charalambous, IEEE Trans. Inform. Theory, 64 (2018), pp. 4962–4992]. We derive characterizations
-
Stability of Abstract Interconnected Systems with a Possibly Unstable Component SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-07 Ivan Atamas, Sergey Dashkovskiy, Vitalii Slynko
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 581-599, February 2024. Abstract. We consider an interconnection of a one-dimensional ODE and an infinite dimensional abstract differential equation in view of the asymptotic stability. Sufficient stability conditions are obtained under the assumption that the whole system is positive with respect to the Minkowski cone. The decoupled
-
Exact Controllability for a Refined Stochastic Wave Equation SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-07 Zhonghua Liao, Qi Lü
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 563-580, February 2024. Abstract. In this paper, we obtain the exact controllability for a refined stochastic wave equation with three controls by establishing a novel Carleman estimate for a backward hyperbolic-like operator. Compared with the known result [Q. Lü and X Zhang, Mathematical Control Theory for Stochastic Partial Differential
-
Exact Controllability and Stabilization for Linear Dispersive PDE’s on the Two-Dimensional Torus SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-07 Francisco J. Vielma-Leal, Ademir Pastor
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 539-562, February 2024. Abstract. The moment method is used to prove the exact controllability of a wide class of bidimensional linear dispersive PDE’s posed on the two-dimensional torus [math]. The control function is considered to be acting on a small vertical and horizontal strip of the torus. Our results apply to several well-known
-
The Global Maximum Principle for Optimal Control of Partially Observed Stochastic Systems Driven by Fractional Brownian Motion SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-06 Yueyang Zheng, Yaozhong Hu
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 509-538, February 2024. Abstract. In this paper we study the stochastic control problem of a partially observed (multidimensional) stochastic system driven by both Brownian motions and fractional Brownian motions. In the absence of the powerful tool of Girsanov transformation, we introduce and study new stochastic processes which are
-
The Nonlocal Kelvin Principle and the Dual Approach to Nonlocal Control in the Conduction Coefficients SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-02 Anton Evgrafov, José C. Bellido
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 487-508, February 2024. Abstract. We explore the dual approach to nonlocal optimal control in the coefficients, specifically for a classical min-max problem which in this study is associated with a nonlocal scalar diffusion equation. We reformulate the optimal control problem utilizing a dual variational principle, which is expressed
-
Admissibility and Observability of Jeffreys Type of Overdamped Second Order Linear Systems SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-02 Jian-Hua Chen, Xian-Feng Zhao, Hua-Cheng Zhou
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 466-486, February 2024. Abstract. We study Jeffreys-type overdamped second order linear systems with observed outputs in the setting of Hilbert spaces. The state equation comes from an overdamped second order linear partial differential equation which is wave-like but was proposed to describe heat conduction. It results from adopting
-
Stabilization for Wave Equation with Localized Kelvin–Voigt Damping on Cuboidal Domain: A Degenerate Case SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-01 Zhong-Jie Han, Zhuangyi Liu, Kai Yu
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 441-465, February 2024. Abstract. In this paper, we study the stabilization issue for a multidimensional wave equation with localized Kelvin–Voigt damping on a cuboidal domain, in which the damping region does not satisfy the geometric control condition (GCC). The variable damping coefficient is assumed to be degenerate near the interface
-
A Viscous Ergodic Problem with Unbounded and Measurable Ingredients, Part 1: HJB Equation SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-02-01 Hicham Kouhkouh
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 415-440, February 2024. Abstract. We address the problem of existence and uniqueness of solutions [math] to ergodic Hamilton–Jacobi–Bellman (HJB) equations of the form [math] in the whole space [math] with unbounded and merely measurable data and where [math] is a Bellman Hamiltonian. The method we use is different from classical approaches
-
A Stability Dichotomy for Discrete-Time Linear Switching Systems in Dimension Two SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-31 Ian D. Morris
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 400-414, February 2024. Abstract. We prove that, for every discrete-time linear switching system in two complex variables and with finitely many switching states, either the system is Lyapunov stable or there exists a trajectory which escapes to infinity with at least linear speed. We also give a checkable algebraic criterion to distinguish
-
Nonlinear Consensus+Innovations under Correlated Heavy-Tailed Noises: Mean Square Convergence Rate and Asymptotics SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-29 Manojlo Vukovic, Dusan Jakovetic, Dragana Bajovic, Soummya Kar
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 376-399, February 2024. Abstract. We consider distributed recursive estimation of consensus+innovations type in the presence of heavy-tailed sensing and communication noises. We allow that the sensing and communication noises are mutually correlated while independent and identically distributed in time, and that they may both have infinite
-
Learning Optimal Policies in Potential Mean Field Games: Smoothed Policy Iteration Algorithms SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-24 Qing Tang, Jiahao Song
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 351-375, February 2024. Abstract. We introduce two smoothed policy iteration algorithms (SPIs) as rules for learning policies and methods for computing Nash equilibria in second order potential mean field games (MFGs). Global convergence is proved if the coupling term in the MFG system satisfies the Lasry–Lions monotonicity condition
-
Discrete-Time Approximation of Stochastic Optimal Control with Partial Observation SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-23 Yunzhang Li, Xiaolu Tan, Shanjian Tang
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 326-350, February 2024. Abstract. We consider a class of stochastic optimal control problems with partial observation, and study their approximation by discrete-time control problems. We establish a convergence result by using the weak convergence technique of Kushner and Dupuis [Numerical Methods for Stochastic Control Problems in
-
Sampled-Data Finite-Dimensional Observer-Based Control of 1D Stochastic Parabolic PDEs SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-23 Pengfei Wang, Emilia Fridman
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 297-325, February 2024. Abstract. Sampled-data control of PDEs has become an active research area; however, existing results are confined to deterministic PDEs. Sampled-data controller design of stochastic PDEs is a challenging open problem. In this paper we suggest a solution to this problem for 1D stochastic diffusion-reaction equations
-
Maximum Principles for Optimal Control Problems with Differential Inclusions SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-23 A. D. Ioffe
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 271-296, February 2024. Abstract. There are three different forms of adjoint inclusions that appear in the most advanced necessary optimality conditions for optimal control problems involving differential inclusions: Euler–Lagrange inclusion (with partial convexification) [A. D. Ioffe, J. Optim. Theory Appl., 182 (2019), pp. 285–309]
-
MF-OMO: An Optimization Formulation of Mean-Field Games SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-22 Xin Guo, Anran Hu, Junzi Zhang
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 243-270, February 2024. Abstract. This paper proposes a new mathematical paradigm to analyze discrete-time mean-field games. It is shown that finding Nash equilibrium solutions for a general class of discrete-time mean-field games is equivalent to solving an optimization problem with bounded variables and simple convex constraints,
-
Analysis of RHC for Stabilization of Nonautonomous Parabolic Equations Under Uncertainty SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-19 Behzad Azmi, Lukas Herrmann, Karl Kunisch
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 220-242, February 2024. Abstract. Stabilization of a class of time-varying parabolic equations with uncertain input data using receding horizon control (RHC) is investigated. The diffusion coefficient and the initial function are prescribed as random fields. We consider both cases: uniform and log-normal distributions of the diffusion
-
Stochastic Fixed-Point Iterations for Nonexpansive Maps: Convergence and Error Bounds SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-18 Mario Bravo, Roberto Cominetti
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 191-219, February 2024. Abstract. We study a stochastically perturbed version of the well-known Krasnoselskii–Mann iteration for computing fixed points of nonexpansive maps in finite dimensional normed spaces. We discuss sufficient conditions on the stochastic noise and stepsizes that guarantee almost sure convergence of the iterates
-
State Estimation with Event Sensors: Observability Analysis and Multi-sensor Fusion SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-17 Xinhui Liu, Kaikai Zheng, Dawei Shi, Tongwen Chen
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 167-190, February 2024. Abstract. This work investigates a state estimation problem for linear time-invariant systems based on polarized measurement information from event sensors. To enable estimator design, a new notion of observability, namely, [math]-observability is defined with the precision parameter [math] which relates to the
-
Optimal Scheduling of Entropy Regularizer for Continuous-Time Linear-Quadratic Reinforcement Learning SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-17 Lukasz Szpruch, Tanut Treetanthiploet, Yufei Zhang
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 135-166, February 2024. Abstract. This work uses the entropy-regularized relaxed stochastic control perspective as a principled framework for designing reinforcement learning (RL) algorithms. Herein, an agent interacts with the environment by generating noisy controls distributed according to the optimal relaxed policy. The noisy policies
-
On Converse Lyapunov Theorem for Fixed-Time Input-to-State Stability SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-12 Denis Efimov, Andrey Polyakov
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 118-134, February 2024. Abstract. Input-to-state stability is one of the most utilizable robust stability properties for nonlinear dynamical systems, while (nearly) fixed-time convergence is a kind of decay for trajectories of disturbance-free systems that is independent in initial conditions. The presence of both these features for
-
The Maximality Principle in Singular Control with Absorption and Its Applications to the Dividend Problem SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-12 Tiziano De Angelis, Erik Ekström, Marcus Olofsson
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 91-117, February 2024. Abstract. Motivated by a new formulation of the classical dividend problem, we show that Peskir’s maximality principle can be transferred to singular stochastic control problems with two-dimensional degenerate dynamics and absorption along the diagonal of the state space. We construct an optimal control as a Skorokhod
-
Extreme Occupation Measures in Markov Decision Processes with an Absorbing State SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-12 Alexey Piunovskiy, Yi Zhang
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 65-90, February 2024. Abstract. In this paper, we consider a Markov decision process (MDP) with a Borel state space [math], where [math] is an absorbing state (cemetery), and a Borel action space [math]. We consider the space of finite occupation measures restricted on [math] and the extreme points in it. It is possible that some strategies
-
An Irreducible Linear Switching System Whose Unique Barabanov Norm Is Not Strictly Convex SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-10 Ian D. Morris
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 42-64, February 2024. Abstract. We construct a marginally stable linear switching system in continuous time, in four dimensions, and with three switching states, which is exponentially stable with respect to constant switching laws and which has a unique Barabanov norm, but such that the Barabanov norm fails to be strictly convex. This
-
On BIBO Stability of Infinite-Dimensional Linear State-Space Systems SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-03 Felix L. Schwenninger, Alexander A. Wierzba, Hans Zwart
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 22-41, February 2024. Abstract. In this paper we consider bounded-input-bounded-output (BIBO) stability of systems described by infinite-dimensional linear state-space representations, filling the so far unattended gap of a formal definition and characterization of BIBO stability in this general case. Furthermore, we provide several
-
Relaxed Excitation Conditions for Robust Identification and Adaptive Control Using Estimation with Memory SIAM J. Control Optim. (IF 2.2) Pub Date : 2024-01-03 Javier Gallegos, Norelys Aguila-Camacho
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 1-21, February 2024. Abstract. In this paper, adaptive controllers are designed to track a given trajectory for linear and nonlinear systems. No condition on the tracked trajectory, other than continuity and boundedness, is needed to simultaneously ensure exponential convergence to the tracking reference, exponential convergence to
-
Process-Controllability of Semilinear Evolution Equations and Applications SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-12-07 Yixing Liang, Zhenbin Fan, Gang Li
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3664-3694, December 2023. Abstract. This article focuses on the controllability for a class of semilinear evolution equations and applications to some specific differential equations. Without assuming compactness or equicontinuity of the related semigroups, the existence of mild solutions of semilinear equations in Hilbert space is
-
The Partial Controllability of Linear Stochastic Control Systems with Terminal Constraints and Its Applications to Game-Based Control Systems with Jumps SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-12-07 Yuanzhuo Song
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3635-3663, December 2023. Abstract. In this paper, we consider the partial controllability of linear stochastic control systems with terminal constraints. Some necessary and sufficient conditions for this controllability are obtained with the help of backward stochastic differential equations (BSDEs). We establish the equivalence between
-
Spike Variations for Stochastic Volterra Integral Equations SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-12-07 Tianxiao Wang, Jiongmin Yong
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3608-3634, December 2023. Abstract. The spike variation technique plays a crucial role in deriving Pontryagin’s type maximum principle of optimal controls for ordinary differential equations (ODEs), partial differential equations (PDEs), stochastic differential equations (SDEs), and (deterministic forward) Volterra integral equations
-
On Disturbance-to-State Adaptive Stabilization without Parameter Bound by Nonlinear Feedback of Delayed State and Input SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-12-06 Iasson Karafyllis, Miroslav Krstic, Alexandros Aslanidis
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3584-3607, December 2023. Abstract. We complete the first step toward the resolution of several decades-old challenges in disturbance-robust adaptive control. For a scalar system with an unknown parameter for which no a priori bound is given, with a disturbance that is of unlimited magnitude and possibly persistent (not square integrable)
-
An Integrated Transportation Distance between Kernels and Approximate Dynamic Risk Evaluation in Markov Systems SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-12-05 Zhengqi Lin, Andrzej Ruszczyński
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3559-3583, December 2023. Abstract. We introduce a distance between kernels based on the Wasserstein distances between their values, study its properties, and prove that it is a metric on an appropriately defined space of kernels. We also relate it to various modes of convergence in the space of kernels. Then we consider the problem
-
Linear Convergence of a Policy Gradient Method for Some Finite Horizon Continuous Time Control Problems SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-29 Christoph Reisinger, Wolfgang Stockinger, Yufei Zhang
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3526-3558, December 2023. Abstract. Despite its popularity in the reinforcement learning community, a provably convergent policy gradient method for continuous space-time control problems with nonlinear state dynamics has been elusive. This paper proposes proximal gradient algorithms for feedback controls of finite-time horizon stochastic
-
Exact Controllability for a Schrödinger Equation with Dynamic Boundary Conditions SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-17 Alberto Mercado, Roberto Morales
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3501-3525, December 2023. Abstract. In this paper, we study the controllability of a Schrödinger equation with mixed boundary conditions on disjoint subsets of the boundary: dynamic boundary condition of Wentzell type and Dirichlet boundary condition. The main result of this article is given by new Carleman estimates for the associated
-
Maximum Principle for Optimal Control of Stochastic Evolution Equations with Recursive Utilities SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-17 Guomin Liu, Shanjian Tang
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3467-3500, December 2023. Abstract. We consider the optimal control problem of stochastic evolution equations in a Hilbert space under a recursive utility, which is described as the solution of a backward stochastic differential equation (BSDE). A very general maximum principle is given for the optimal control, allowing the control
-
Mean-Field Approximations for Stochastic Population Processes with Heterogeneous Interactions SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-16 Anirudh Sridhar, Soummya Kar
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3442-3466, December 2023. Abstract. This paper studies a general class of stochastic population processes in which agents interact with one another over a network. Agents update their behaviors in a random and decentralized manner according to a policy that depends only on the agent’s current state and an estimate of the macroscopic
-
On Integer Optimal Control with Total Variation Regularization on Multidimensional Domains SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-15 Paul Manns, Annika Schiemann
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3415-3441, December 2023. Abstract. We consider optimal control problems with integer-valued controls and a total variation regularization penalty in the objective on domains of dimension two or higher. The penalty yields that the feasible set is sequentially closed in the weak-[math] topology and closed in the strict topology in the
-
Interior Point Methods in Optimal Control Problems of Affine Systems: Convergence Results and Solving Algorithms SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-15 Paul Malisani
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3390-3414, December 2023. Abstract. This paper presents an interior point method for pure state and mixed-constraint optimal control problems for dynamics, mixed constraints, and cost function all affine in the control variable. This method relies on resolving a sequence of two-point boundary value problems of differential and algebraic
-
An Optimal Control Problem with Terminal Stochastic Linear Complementarity Constraints SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-14 Jianfeng Luo, Xiaojun Chen
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3370-3389, December 2023. Abstract. In this paper, we investigate an optimal control problem with a crucial ODE constraint involving a terminal stochastic LCP and its discrete approximation using the relaxation, the sample average approximation (SAA), and the implicit Euler time-stepping scheme. We show the existence of feasible solutions
-
An Algebraic Convergence Rate for the Optimal Control of McKean–Vlasov Dynamics SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-09 Pierre Cardaliaguet, Samuel Daudin, Joe Jackson, Panagiotis E. Souganidis
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3341-3369, December 2023. Abstract. We establish an algebraic rate of convergence of the value functions of [math]-particle stochastic control problems towards the value function of the corresponding McKean–Vlasov problem, also known as mean field control. The rate is obtained in the presence of both idiosyncratic and common noises
-
Exact Controllability of the Vortex System by Means of a Single Vortex SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-07 Justine Dorsz, Olivier Glass
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3316-3340, December 2023. Abstract. In this paper, we investigate the controllability of the point vortex system by means of a single vortex. The point vortex system is a well-known simplified model for the incompressible Euler equation, where the vorticity is concentrated in a finite number of Dirac masses. We use one of the vortices
-
Second-Order Hamilton–Jacobi PDE Problems and Certain Related First-Order Problems, Part 1: Approximation SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-06 William M. McEneaney, Peter M. Dower, Tao Wang
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3280-3315, December 2023. Abstract. A class of nonlinear, stochastic staticization control problems (including minimization problems with smooth, convex, coercive payoffs) driven by diffusion dynamics with constant diffusion coefficient is considered. The nonlinearities are addressed through stat duality. The second-order Hamilton–Jacobi
-
Stochastic Stabilization of Neutral Stochastic Delay Systems Based on Discrete Observations SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-11-03 Fangzhe Wan, Xueyan Zhao, Feiqi Deng, Peilin Yu, Xiongding Liu
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3259-3279, December 2023. Abstract. This paper addresses the problem of stochastic stabilization for the neutral stochastic delay systems (NSDSs) based on discrete observations. Specifically, we design sampled-data based controllers (SDBCs) to stabilize NSDSs. To conquer the difficulties caused by the neutral term and stochastic stabilization
-
Kullback–Leibler-Quadratic Optimal Control SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-10-25 Neil Cammardella, Ana Bušić, Sean P. Meyn
SIAM Journal on Control and Optimization, Volume 61, Issue 5, Page 3234-3258, October 2023. Abstract. This paper presents approaches to mean-field control, motivated by distributed control of multiagent systems. Control solutions are based on a convex optimization problem, whose domain is a convex set of probability mass functions (pmfs). The main contributions follow: (1) Kullback–Leibler-quadratic
-
Vector Control Lyapunov and Barrier Functions for Safe Stabilization of Interconnected Systems SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-10-25 Wei Ren, Jingjie Li, Junlin Xiong, Xi-Ming Sun
SIAM Journal on Control and Optimization, Volume 61, Issue 5, Page 3209-3233, October 2023. Abstract. In this paper, we investigate the safety and stabilization problems of interconnected nonlinear systems. In particular, different subsystems may involve potentially conflicting control objectives and distributed safety constraints. For this purpose, we first propose a novel vector control Lyapunov
-
Adaptive Optimal Control of Linear Discrete-Time Networked Control Systems with Two-Channel Stochastic Dropouts SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-10-24 Yi Jiang, Weinan Gao, Ci Chen, Tianyou Chai, Frank L. Lewis
SIAM Journal on Control and Optimization, Volume 61, Issue 5, Page 3183-3208, October 2023. Abstract. This paper investigates the adaptive optimal control problem and proposes fundamentally novel non-model-based approaches for linear discrete-time networked control systems (NCSs) with both sensor and actuator two-channel stochastic dropouts by using directly the data transmitted via communication networks
-
An Optimal Control Problem Subject to Strong Solutions of Chemotaxis-Consumption Models SIAM J. Control Optim. (IF 2.2) Pub Date : 2023-10-20 Francisco Guillén-González, André Luiz Corrêa Vianna Filho
SIAM Journal on Control and Optimization, Volume 61, Issue 5, Page 3156-3182, October 2023. Abstract. We consider a bilinear optimal control problem associated to the following chemotaxis-consumption model in a bounded domain [math] during a time interval [math]: [math], with [math], endowed with isolated boundary conditions and initial conditions for [math], [math] being the cell density, [math] the