Skip to content

DCT Lexicon · Governing Dynamics

HJB Equations and Viscosity Solutions

In continuous time, Bellman's recursion becomes a nonlinear partial differential equation for the value function. Viscosity solutions make sense of it when the value function has kinks.

DCT Governing Dynamics

In depth

Formal statement

For dXt=b(Xt,ut) dt+σ(Xt,ut) dWtdX_t = b(X_t,u_t)\,dt + \sigma(X_t,u_t)\,dW_t and discount rate ρ\rho, the value function solves the Hamilton–Jacobi–Bellman equation:

ρV(x)  =  sup⁡u∈U{r(x,u)+b(x,u)⊤∇V(x)+12 tr(σσ⊤(x,u) ∇2V(x))}\rho V(x) \;=\; \sup_{u \in U} \Big\{ r(x,u) + b(x,u)^{\top} \nabla V(x) + \tfrac12\, \mathrm{tr}\big(\sigma\sigma^{\top}(x,u)\, \nabla^2 V(x)\big) \Big\}φ∈C2,  V−φ has a local max at x0  ⟹  ρV(x0)≤sup⁡u{r+b⊤∇φ+12tr(σσ⊤∇2φ)}(x0)\varphi \in C^2,\; V - \varphi \text{ has a local max at } x_0 \;\Longrightarrow\; \rho V(x_0) \le \sup_u \{ r + b^{\top}\nabla\varphi + \tfrac12 \mathrm{tr}(\sigma\sigma^{\top}\nabla^2\varphi) \}(x_0)

DCT Governing Dynamics: the element's drawer (/governing-dynamics)

Crandall–Lions uniqueness

Under Lipschitz coefficients and a comparison principle, the value function is the unique viscosity solution of the HJB equation, even where it is not differentiable. Monotone, stable, consistent schemes converge to it (Barles–Souganidis).

DCT Governing Dynamics: the element's drawer (/governing-dynamics)

In DCT

State constraints (a liquidity floor, a capability floor) create kinks and corners in the value function exactly where the commitments bind. Viscosity solutions keep the theory valid there, and the corners are where the prices of commitments jump.

DCT Governing Dynamics: the element's drawer (/governing-dynamics)

Limits

Classical solutions rarely exist under constraints or degenerate noise. Numerical schemes must be monotone to converge to the right solution; non-monotone high-order schemes can converge to a wrong one.

DCT Governing Dynamics: the element's drawer (/governing-dynamics)

Go next

  • Forward–Backward SDEs and Costates: The gradient of the value function is the costate of the FBSDE.
  • Occupation Measures: The HJB equation's dual is a linear program over occupation measures.
  • Dynamic Risk Measures: Risk-sensitive control changes the Hamiltonian to a dynamic risk measure.

DCT Governing Dynamics: the element's drawer (/governing-dynamics)

References

  • Crandall, Ishii & Lions (1992), User's guide to viscosity solutions
  • Fleming & Soner (2006), Controlled Markov Processes and Viscosity Solutions
  • Barles & Souganidis (1991)

DCT Governing Dynamics: the element's drawer (/governing-dynamics)

In the book: Vol. II, Ch. 8: Hamilton–Jacobi–Bellman Enterprise Framework · Vol. II, Ch. 6: Optimal Control of Enterprise Systems

Related: Forward–Backward SDEs and Costates · Occupation Measures · Dynamic Risk Measures

GD.12

Dynamic Corporate Transformation — Volume I: Foundations and Mathematical Framework; Volume II: Enterprise Optimization & Applications
Jump to any chapter

Volume I: Foundations and Mathematical Framework

  1. Ch. 1Introduction to Dynamic Corporate Transformation
  2. Ch. 2Enterprise Systems and Transformation
  3. Ch. 3Mathematical Foundations
  4. Ch. 4Enterprise Modeling Principles
  5. Ch. 5Enterprise State Representation
  6. Ch. 6Enterprise Transformation Operators
  7. Ch. 7Dynamic Enterprise Systems
  8. Ch. 8Stochastic Enterprise Dynamics
  9. Ch. 9Enterprise State Architecture
  10. Ch. 10Enterprise Capital Architecture
  11. Ch. 11Enterprise Performance Architecture
  12. Ch. 12Enterprise Risk, Resilience, and Robustness Architecture
  13. Ch. 13Unified Enterprise Transformation Architecture
  14. Ch. 14Mathematical Analysis of the Unified Enterprise Transformation Architecture
  15. Ch. 15Mathematical Formulation of Enterprise Optimization
  16. Ch. 16Synthesis, Future Directions, and Transition to Volume II

Volume II: Enterprise Optimization & Applications

  1. Ch. 1Introduction to Enterprise Optimization
  2. Ch. 2The General Enterprise Optimization Problem Revisited
  3. Ch. 3Convex Enterprise Optimization
  4. Ch. 4Nonlinear and Mixed-Integer Enterprise Optimization
  5. Ch. 5Dynamic Enterprise Optimization
  6. Ch. 6Optimal Control of Enterprise Systems
  7. Ch. 7Dynamic Programming for Enterprise Systems
  8. Ch. 8Hamilton–Jacobi–Bellman Enterprise Framework
  9. Ch. 9Stochastic Enterprise Optimization
  10. Ch. 10Neuro-Fuzzy Robust Enterprise Optimization
  11. Ch. 11Distributionally Robust Enterprise Optimization
  12. Ch. 12Multi-Objective Enterprise Optimization
  13. Ch. 13Machine Learning for Enterprise Transformation
  14. Ch. 14Artificial Intelligence for Enterprise Optimization
  15. Ch. 15Enterprise Digital Twins and Autonomous Enterprise Transformation
  16. Ch. 16Enterprise Applications and Integrated Transformation Case Studies

Dynamic Corporate Transformation

Springer Nature · Management for Professionals · Forthcoming 2027

  • Volume I — Foundations and Mathematical Framework
  • Volume II — Enterprise Optimization & Applications
Buy Volume I: Dynamic Corporate Transformation: Foundations and Mathematical FrameworkBuy Volume II: Dynamic Corporate Transformation: Enterprise Optimization & Applications
Jump to any chapter

Volume I: Foundations and Mathematical Framework

  1. Ch. 1Introduction to Dynamic Corporate Transformation
  2. Ch. 2Enterprise Systems and Transformation
  3. Ch. 3Mathematical Foundations
  4. Ch. 4Enterprise Modeling Principles
  5. Ch. 5Enterprise State Representation
  6. Ch. 6Enterprise Transformation Operators
  7. Ch. 7Dynamic Enterprise Systems
  8. Ch. 8Stochastic Enterprise Dynamics
  9. Ch. 9Enterprise State Architecture
  10. Ch. 10Enterprise Capital Architecture
  11. Ch. 11Enterprise Performance Architecture
  12. Ch. 12Enterprise Risk, Resilience, and Robustness Architecture
  13. Ch. 13Unified Enterprise Transformation Architecture
  14. Ch. 14Mathematical Analysis of the Unified Enterprise Transformation Architecture
  15. Ch. 15Mathematical Formulation of Enterprise Optimization
  16. Ch. 16Synthesis, Future Directions, and Transition to Volume II

Volume II: Enterprise Optimization & Applications

  1. Ch. 1Introduction to Enterprise Optimization
  2. Ch. 2The General Enterprise Optimization Problem Revisited
  3. Ch. 3Convex Enterprise Optimization
  4. Ch. 4Nonlinear and Mixed-Integer Enterprise Optimization
  5. Ch. 5Dynamic Enterprise Optimization
  6. Ch. 6Optimal Control of Enterprise Systems
  7. Ch. 7Dynamic Programming for Enterprise Systems
  8. Ch. 8Hamilton–Jacobi–Bellman Enterprise Framework
  9. Ch. 9Stochastic Enterprise Optimization
  10. Ch. 10Neuro-Fuzzy Robust Enterprise Optimization
  11. Ch. 11Distributionally Robust Enterprise Optimization
  12. Ch. 12Multi-Objective Enterprise Optimization
  13. Ch. 13Machine Learning for Enterprise Transformation
  14. Ch. 14Artificial Intelligence for Enterprise Optimization
  15. Ch. 15Enterprise Digital Twins and Autonomous Enterprise Transformation
  16. Ch. 16Enterprise Applications and Integrated Transformation Case Studies