Skip to content

DCT Lexicon · Robustness

Kullback–Leibler divergence

KL(Q ∥ P)

\mathrmKL(Q \Vert P) = \mathbbE_Q \log(dQ/dP): how far a law Q reweights the futures of P.

Vol. II, Glossary of Key Terms, p. 399, its first sentence

In depth

In the book

KL(Q∥P)=EQlog⁡(dQ/dP)\mathrm{KL}(Q \Vert P) = \mathbb{E}_Q \log(dQ/dP), how far a law QQ reweights the futures of PP. A ball of radius dd keeps a chance α\alpha exactly when the law keeps the smaller α′\alpha' with kl(α∥α′)=d\mathrm{kl}(\alpha \Vert \alpha') = d; its dual is the entropic criterion (Theorem 11.2).

Vol. II, Glossary of Key Terms, p. 399, verbatim

Formal statement

Let Pd={Q:KL(Q∥P)≤d}\mathcal{P}_d = \{Q : \mathrm{KL}(Q \Vert P) \le d\}, d>0d > 0. (i) Dual form. For a bounded loss LL, sup⁡Q∈PdEQL=inf⁡θ>0{θlog⁡EPeL/θ+θd}.\sup_{Q \in \mathcal{P}_d} \mathbb{E}_Q L = \inf_{\theta > 0} \big\{\theta \log \mathbb{E}_P e^{L/\theta} + \theta d\big\}. (ii) Worst chance. For an event of chance pp under PP, the worst chance over the ball is the q≥pq \ge p with kl(q∥p)=qlog⁡(q/p)+(1−q)log⁡((1−q)/(1−p))=d\mathrm{kl}(q \Vert p) = q\log(q/p) + (1-q)\log\big((1-q)/(1-p)\big) = d, or 1 if log⁡(1/p)≤d\log(1/p) \le d.

Vol. II, Theorem 11.2(i)–(ii) (Divergence Families), verbatim

Executive example

Over a Kullback–Leibler ball of radius d around Chapter 9’s law: the worst chance of a breach of Volume I’s package, 5 percent under the law, and the chance the law must keep for the ball to keep 5 percent; dashed, the radii of the records’ doubts (closures 0.44, spread 0.60, both 1.04).

Vol. II, Figure 11.1 caption, verbatim

Common misreading

A common mistake is to size a ball by intuition rather than by the doubts it must hold.

Vol. II, LOS 11.2, verbatim

How AXIOM uses it

On the Robust vs optimal tab, for each Kullback–Leibler radius AXIOM computes the appetite the plan must keep under the declared law for the ball to keep the board's appetite, and the plan Optimize finds there. No radius is assumed: the curve is shown across radii.

Drafted for the author's approval, from AXIOM's method passport "Robust plan and the cost of doubt" (D-063)

In the book: Vol. II, Ch. 11: Distributionally Robust Enterprise Optimization

Related: Wasserstein Distributionally Robust Optimization · Price of robustness (cost of doubt) · Robust optimization (max-min plan)

V2.Thm.11.2 · V2.Def.11.1 · V2.WE.11.1

Dynamic Corporate Transformation — Volume I: Foundations and Mathematical Framework; Volume II: Enterprise Optimization & Applications
Jump to any chapter

Volume I: Foundations and Mathematical Framework

  1. Ch. 1Introduction to Dynamic Corporate Transformation
  2. Ch. 2Enterprise Systems and Transformation
  3. Ch. 3Mathematical Foundations
  4. Ch. 4Enterprise Modeling Principles
  5. Ch. 5Enterprise State Representation
  6. Ch. 6Enterprise Transformation Operators
  7. Ch. 7Dynamic Enterprise Systems
  8. Ch. 8Stochastic Enterprise Dynamics
  9. Ch. 9Enterprise State Architecture
  10. Ch. 10Enterprise Capital Architecture
  11. Ch. 11Enterprise Performance Architecture
  12. Ch. 12Enterprise Risk, Resilience, and Robustness Architecture
  13. Ch. 13Unified Enterprise Transformation Architecture
  14. Ch. 14Mathematical Analysis of the Unified Enterprise Transformation Architecture
  15. Ch. 15Mathematical Formulation of Enterprise Optimization
  16. Ch. 16Synthesis, Future Directions, and Transition to Volume II

Volume II: Enterprise Optimization & Applications

  1. Ch. 1Introduction to Enterprise Optimization
  2. Ch. 2The General Enterprise Optimization Problem Revisited
  3. Ch. 3Convex Enterprise Optimization
  4. Ch. 4Nonlinear and Mixed-Integer Enterprise Optimization
  5. Ch. 5Dynamic Enterprise Optimization
  6. Ch. 6Optimal Control of Enterprise Systems
  7. Ch. 7Dynamic Programming for Enterprise Systems
  8. Ch. 8Hamilton–Jacobi–Bellman Enterprise Framework
  9. Ch. 9Stochastic Enterprise Optimization
  10. Ch. 10Neuro-Fuzzy Robust Enterprise Optimization
  11. Ch. 11Distributionally Robust Enterprise Optimization
  12. Ch. 12Multi-Objective Enterprise Optimization
  13. Ch. 13Machine Learning for Enterprise Transformation
  14. Ch. 14Artificial Intelligence for Enterprise Optimization
  15. Ch. 15Enterprise Digital Twins and Autonomous Enterprise Transformation
  16. Ch. 16Enterprise Applications and Integrated Transformation Case Studies

Dynamic Corporate Transformation

Springer Nature · Management for Professionals · Forthcoming 2027

  • Volume I — Foundations and Mathematical Framework
  • Volume II — Enterprise Optimization & Applications
Buy Volume I: Dynamic Corporate Transformation: Foundations and Mathematical FrameworkBuy Volume II: Dynamic Corporate Transformation: Enterprise Optimization & Applications
Jump to any chapter

Volume I: Foundations and Mathematical Framework

  1. Ch. 1Introduction to Dynamic Corporate Transformation
  2. Ch. 2Enterprise Systems and Transformation
  3. Ch. 3Mathematical Foundations
  4. Ch. 4Enterprise Modeling Principles
  5. Ch. 5Enterprise State Representation
  6. Ch. 6Enterprise Transformation Operators
  7. Ch. 7Dynamic Enterprise Systems
  8. Ch. 8Stochastic Enterprise Dynamics
  9. Ch. 9Enterprise State Architecture
  10. Ch. 10Enterprise Capital Architecture
  11. Ch. 11Enterprise Performance Architecture
  12. Ch. 12Enterprise Risk, Resilience, and Robustness Architecture
  13. Ch. 13Unified Enterprise Transformation Architecture
  14. Ch. 14Mathematical Analysis of the Unified Enterprise Transformation Architecture
  15. Ch. 15Mathematical Formulation of Enterprise Optimization
  16. Ch. 16Synthesis, Future Directions, and Transition to Volume II

Volume II: Enterprise Optimization & Applications

  1. Ch. 1Introduction to Enterprise Optimization
  2. Ch. 2The General Enterprise Optimization Problem Revisited
  3. Ch. 3Convex Enterprise Optimization
  4. Ch. 4Nonlinear and Mixed-Integer Enterprise Optimization
  5. Ch. 5Dynamic Enterprise Optimization
  6. Ch. 6Optimal Control of Enterprise Systems
  7. Ch. 7Dynamic Programming for Enterprise Systems
  8. Ch. 8Hamilton–Jacobi–Bellman Enterprise Framework
  9. Ch. 9Stochastic Enterprise Optimization
  10. Ch. 10Neuro-Fuzzy Robust Enterprise Optimization
  11. Ch. 11Distributionally Robust Enterprise Optimization
  12. Ch. 12Multi-Objective Enterprise Optimization
  13. Ch. 13Machine Learning for Enterprise Transformation
  14. Ch. 14Artificial Intelligence for Enterprise Optimization
  15. Ch. 15Enterprise Digital Twins and Autonomous Enterprise Transformation
  16. Ch. 16Enterprise Applications and Integrated Transformation Case Studies