 EdisonCruise
Topic Author
Posts: 117
Joined: September 15th, 2012, 4:22 am

### Is HJB equation a local or global optimum?

I am a bit confused on the HJB equation. In the derivation of Hamilton?Jacobi?Bellman (HJB) equation, we take the first order optimality at each time step, so that the trading strategy is optimum over the next infinitesimal time step. It seems that this strategy gives only local optimum, which is not necessarily a global optimum.However, from the verification theorem (www.math.nyu.edu/faculty/kohn/pde.finan ... ction4.pdf), it seems to be a global optimum. On the other hand, from WIKI ?When solved locally, the HJB is a necessary condition, but when solved over the whole of state space, the HJB equation is a necessary and sufficient condition for an optimum.? So what?s the difference between solving locally and globally?Thank you. davidhigh
Posts: 11
Joined: March 2nd, 2015, 9:09 pm

### Is HJB equation a local or global optimum?

The funny thing here is that you scratch your head only as you forgot the assumptions. You are completely right, a sequence of local optima doesn't make up to the global optimum. If it were like this optimization theory would be complete at the level of greedy functions.However, the HJB (or its discrete version, the Bellman equation) is exactly designed for those kind of problems, where it is exactly like this, i.e. where a sequence of local optima leads to the global optimum. The same in another terms: the property an optimization problem needs to satisfy in order to be treated by the dynamic programming method is "Optimal substructure".
Last edited by davidhigh on March 5th, 2015, 11:00 pm, edited 1 time in total.  