After doing some reading on decision under un-certainity, I get the feeling that this I will be looking more into this. More so because I have the feeling like there is more to this field, lot of unknowns yet(which is still partly due to my lack of profound knowledge in the field). I feel this field is yet to mature.

Solution to Hamilton-Jacobi-Bellman (great story on how the -Bellman part was added to the equation) has been worked by several researchers, but I am looking into the prospect of applying the same under ‘uncertainity’.

The problem:
\[ V(x(0), 0) = \min_u \int_0^T C[x(t),u(t)]\,dt + D[x(T)] \]

The Solution:
\[ \dot{V}(x,t) + \min_u ( \nabla V(x,t) \cdot F(x, u) + C(x,u) ) = 0 \]

usual constraints and conditions apply, full description at this wiki page

Last one month, I did some work; tried my hand with varies forms of solution. I looked into Stochastic Approaches in CFD simulations (Stochastic collocation), Chebyshev Polynomials, Galerkin Approximation, Pontryagin Maximum Principle). But I have failed and right now in life other priorities (grad-school applications) is keeping me from giving another serious look. (This work was part of the reason why no blog posts for a whole month).

I want to come back to this topic and work more, in the meantime, I am making note of some of the papers and materials I referred and will be doing so again in the near future.

Light introduction and derivation of Hamilton-Jacobi-Bellman

Ian Mitchell

http://www.cs.ubc.ca/~mitchell/Class/CS532M.2007W2/Talks/hjbSham.pdf

general read

Stochastic Perron’s method for Hamilton-Jacobi-Bellman equations

Bayraktar et al

http://arxiv.org/abs/1212.2170

• new approach *

Hamilton-Jacobi-Bellman Equations – Analysis and Numerical Analysis

Iain Smears

http://www.maths.dur.ac.uk/Ug/projects/highlights/PR4/Smears_HJB_report.pdf

• Complete Thesis *

Stochastic Approaches To Uncertainity Quantification In CFD Simulations

Mathelin et al

http://perso.limsi.fr/Individu/mathelin/research/NumUNC_MHZ.pdf

• Inspiration from CFD *

Solution of Hamilton Jacobi Bellman Equations

Navasca et al

http://people.clarkson.edu/~cnavasca/KN1.pdf

• using Pontryagin maximum principle *

Potential use of Ito lemma

See this equation