Numerical methods for controlled Hamilton-Jacobi-Bellman PDEs in finance

Peter A. Forsyth, George Labahn

Abstract

ABSTRACT

Many nonlinear option pricing problems can be formulated as optimal control problems, leading to Hamilton–Jacobi–Bellman (HJB) or Hamilton– Jacobi–Bellman–Isaacs (HJBI) equations. We show that such formulations are very convenient for developing monotone discretization methods that ensure convergence to the financially relevant solution, which in this case is the viscosity solution. In addition, for the HJB-type equations, we can guarantee convergence of a Newton-type (policy) iteration scheme for the nonlinear discretized algebraic equations. However, in some cases, the Newton-type iteration cannot be guaranteed to converge (for example, the HJBI case), or can be very costly (for example, for jump processes). In this case, we can use a piecewise constant control approximation. While we use a very general approach, we also include numerical examples for the specific interesting case of option pricing with unequal borrowing/lending costs and stock borrowing fees